6 Hits in 1.7 sec

STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentation [article]

Zhengkai Jiang, Zhangxuan Gu, Jinlong Peng, Hang Zhou, Liang Liu, Yabiao Wang, Ying Tai, Chengjie Wang, Liqing Zhang
2022 arXiv   pre-print
Video Instance Segmentation (VIS) is a task that simultaneously requires classification, segmentation, and instance association in a video.  ...  We hope the proposed framework can serve as a simple and strong alternative for many other instance-level video association tasks. Code will be made available.  ...  Feature-aggregation methods [21] enhance features through pixel-wise or instance-wise aggregation from adjacent frames similarly to other video tasks, like video object detection [19, 41] .  ... 
arXiv:2202.03747v1 fatcat:wdj6puyv35cgpe2fad2vrzsrny

Tracking Instances as Queries [article]

Shusheng Yang, Yuxin Fang, Xinggang Wang, Yu Li, Ying Shan, Bin Feng, Wenyu Liu
2021 arXiv   pre-print
, and instance segmentation.  ...  However, how to establish a query based video instance segmentation (VIS) framework with elegant architecture and strong performance remains to be settled.  ...  Compfeat: Comprehensive feature aggregation for video instance segmentation. arXiv preprint arXiv:2012.03400, 2020. 1, 4 [8] Vidit Goel, Jiachen Li, Shubhika Garg, Harsh Maheshwari, and Humphrey Shi.  ... 
arXiv:2106.11963v2 fatcat:qyyvel3uxjenfgblwgjsykqdpq

A Survey on Deep Learning Technique for Video Segmentation [article]

Wenguan Wang, Tianfei Zhou, Fatih Porikli, David Crandall, Luc Van Gool
2021 arXiv   pre-print
In this survey, we comprehensively review two basic lines of research - generic object segmentation (of unknown categories) in videos and video semantic segmentation - by introducing their respective task  ...  Recently, due to the renaissance of connectionism in computer vision, there has been an influx of deep learning based approaches for video segmentation that have delivered compelling performance.  ...  over time and allows for comprehensive use of past segmentation clues even over long period of time.  ... 
arXiv:2107.01153v3 fatcat:nry4yjhq7zhtzbfh53wf7ie3um

A Numerical Measurement Method for Dynamic Granular Materials Based on Computer Vision

Hao Liu, Yuxing Nie, Man Chen, Shunkai Liu, Ashiru Mohammed
2022 Materials  
Firstly, an improved video instance segmentation (VIS) network is introduced to perform end-to-end multi-task learning, and its temporal feature fusion module and tracking head with long-sequence external  ...  memory can improve the problems of poor video data quality and high similarity in appearance of granular materials, respectively.  ...  It can be seen that our VIS model can also achieve good instance segmentation and tracking for these two adversely affected videos.  ... 
doi:10.3390/ma15103554 pmid:35629581 pmcid:PMC9148117 fatcat:434q43cdr5arjfpp5x4kub6ubm

Instances as Queries [article]

Yuxin Fang, Shusheng Yang, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu
2021 arXiv   pre-print
For video instance segmentation, QueryInst achieves the best performance among all online VIS approaches and strikes a decent speed-accuracy trade-off. Code is available at .  ...  ., COCO, CityScapes, and YouTube-VIS to evaluate the effectiveness of QueryInst in instance segmentation and video instance segmentation (VIS) task.  ...  Compfeat: Comprehensive feature aggre- medical image segmentation.  ... 
arXiv:2105.01928v3 fatcat:wxoq6lnsffcjhgatmcrguakk6y

One-stage Video Instance Segmentation: From Frame-in Frame-out to Clip-in Clip-out [article]

Minghan Li, Lei Zhang
2022 arXiv   pre-print
Many video instance segmentation (VIS) methods partition a video sequence into individual frames to detect and segment objects frame by frame.  ...  A clip-level segmentation loss is proposed to ensure that the generated instance masks are temporally coherent in the clip.  ...  for each object, thereby achieving instance segmentation of the entire video.  ... 
arXiv:2203.06421v1 fatcat:oxy2pte7azb4batrizsrshn2qq