T-CNN: Tubelets With Convolutional Neural Networks for Object Detection From Videos

Issue Number:
Volume Number:
Starting page
Ending page
Kai Kang; Hongsheng Li; Junjie Yan; Xingyu Zeng; Bin Yang; Tong Xiao; Cong Zhang; Zhe Wang; Ruohui Wang; Xiaogang Wang; Wanli Ouyang

paper Menu


The state-of-the-art performance for object detection has been significantly improved over the past two years. Besides the introduction of powerful deep neural networks, such as GoogleNet and VGG, novel object detection frameworks, such as R-CNN and its successors, Fast R-CNN, and Faster R-CNN, play an essential role in improving the state of the art. Despite their effectiveness on still images, those frameworks are not specifically designed for object detection from videos. Temporal and contextual information of videos are not fully investigated and utilized. In this paper, we propose a deep learning framework that incorporates temporal and contextual information from tubelets obtained in videos, which dramatically improves the baseline performance of existing still-image detection frameworks when they are applied to videos. It is called T-CNN, i.e., tubelets with convolutional neural networks. The proposed framework won newly introduced an object-detection-from-video task with provided data in the ImageNet Large-Scale Visual Recognition Challenge 2015. Code is publicly available at


K. Kang et al., "T-CNN: Tubelets With Convolutional Neural Networks for Object Detection From Videos," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 10, pp. 2896-2907, Oct. 2018, doi: 10.1109/TCSVT.2017.2736553.