【资源】多目标追踪资源列表(数据集、论文、代码和牛人主页等)

多目标跟踪是一项有着多年研究工作但还未真正成熟的计算机视觉任务,需要更多的开源和更多的标准评估指标。以下是作者整理的多目标追踪资源列表,包含数据集、论文、代码和牛人主页等。
作者:SpyderXu
来源github:https://github.com/SpyderXu/multi-object-tracking-paper-list


在MOT16, MOT17排行榜中可以找到一些新的作品,但是最近几个月似乎没有开源的工作,所以我没有更新源代码列表。MOT17基准提供了三种检测结果:DPM,更快的RCNN和SDP,如果你分析基于不同检测结果的结果,你会发现大多数跟踪器在更快的RCNN和SDP检测上有着相似的性能。跟踪器的良好排名主要依赖于DPM检测的良好性能,在采用更快的RCNN和SDP检测时,其性能与DeepSort相似。所以如果你想提高你的MOTA分数,可以关注DPM结果。


Datasets

PETS2009 : An old dataset.

KITTI-Tracking : Multi-person or multi-car tracking dataset.

MOT dataset : A dataset for multi-person detection and tracking, mostly used.

UA-DETRAC : A dataset for multi-car detection and tracking.

AVSS2018 Challenge : AVSS2018 Challenge based on UA-DETRAC is opened!

DukeMTMC : A dataset for multi-camera multi-person tracking.

PoseTrack: A dataset for multi-person pose tracking.

NVIDIA AI CITY Challenge: Challenges including "Traffic Flow Analysis", "Anomaly Detection" and "Multi-sensor Vehicle Detection and Reidentification", you may find some insteresting codes on their Github repos

Vis Drone: Tracking videos captured by drone-mounted cameras.

JTA Dataset: A huge dataset for pedestrian pose estimation and tracking in urban scenarios created by exploiting the highly photorealistic video game Grand Theft Auto V developed by Rockstar North.

Baidu Trajectory Interesting dataset for trajectory prediction for Autonomous drive, wait to be opened.

Path Track A new dataset with many scenes.


Overview

P Emami,PM Pardalos,L Elefteriadou,S Ranka "Machine Learning Methods for Solving Assignment Problems in Multi-Target Tracking" [paper]

Wenhan Luo, Junliang Xing, Anton Milan, Xiaoqin Zhang, Wei Liu, Xiaowei Zhao and Tae-Kyun Kim, "Multiple Object Tracking: A Literature Review" [paper]


Evaluation Metric

CLEAR MOT : Bernardin, K. & Stiefelhagen, R. "Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metric" [paper]

IDF1 : Ristani, E., Solera, F., Zou, R., Cucchiara, R. & Tomasi, C. "Performance Measures and a Data Set for Multi-Target, Multi-Camera Tracking" [paper]

Evaluation Code: [Python]


Researcher

Anton Milan [webpage and his source code]

Laura Leal-Taixé [webpage and her source code]

Dynamic Vision and Learning Group [webpage and their source code]

Longyin Wen [webpage and his source code]

UCF [webpage]

Some source codes in above webpage are not listed in below Open Source.Such as:

"segTrack"

"Exploiting Hierarchical Dense Structures on Hypergraphs for Multi-Object Tracking"

"Learning an image-based motion context for multiple people tracking"


Open Source

Batch

NT Longyin Wen, Dawei Du, Shengkun Li, Xiao Bian, Siwei Lyu Learning Non-Uniform Hypergraph for Multi-Object Tracking, In AAAI 2019 [paper][code] Waited!

headTracking: Shun Zhang, Jinjun Wang, Zelun Wang, Yihong Gong,Yuehu Liu: "Multi-Target Tracking by Learning Local-to-Global Trajectory Models" in PR 2015 [paper] [code] seems like a repo.

IOU : E. Bochinski, V. Eiselein, T. Sikora. "High-Speed Tracking-by-Detection Without Using Image Information" [paper] [code] In International Workshop on Traffic and Street Surveillance for Safety and Security at IEEE AVSS 2017, 2017.

NMGC-MOT Andrii Maksai, Xinchao Wang, Franc¸ois Fleuret, and Pascal Fua "Non-Markovian Globally Consistent Multi-Object Tracking
" [paper][code] In ICCV 2017

D2T Christoph Feichtenhofer, Axel Pinz, Andrew Zisserman, "Detect to Track and Track to Detect" [paper] [code] In ICCV 2017

H2T : Longyin Wen, Wenbo Li, Junjie Yan, Zhen Lei, Dong Yi, Stan Z. Li. "Multiple Target Tracking Based on Undirected Hierarchical Relation Hypergraph," [paper] [code] IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.

LDCT : F. Solera, S. Calderara, R. Cucchiara "Learning to Divide and Conquer for Online Multi-Target Tracking" [paper] [code page 1] [code page 2] In Proceedings of International Converence on Computer Vision (ICCV), Santiago Cile, Dec 12-18, 2015

CEM : Anton Milan, Stefan Roth, Konrad Schindler "Continuous Energy Minimization for Multi-Target Tracking" [paper] [code] in pami 2014

OPCNF : Chari, Visesh and Lacoste-Julien, Simon and Laptev, Ivan and Sivic, Josef "On Pairwise Costs for Network Flow Multi-Object Tracking" [paper] [code] In CVPR 2015

KSP : J. Berclaz, F. Fleuret, E. Türetken and P. Fua "Multiple Object Tracking using K-Shortest Paths Optimization" [paper] [code] IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011.

GMCP : Amir Roshan Zamir, Afshin Dehghan, and Mubarak Shah "GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs" [paper] [code] European Conference on Computer Vision (ECCV), 2012.


Online

LSST Weitao Feng, Zhihao Hu, Wei Wu, Junjie Yan, Wanli Ouyang "Multi-Object Tracking with Multiple Cues and Switcher-Aware Classification" [paper] SOA tracker on MOT ranking list. No code now.

MOTBeyondPixels Sarthak Sharma, Junaid Ahmed Ansari, J. Krishna Murthy, and K. Madhava Krishna Beyond Pixels: Leveraging Geometry and Shape Cues for Online Multi-Object Tracking In ICRA 2018 [paper][code]

SST Sun. S., Akhtar, N., Song, H., Mian A., & Shah M. (2018). Deep Affinity Network for Multiple Object Tracking[paper][code]: Interesting work and expect the author to update their DPM tracking results on MOT17 benchmark.

MOTDT Long Chen, Haizhou Ai "Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-identification" in ICME 2018 [code][paper]!

TMPORT : E. Ristani and C. Tomasi. Tracking Multiple People Online and in Real Time. in ACCV 2014 [paper] [code]

MOT-RNN : Anton Milan, Seyed Hamid Rezatofighi, Anthony Dick, Konrad Schindler, Ian Reid "Online Multi-target Tracking using Recurrent Neural Networks"[paper] [code] In AAAI 2017.

DeepSort : Wojke, Nicolai and Bewley, Alex and Paulus, Dietrich "Simple Online and Realtime Tracking with a Deep Association Metric" [paper] [code] In ICIP 2017

Sort : Bewley, Alex and Ge, Zongyuan and Ott, Lionel and Ramos, Fabio and Upcroft, Ben "Simple Online and Realtime Tracking"[paper] [code] In ICIP 2016.

MDP : Yu Xiang, Alexandre Alahi, and Silvio Savarese "Learning to Track: Online Multi-Object Tracking by Decision Making
" [paper] [code] In International Conference on Computer Vision (ICCV), 2015

CMOT : S. H. Bae and K. Yoon. "Robust online multi-object tracking based on tracklet confidence and online discriminative appearance learning" [paper] [code] In CVPR 2014

RCMSS : Mohamed A. Naiel1, M. Omair Ahmad, M.N.S. Swamy, Jongwoo Lim, and Ming-Hsuan Yang "Online Multi-Object Tracking Via
Robust Collaborative Model and Sample Selection"[paper] [code] Computer Vision and Image Understanding 2016

MHT-DAM : Chanho Kim, Fuxin Li, Arridhana Ciptadi, James M. Rehg "Multiple Hypothesis Tracking Revisited"[paper] [code] In ICCV 2015

OMPTTH : Jianming Zhang, Liliana Lo Presti and Stan Sclaroff, "Online Multi-Person Tracking by Tracker Hierarchy," [[paper]]() [code] Proc. Int. Conf. on Advanced Video and Signal Based Surveillance (AVSS), 2012.

SMOT : C. Dicle, O. Camps, M. Sznaier. "The Way They Move: Tracking Targets with Similar Appearance" [paper] [code] In ICCV, 2013.


Private Detection

POI : F. Yu, W. Li, Q. Li, Y. Liu, X. Shi, J. Yan. "POI: Multiple Object Tracking with High Performance Detection and Appearance Feature" [paper] [detection] In BMTT, SenseTime Group Limited, 2016


New papers

CVPR2017

Eldar Insafutdinov, Mykhaylo Andriluka, Leonid Pishchulin, Siyu Tang, Evgeny Levinkov, Bjoern Andres, Bernt Schiele "Art Track: Articulated Multi-Person Tracking in the Wild" [paper]

Manmohan Chandraker, Paul Vernaza, Wongun Choi, Samuel Schulter "Deep Network Flow for Multi-Object Tracking" [paper]

Jeany Son, Mooyeol Baek, Minsu Cho, and Bohyung Han, "Multi-Object Tracking with Quadruplet Convolutional Neural Networks" [paper]


ICCV2017

A. Sadeghian, A. Alahi, S. Savarese, Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies [paper]

Andrii Maksai, Xinchao Wang, Franc¸ois Fleuret, and Pascal Fua "Non-Markovian Globally Consistent Multi-Object Tracking
" [paper][code]

Christoph Feichtenhofer, Axel Pinz, Andrew Zisserman, "Detect to Track and Track to Detect" [paper] [code]

Qi Chu, Wanli Ouyang, Xiaogang Wang, Bin Liu, Nenghai Yu "Online Multi-Object Tracking Using CNN-Based Single Object Tracker With Spatial-Temporal Attention Mechanism" [paper]

CVPR2018

Ristani and C. Tomasi "Features for Multi-Target Multi-Camera Tracking and Re-Identification" [paper] [code]


ECCV2018

Zhu, Ji and Yang, Hua and Liu, Nian and Kim, Minyoung and Zhang, Wenjun and Yang, Ming-Hsuan "Online Multi-Object Tracking with Dual Matching Attention Networks" [paper] The source code will be made available to the public!

Ren, Liangliang and Lu, Jiwen and Wang, Zifeng and Tian, Qi and Zhou, Jie "Collaborative Deep Reinforcement Learning for Multi-Object Tracking" [paper]

Kim, Chanho and Li, Fuxin and Rehg, James M "Multi-object Tracking with Neural Gating Using Bilinear LSTM" [paper]


New paper

M Fabbri, F Lanzi, S Calderara, A Palazzi "Learning to Detect and Track Visible and Occluded Body Joints in a Virtual World" [paper] [[code]] Waited!

Cong Ma, Changshui Yang, Fan Yang, Yueqing Zhuang, Ziwei Zhang, Huizhu Jia, Xiaodong Xie "Trajectory Factory: Tracklet Cleaving and Re-connection by Deep Siamese Bi-GRU for Multiple Object Tracking" In ICME 2018 [paper]

Kuan Fang, Yu Xiang, Xiaocheng Li and Silvio Savarese "Recurrent Autoregressive Networks for Online Multi-Object Tracking" In IEEE Winter Conference on Applications of Computer Vision (WACV), 2018. [webpage]

Tharindu Fernando, Simon Denman, Sridha Sridharan, Clinton Fookes "Tracking by Prediction: A Deep Generative Model for Mutli-Person localisation and Tracking" In WACV 2018 [paper]


Multi-person Face Tracking

Shun Zhang, Yihong Gong, Jia-Bin Huang, Jongwoo Lim, Jinjun Wang, Narendra Ahuja and Ming-Hsuan Yang "Tracking Persons-of-Interest via Adaptive Discriminative Features" In ECCV 2016 [paper] [code]

Chung-Ching Lin, Ying Hung"A Prior-Less Method for Multi-Face Tracking in Unconstrained Videos" In CVPR 2018 [paper]

Multi-person Pose Tracking

Yuliang Xiu, Jiefeng Li, Haoyu Wang, Yinghong Fang, Cewu Lu "Pose Flow: Efficient Online Pose Tracking" [paper] Idea is interesting but the true source code is not opened.

Bin Xiao, Haiping Wu, and Yichen Wei "Simple Baselines for Human Pose Estimation and Tracking" [paper][code]




推荐阅读
深度多目标跟踪算法综述
多目标追踪器:用 OpenCV 实现多目标追踪(C++/Python)
多目标跟踪 (MOT) 论文随笔-SIMPLE ONLINE AND REALTIME TRACKING (SORT)