Object tracking

cotracker
https://news.ycombinator.com/item?id=37314073 and https://github.com/facebookresearch/co-tracker tracks all pixels.

deep sort
https://github.com/NirAharon/BoT-SORT The goal of multi-object tracking (MOT) is detecting and tracking all the objects in a scene, while keeping a unique identifier for each object. In this paper, we present a new robust state-of-the-art tracker, which can combine the advantages of motion and appearance information, along with camera-motion compensation, and a more accurate Kalman filter state vector. See Nvidia cuda install to install cuda. deep sort people tracking. This repository contains a two-stage-tracker. The detections generated by YOLOv5, a family of object detection architectures and models pretrained on the COCO dataset, are passed to a Deep Sort algorithm which tracks the objects. It can track any object that your Yolov5 model was trained to detect. Pose_estimation for Alphapose based tracking of people only. Use camera pivoting code for sentry gun servo gimbal tracking from the gentlenav uav drone project.

2D tracking
object tracking norfair Lightweight Python library for adding real-time object tracking to any detector. Any detector expressing its detections as a series of (x, y) coordinates can be used with Norfair. This includes detectors performing object detection, pose estimation, person reid and instance segmentation such as Yolo, Detectron2.

amazon
https://github.com/amazon-research/siam-mot uses https://github.com/facebookresearch/maskrcnn-benchmark patched(pytorch1.7) and see setting up symlinks for datasets(detectron) and see [https://github.com/amazon-research/siam-mot/blob/main/readme/INSTALL.md export env. variables]

recents
https://github.com/DeformableFriends/NeuralTracking https://jerryxu.net/VFS/ Rethinking Self-Supervised Correspondence Learning: A Video Frame-level Similarity Perspective

satellite
https://github.com/SY-Xuan/CFME Object Tracking in Satellite Videos by Improved Correlation Filters With Motion Estimations, TGRS from Python implementation of KCF tracking algorithm

Globaltrack
https://github.com/huanglianghua/GlobalTrack Extremely simple tracking process, with NO motion model, NO online learning, NO punishment on position or scale changes, NO scale smoothing and NO trajectory refinement. Outperforms SPLT (ICCV19), SiamRPN, ATOM and MBMD on TLP benchmark (avg. 13,529 frames per video) by MORE THAN 11% (absolute gain). https://www.youtube.com/watch?v=na0H3u4cLqY&feature=youtu.be

Smorodov
https://github.com/Smorodov/Multitarget-tracker from Kalman tracking. Ref medium.com hal24k-techblog track objects

Chained tracking
https://github.com/pjl1995/CTracker Official implementation in PyTorch of Chained-Tracker as described in Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking.https://www.youtube.com/watch?v=UovwAgKys88

Multiclass multi object tracking (MCMOT)
https://github.com/CaptainEven/YOLOV4_MCMOT Tracking demo of C5(car, bicycle, person, cyclist, tricycle)

PaddleDetection
https://github.com/PaddlePaddle/PaddleDetection/tree/release/2.1/configs/mot for testing and inference Derived from https://github.com/longcw/MOTDT and https://github.com/Zhongdao/Towards-Realtime-MOT and https://github.com/ifzhang/FairMOT (https://www.crowdhuman.org/) person reid and tracking derived from Zhongdao. https://github.com/CaptainEven/MCMOT fork of FairMOT, which extends the one-class multi-object tracking to multi-class multi-object tracking. See issues254

opencv
https://github.com/vivekhsridhar/tracktor opencv tracking from https://github.com/jgraving/DeepPoseKit

https://idtrackerai.readthedocs.io/en/latest/ animal tracking

https://github.com/jgraving/pinpoint barcode tracking

DAN
https://github.com/shijieS/SST (Deep Affinity Network), single shot tracking, based on SSD. Evaluate on https://motchallenge.net/data/MOT17/ and https://detrac-db.rit.albany.edu/

DMMN
https://github.com/shijieS/DMMN

SIDE: Single image depth estimation
Build a Tracked vehicle as per Make it extreme youtube channel and use SIDE(implemented on FpGa) instead of expensive Lidar to herd and protect cattle by deterring stock thieves with a Net gun.

Jeremy Cohen
https://github.com/kcg2015/Vehicle-Detection-and-Tracking/ vehicle tracking from https://towardsdatascience.com/computer-vision-for-tracking-8220759eee85

opendatacam
https://github.com/opendatacam/opendatacam

Papers
https://github.com/foolwood/benchmark_results visual tracking paper list of supervised and unsupervised tracking.
 * https://github.com/researchmm/SiamDW We are the Winner of VOT-19 RGB-D challenge
 * https://github.com/iiau-tracker/SPLT
 * https://github.com/vision4robotics/ARCF-tracker Learning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking (ICCV 2019)
 * https://github.com/ZikunZhou/TADT-python Existing deep trackers mainly use convolutional neural networks pre-trained for generic object recognition task for representations. Despite demonstrated successes for numerous vision tasks, the contributions of using pre-trained deep features for visual tracking are not as significant as that for object recognition. The key issue is that in visual tracking the targets of interest can be arbitrary object class with arbitrary forms. See https://xinli-zn.github.io/TADT-project-page/
 * https://github.com/XU-TIANYANG/GFS-DCF matlab

long term visual tracking
https://github.com/wangdongdut/Long-term-Visual-Tracking

Face tracking
See Facial Recognition tiny faces detection, extracts hundreds of faces from image.

https://github.com/shunzhang876/AdaptiveFeatureLearning from https://github.com/shijieS/ComputerVisionSummarization further list of visual tracking papers and repos. See tiny faces github repo.

https://sites.google.com/site/shunzhang876/eccv16_facetracking/

Multi-face tracking in unconstrained videos is a challenging problem as faces of one person often appear drastically different in multiple shots due to signiﬁcant variations in scale, pose, expression, illumination, and make-up. Low- level features used in existing multi-target tracking methods are not effective for identifying faces with such large appearance variations. In this paper, we tackle this problem by learning discriminative, video-speciﬁc face features using convolutional neural networks (CNNs). Unlike existing CNN-based approaches that are only trained on large-scale face image datasets ofﬂine, we further adapt the pre-trained face CNN to speciﬁc videos using automatically discovered training samples from tracklets. Our network directly optimizes the embedding space so that the Euclidean distances correspond to a measure of semantic face similarity. This is technically realized by minimizing an improved triplet loss function. With the learned discriminative features, we apply the Hungarian algorithm to link tracklets within each shot and the hierarchical clustering algorithm to link tracklets across multiple shots to form ﬁnal trajectories. We extensively evaluate the proposed algorithm on a set of TV sitcoms and music videos and demonstrate signiﬁcant performance improvement over existing techniques. Multi-face Tracking

Unsupervised tracking

 * https://github.com/594422814/UDT_pytorch pytorch version
 * https://github.com/594422814/UDT We propose an unsupervised visual tracking method in this paper. Different from existing approaches using extensive annotated data for supervised learning, our model is trained on large-scale unlabeled videos in an unsupervised manner. Our motivation is that a robust tracker should be effective in both the forward and backward ways, i.e., the tracker can forward localize the target object in successive frames and backtrace to its initial position in the first frame. We build our method on a Siamese correlation filter network, which is trained using raw videos without labels. Meanwhile, we propose a multiple-frame validation and a cost-sensitive loss to further facilitate the unsupervised learning. Without bells and whistles, our unsupervised tracker achieves the baseline accuracy of fully-supervised trackers, which require complete and accurate labels for training. Furthermore, unsupervised framework exhibits potential in leveraging unlabeled or weakly labeled data to further improve the tracking accuracy. Linked from https://github.com/foolwood/benchmark_results visual tracking paper list.

zhengthomastang
https://github.com/zhengthomastang/2018AICity_TeamUW tracking cars and their speeds at https://www.youtube.com/watch?v=_i4numqiv7Y Single-camera and Inter-camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features (Winner of Track 1 and Track 3 at the AI City Challenge Workshop in CVPR 2018). https://www.aicitychallenge.org/.

Uses https://github.com/AlexXiao95/Multi-camera-Vehicle-Tracking-and-Reidentification We achieved Multi-Camera Vehicle Tracking and Re-identification based on a fusion of histogram-based adaptive appearance models, DCNN features, detected license plates, detected car types and traveling time information.
 * https://github.com/zhengthomastang/MOT_Kalman Kalman tracking

Pytracking
https://github.com/visionml/pytracking Visual tracking library based on PyTorch.

Staple
Correlation Filter-based trackers have recently achieved excellent performance, showing great robustness to challenging situations exhibiting motion blur and illumination changes. However, since the model that they learn depends strongly on the spatial layout of the tracked object, they are notoriously sensitive to deformation. Models based on colour statistics have complementary traits: they cope well with variation in shape, but suffer when illumination is not consistent throughout a sequence. Moreover, colour distributions alone can be insufficiently discriminative. In this paper, we show that a simple tracker combining complementary cues in a ridge regression framework can operate faster than 80 FPS and outperform not only all entries in the popular VOT14 competition, but also recent and far more sophisticated trackers according to multiple benchmarks.

Staple: "Complementary Learners for Real-Time Tracking" from http://www.robots.ox.ac.uk/~luca/staple.html and matlab verion https://github.com/bertinetto/staple

C++ version: https://github.com/xuduo35/STAPLE/blob/master/README.md uses https://github.com/foolwood/DAT

foolwood
https://github.com/foolwood/deepmask-pytorch

Kalman
https://github.com/abewley/sort tracks any object with yolo as implemented by Fotache repo(Pytorch)

https://github.com/ido90/UsingKalmanFilterTheRightWay

Pose tracking
https://github.com/NVlabs/Deep_Object_Pose This is the official DOPE ROS package for detection and 6-DoF pose estimation of known objects from an RGB camera. The network has been trained on the following YCB objects: cracker box, sugar box, tomato soup can, mustard bottle, potted meat can, and gelatin box

Combine the 6D object pose estimation code with Chris Annin six axis robot to automate Greenhouse pepper growing.

https://github.com/j96w/6-PACK from "6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints" from paperswithcode.com. https://www.youtube.com/watch?v=8Xb6dazqj10

https://github.com/hughw19/NOCS_CVPR2019 Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation at https://arxiv.org/pdf/1901.02970.pdf The goal of this paper is to estimate the 6D pose anddimensions of unseen object instances in an RGB-D im-age. Contrary to “instance-level” 6D pose estimation tasks,our problem assumes that no exact object CAD models areavailable during either training or testing time.

Time cycle
https://github.com/xiaolonw/TimeCycle We introduce a self-supervised method for learning visual correspondence from unlabeled video. The main idea is to use cycle-consistency in time as free supervisory signal for learning visual representations from scratch. At training time, our model learns a feature map representation to be useful for performing cycle-consistent tracking. At test time, we use the acquired representation to find nearest neighbors across space and time. We demonstrate the generalizability of the representation -- without finetuning -- across a range of visual correspondence tasks, including video object segmentation, keypoint tracking, and optical flow. Our approach outperforms previous self-supervised methods and performs competitively with strongly supervised methods.

filter flow
https://github.com/aimerykong/predictive-filter-flow learning with Predictive Filter Flow (PFF) for various vision tasks. PFF is a framework not only supporting self/fully/un-supervised learning on images and videos, but also providing better interpretability that one is able to track every single pixel's movement and its kernels in constructing the output.

Siamese tracking
https://github.com/AlexeyAB/DaSiamRPN Siamese Networks for Visual Object Tracking won the VOT 2018 challenge.

Goturn tracking
https://github.com/nrupatunga/PY-GOTURN/ python version try on ubuntu 16 or 14 if 18 doesn't work

https://github.com/davheld/GOTURN c++ version.

https://www.learnopencv.com/goturn-deep-learning-based-object-tracking/

https://davheld.github.io/GOTURN/GOTURN.pdf

https://davheld.github.io/

deep lk object tracking

Geekalexis
https://github.com/GeekAlexis/FastMOT

General repos
https://github.com/ido90/AyalonRoad Since the small, crowded cars in the videos were failed to be detected by several out-of-the-box detectors, I manually tagged the vehicles within 15 frames and trained a dedicatedly-designed CNN (in the general spirit of Faster RCNN) consisting of pre-trained Resnet34 layers (chosen with accordance to the desired feature-map cell size and receptive field), location-based network (to incorporate road-map information), and a detection & location head.

Since the low frame-rate could not guarantee intersection between the bounding-boxes of the same vehicle in adjacent frames, I replaced the assignment mechanism of SORT tracker with a location-based probabilistic model implemented through a Kalman filter. The resulted traffic data were transformed from pixels to meters units and organized in both spatial and vehicle-oriented structures. Several research questions were addressed, e.g. regarding the relations between speed/density/flux (the fundamental traffic diagram), daily and temporal patterns and the effects of lane-transitions.

links
Nvidia cuda install streaming split the the rtsp stream using socat Deep sort https://github.com/Zhongdao/UniTrack Unified tracking framework with a single appearance model. It supports Single Object Tracking (SOT), Video Object Segmentation (VOS), Multi-Object Tracking (MOT), Multi-Object Tracking and Segmentation (MOTS), Pose Tracking, Video Instance Segmentation (VIS), and class-agnostic MOT (e.g. TAO dataset). super resolution Yolo_training Mdnet tracking lane detection Facial Recognition Neural papers with code Person reidentification intel openvino https://github.com/phil-bergmann/tracking_wo_bnw