Deepgroup

https://www.youtube.com/watch?v=40A85ixSDN8

https://www.youtube.com/watch?v=p0jKbDwNTag Supplementary material for ECCV 2012 paper : A Unified Framework for Multi-Target Tracking and Collective Activity Recognition by Wongun Choi and Silvio Savarese

https://github.com/albu5/deepGroup

http://www-personal.umich.edu/~wgchoi/eccv12/wongun_eccv12.html We present a coherent, discriminative framework for simultaneously tracking multiple people and estimating their collective activities. Instead of treating two problems separately, our model is grounded in the intuition that a strong correlation exists between a person's motion, their activity, and the motion and activities of other nearby people. Instead of directly linking the solutions to these two problems, we introduce a hierarchy of activity types that create a natural progression that leads from a specific person’s motion to the activity of the group as a whole. Our model is capable of jointly tracking multiple people, recognizing individual activities (atomic activities), the interactions between pairs of people (interaction activities), and finally the behavior of groups of people (collective activities).

We also propose an algorithm for solving this otherwise intractable joint inference problem by combining belief propagation with a version of the branch and bound algorithm equipped with integer programming. Experimental results on challenging video datasets demonstrate our theoretical claims and indicate that our model achieves the best collective activity classification results to date.

links
Keras

Medium.com