Awesome Action Recognition:

A curated list of action recognition and related area (e.g. object recognition, pose estimation) resources, inspired by awesome-computer-vision.

Contents

• Action Recognition and Video Understanding
• Object Recognition
• Pose Estimation
• Competitions

Action Recognition and Video Understanding

Summary posts

• Deep Learning for Videos: A 2018 Guide to Action Recognition - Summary of major landmark action recognition research papers till 2018
• Literature Survey: Human Action Recognition - Brief human action recognition literature survey of work published between 2014 and 2019.

Video Representation

• Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognition - J. Choi et al., NeurIPS2019. [project web] [code] [arXiv]
• SlowFast Networks for Video Recognition - C. Feichtenhofer et al., ICCV2019. [code]
• Large-scale weakly-supervised pre-training for video action recognition - D. Ghadiyaram et al., arXiv2019.
• Video Classification with Channel-Separated Convolutional Networks - D. Tran et al., arXiv2019.
• DistInit: Learning Video Representations without a Single Labeled Video - R. Girdhar et al., arXiv2019.
• SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition - B. Korbar et al., arXiv2019.
• Video Action Transformer Network - R. Girdhar et al., CVPR2019. [project web]
• Learning Correspondence from the Cycle-consistency of Time - X. Wang et al., CVPR2019. [code] [project web]
• Representation Flow for Action Recognition - AJ. Piergiovanni and M. S. Ryoo et al., CVPR2019.
• Collaborative Spatiotemporal Feature Learning for Video Action Recognition - C. Li et al., CVPR2019.
• Learning Video Representations from Correspondence Proposals - X. Liu et al., CVPR2019.
• Timeception for Complex Action Recognition - N. Hussein et al., CVPR2019.
• The Visual Centrifuge: Model-Free Layered Video Representations - J.-B. Alayrac et al., CVPR2019.
• Long-Term Feature Banks for Detailed Video Understanding - C.-Y. Wu. et al., CVPR2019. [code]
• Temporal Relational Reasoning in Videos - B. Zhou et al., ECCV2018. [code] [project web]
• Action Recognition Zoo - Codes for popular action recognition models, written based on pytorch, verified on the something-something dataset.
• Videos as Space-Time Region Graphs - X. Wang and A. Gupta, ECCV2018.
• Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? - K. Hara et al., CVPR2019. [code]
• A Closer Look at Spatiotemporal Convolutions for Action Recognition - D. Tran et al., CVPR2018. [code] [PyTorch]
• Attend and Interact: Higher-Order Object Interactions for Video Understanding - CY. Ma et al., CVPR 2018.
• Non-Local Neural Networks - X. Wang et al., CVPR2018. [code]
• Rethinking Spatiotemporal Feature Learning For Video Understanding - S. Xie et al., arXiv2017.
• ConvNet Architecture Search for Spatiotemporal Feature Learning - D. Tran et al, arXiv2017. Note: Aka Res3D. [code]: In the repository, C3D-v1.1 is the Res3D implementation.
• Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks - Z. Qui et al, ICCV2017. [code]
• Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset - J. Carreira et al, CVPR2017. [code][PyTorch code], [another PyTorch code]
• Learning Spatiotemporal Features with 3D Convolutional Networks - D. Tran et al, ICCV2015. [the official Caffe code] [project web] Note: Aka C3D. [Python Wrapper] Note that the official caffe does not support python wrapper. [TensorFlow], [TensorFlow + Keras], [Another TensorFlow Implemetation], [Keras C3D Project web]: [Keras code], [Pretrained weights].
• Deep Temporal Linear Encoding Networks - A. Diba et al, CVPR2017.
• Temporal Convolutional Networks: A Unified Approach to Action Segmentation and Detection - C. Lea et al, CVPR 2017. [code]
• Long-term Temporal Convolutions - G. Varol et al, TPAMI2017. [project web] [code]
• Temporal Segment Networks: Towards Good Practices for Deep Action Recognition - L. Wang et al, arXiv 2016. [code]
• Convolutional Two-Stream Network Fusion for Video Action Recognition - C. Feichtenhofer et al, CVPR2016. [code]
• Two-Stream Convolutional Networks for Action Recognition in Videos - K. Simonyan and A. Zisserman, NIPS2014.
• Temporal Recurrent Networks for Online Action Detection - M. Xu et al, ICCV2019. [code]
• Long Short-Term Transformer for Online Action Detection - M. Xu et al, Neurips2021. [code]

Useful Code Repos on Video Representation Learning

• [3D ResNet PyTorch]
• [PyTorch Video Research]
• [M-PACT: Michigan Platform for Activity Classification in Tensorflow]
• [Inflated models on PyTorch]
• [I3D models transfered from Tensorflow to PyTorch]
• [A Two Stream Baseline on Kinectics dataset]
• [MMAction]
• [MMAction2]
• [PySlowFast]
• [Decord] Efficient video reader for python
• [I3D models converted from Tensorflow to Core ML]
• [Extract frame and optical-flow from videos, #docker]
• [NVIDIA-DALI, video loading pipelines]
• [NVIDIA optical-flow SDK]

Action Classification

• Guided Weak Supervision for Action Recognition with Scarce Data to Assess Skills of Children with Autism - P. Pandey et al, AAAI 2020. [[code]](https://github.com/pr