MMSkeleton

Introduction

MMSkeleton is an open source toolbox for skeleton-based human understanding. It is a part of the open-mmlab project in the charge of Multimedia Laboratory, CUHK. MMSkeleton is developed on our research project ST-GCN.

<p align="center"> <img src="demo/recognition/demo_video.gif", width="700"> </p>

Updates

• [2020-01-21] MMSkeleton v0.7 is released.
• [2019-10-09] MMSkeleton v0.6 is released.
• [2019-10-08] Support model zoo.
• [2019-10-02] Support custom dataset.
• [2019-09-23] Add video-based pose estimation demo.
• [2019-08-29] MMSkeleton v0.5 is released.

Features

• High extensibility

  MMSkeleton provides a flexible framework for organizing codes and projects systematically, with the ability to extend to various tasks and scale up to complex deep models.

• Multiple tasks

  MMSkeleton addresses to multiple tasks in human understanding, including but not limited to:

  • [x] skeleton-based action recognition (ST-GCN)
  • [x] 2D pose estimation
  • [ ] skeleton-based action generation
  • [ ] 3D pose estimation
  • [ ] pose tracking
  • [x] build custom skeleton-based dataset
  • [x] create your own applications

Getting Started

Please see GETTING_STARTED.md for more details of MMSkeleton.

License

The project is release under the Apache 2.0 license.

Contributing

We appreciate all contributions to improve MMSkeleton. Please refer to CONTRIBUTING.md for the contributing guideline.

Citation

Please cite the following paper if you use this repository in your reseach.

<!-- @inproceedings{stgcn2018aaai, title = {Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition}, author = {Sijie Yan and Yuanjun Xiong and Dahua Lin}, booktitle = {AAAI}, year = {2018}, } -->

@misc{mmskeleton2019,
  author =       {Sijie Yan, Yuanjun Xiong, Jingbo Wang, Dahua Lin},
  title =        {MMSkeleton},
  howpublished = {\url{https://github.com/open-mmlab/mmskeleton}},
  year =         {2019}
}

Contact

For any question, feel free to contact

Sijie Yan     : ys016@ie.cuhk.edu.hk
Jingbo Wang   : wangjingbo1219@foxmail.com
Yuanjun Xiong : bitxiong@gmail.com