ContactPose
Large dataset of hand-object contact, hand- and object-pose, and 2.9 M RGB-D grasp images.
Install / Use
/learn @facebookresearch/ContactPoseREADME
NOTE: We are aware that the original Dropbox data download links are not valid anymore. Most of the data is now available in IEEE DataPort. This is being tracked in Issue 27.
For users that do not have access to IEEE DataPort, here is a Google Drive link to sample data.
Instructions (assume CONTACTPOSE_ROOT denotes the ContactPose repository directory):
- Delete or rename the
CONTACTPOSE_ROOT/data. - Download this ZIP file to
CONTACTPOSE_ROOT. - Unzip this file. It will create
CONTACTPOSE_ROOT/ContactPose sample data. Rename this directory toCONTACTPOSE_ROOT/data.
ContactPose
Download and pre-processing utilities + Python dataloader for the ContactPose dataset. The dataset was introduced in the following ECCV 2020 paper: ContactPose: A Dataset of Grasps with Object Contact and Hand Pose -
Samarth Brahmbhatt, Chengcheng Tang, Christopher D. Twigg, Charles C. Kemp, and James Hays
<figure> <img src="readme_images/teaser.png" width="700"> <figcaption>Example ContactPose data: Contact Maps, 3D hand pose, and RGB-D grasp images for functional grasps.</figcaption> </figure>Companion Repositories/Websites:
- Explore the dataset
- hand-object contact ML code
- ROS code used for recording the dataset
Citation
@InProceedings{Brahmbhatt_2020_ECCV,
author = {Brahmbhatt, Samarth and Tang, Chengcheng and Twigg, Christopher D. and Kemp, Charles C. and Hays, James},
title = {{ContactPose}: A Dataset of Grasps with Object Contact and Hand Pose},
booktitle = {The European Conference on Computer Vision (ECCV)},
month = {August},
year = {2020}
}
Documentation Link
Data Changelog
We have made some data and annotation corrections. The link above mentions the correction date and the exact data that was corrected. If you got that data before the correction date, please re-download it.
Licensing
- Code: MIT License
- 3D models: each model has its own license, see
README.txtandlicenses.jsonin the downloads - All other data: MIT License
Updates
- :black_square_button: Create a HuggingFace dataset.
- :heavy_check_mark: For users that do not have access to IEEE DataPort, here is a Google Drive link to sample data.
- :heavy_check_mark: Dataset has been uploaded to IEEE DataPort at https://dx.doi.org/10.21227/fb0w-gt48 to prevent Dropbox issues.
- :heavy_check_mark: Fix annotation errors in data from participants 31-35.
- :black_square_button: Use rclone for Dropbox downloads
- :black_square_button: Make depth images optional in cropping script
- :heavy_check_mark: Robust networking utilities for data download with exponential backoff in case of connection failure
- :heavy_check_mark: Speed up dataset download by organizing images into videos
- :heavy_check_mark: Release object 3D models
- :heavy_check_mark: Code for cropping images around hand-object
- :heavy_check_mark: Release contact modeling ML code
- :black_square_button: Release more data analysis code
- :heavy_check_mark: Release MANO fitting code | demo at end of notebook
- :heavy_check_mark: RGB-D image background randomization support
- :heavy_check_mark: new Release ROS code used for recording the dataset
- :heavy_check_mark: MANO and object mesh rendering
- :black_square_button: Documentation using Read the Docs
Related Skills
node-connect
349.2kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
109.5kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
349.2kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
qqbot-media
349.2kQQBot 富媒体收发能力。使用 <qqmedia> 标签,系统根据文件扩展名自动识别类型(图片/语音/视频/文件)。
