Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments.
Author
Summary, in English
We introduce a new dataset, Human3.6M, of 3.6 Million 3D Human poses, acquired by recording the performance of 11 subjects, under 4 different viewpoints, for training realistic human sensing systems and for evaluating the next generation of human pose estimation models. Besides increasing the size the current state of the art datasets by several orders of magnitude, we aim to complement such datasets with a diverse set of poses encountered in typical human activities (taking photos, posing, greeting, eating, etc.), with synchronized image, motion capture and depth data, and with accurate 3D body scans of all subjects involved. We also provide mixed reality videos where 3D human models are animated using motion capture data and inserted using correct 3D geometry, in complex real environments, viewed with moving cameras, and under occlusion. Finally, we provide large scale statistical models and detailed evaluation baselines for the dataset illustrating its diversity and the scope for improvement by future work in the research community. The dataset and code for the associated large-scale learning models, features, visualization tools, as well as the evaluation server, are available online at http://vision.imar.ro/human3.6m.
Department/s
Publishing year
2014
Language
English
Pages
1325-1339
Publication/Series
IEEE Transactions on Pattern Analysis and Machine Intelligence
Volume
36
Issue
7
Document type
Journal article
Publisher
IEEE - Institute of Electrical and Electronics Engineers Inc.
Topic
- Mathematics
Keywords
- 3D human pose estimation
- human motion capture data
- articulated body modeling
- optimization
- large scale learning
- structured prediction
- Fourier kernel approximations
Status
Published
ISBN/ISSN/Other
- ISSN: 1939-3539