Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video

Erik Gärtner, Mykhaylo Andriluka, Hongyi Xu, Cristian Sminchisescu

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceedingPeer review

Sammanfattning

We focus on the task of estimating a physically plausi-ble articulated human motion from monocular video. Ex-isting approaches that do not consider physics often pro-duce temporally inconsistent output with motion artifacts, while state-of-the-art physics-based approaches have either been shown to work only in controlled laboratory conditions or consider simplified body-ground contact limited to feet. This paper explores how these shortcomings can be addressed by directly incorporating a fully-featured physics engine into the pose estimation process. Given an uncon-trolled, real-world scene as input, our approach estimates the ground-plane location and the dimensions of the physi-cal body model. It then recovers the physical motion by per-forming trajectory optimization. The advantage of our for-mulation is that it readily generalizes to a variety of scenes that might have diverse ground properties and supports any form of self-contact and contact between the articu-lated body and scene geometry. We show that our approach achieves competitive results with respect to existing physics-based methods on the Human3.6M benchmark [13], while being directly applicable without re-training to more complex dynamic motions from the AIST benchmark [36] and to uncontrolled internet videos.
Originalspråkengelska
Titel på värdpublikationProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
FörlagIEEE - Institute of Electrical and Electronics Engineers Inc.
ISBN (elektroniskt)978-1-6654-6946-3
ISBN (tryckt)978-1-6654-6947-0
DOI
StatusPublished - 2022
Evenemang2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022 - New Orleans, USA
Varaktighet: 2022 juni 192022 juni 24

Konferens

Konferens2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022
Land/TerritoriumUSA
OrtNew Orleans
Period2022/06/192022/06/24

Ämnesklassifikation (UKÄ)

  • Robotteknik och automation

Fingeravtryck

Utforska forskningsämnen för ”Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här