Parametric Model-Based 3D Human Shape and Pose Estimation from Multiple Views

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceeding

Abstract

Human body pose and shape estimation is an important and challenging task in computer vision. This paper presents a novel method for estimating 3D human body pose and shape from several RGB images, using detected joint positions in the images and based on a parametric human body model. Firstly, the 2D joint points of the RGB images are estimated using a deep neural network, which provides a strong prior on the pose. Then, an energy function is constructed based on the 2D joint points in the RGB images and a parametric human body model. By minimizing the energy function, the pose, shape and camera parameters are obtained. The main contribution of the method over previous work, is that the optimization is based on several images simultaneously using only estimated joint positions in the images. We have performed experiments on both synthetic and real image data-sets, that demonstrate that our method can reconstruct 3D human bodies with better accuracy than previous single view methods.

Details

Authors
Organisations
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Computer Vision and Robotics (Autonomous Systems)

Keywords

  • Camera, Human body, Parametric model, Pose and shape estimation, RGB images
Original languageEnglish
Title of host publicationImage Analysis - 21st Scandinavian Conference, SCIA 2019, Proceedings
EditorsMichael Felsberg, Per-Erik Forssén, Jonas Unger, Ida-Maria Sintorn
PublisherSpringer
Pages336-347
Number of pages12
ISBN (Print)9783030202040
Publication statusPublished - 2019
Publication categoryResearch
Peer-reviewedYes
Event21st Scandinavian Conference on Image Analysis, SCIA 2019 - Norrköping, Sweden
Duration: 2019 Jun 112019 Jun 13

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11482 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st Scandinavian Conference on Image Analysis, SCIA 2019
CountrySweden
CityNorrköping
Period2019/06/112019/06/13