Dense depth alignment for human pose and shape estimation

Date

2024-01-01

Author

Karagoz, Batuhan
Suat, Ozhan
Uguz, Bedirhan
Akbaş, Emre

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

36
views

0
downloads

Cite This

Estimating 3D human pose and shape (HPS) from a monocular image has many applications. However, collecting ground-truth data for this problem is costly and constrained to limited lab environments. Researchers have used priors based on body structure or kinematics, cues obtained from other vision tasks to mitigate the scarcity of supervision. Despite its apparent potential in this context, monocular depth estimation has yet to be explored. In this paper, we propose the Dense Depth Alignment (DDA) method, where we use an estimated dense depth map to create an auxiliary supervision signal for 3D HPS estimation. Specifically, we define a dense mapping between the points on the surface of the human mesh and the points reconstructed from depth estimation. We further introduce the idea of Camera Pretraining, a novel learning strategy where, instead of estimating all parameters simultaneously, learning of camera parameters is prioritized (before pose and shape parameters) to avoid unwanted local minima. Our experiments on Human3.6M and 3DPW datasets show that our DDA loss and Camera Pretraining significantly improve HPS estimation performance over using only 2D keypoint supervision or 2D and 3D supervision. Code will be provided for research purposes in the following URL: https://terteros.github.io/hmr-depth/.

Subject Keywords

Dense correspondence estimation, Depth estimation, Human mesh estimation, Human pose and shape estimation, Human pose estimation

URI

https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85205299702&origin=inward
https://hdl.handle.net/11511/111823

Collections

Department of Computer Engineering, Article