Single image-based head pose estimation with spherical parametrization and 3D morphing

作者:

Highlights:

• We propose a novel geometry based algorithm for accurately estimating the head pose from a single 2D face image at a very low computational cost. Specifically, the rectangular coordinates of only four non-coplanar feature points from a predefined 3D facial model as well as the corresponding ones automatically/manually extracted from a 2D face image are first normalized to exclude the effect of external factors (i.e., scale factor and translation parameters). Then, the four normalized 3D feature points are represented in spherical coordinates with reference to the uniquely determined sphere by themselves, which are further iteratively refined via 3D morphing. Due to the spherical parameterization, the coordinates of feature points could be morphed along all the three directions effectively. Finally, the rotation matrix indicating the head pose is obtained by minimizing the Euclidean distance between the normalized 2D feature points and the 2D re-projections of morphed 3D feature points.

摘要

•We propose a novel geometry based algorithm for accurately estimating the head pose from a single 2D face image at a very low computational cost. Specifically, the rectangular coordinates of only four non-coplanar feature points from a predefined 3D facial model as well as the corresponding ones automatically/manually extracted from a 2D face image are first normalized to exclude the effect of external factors (i.e., scale factor and translation parameters). Then, the four normalized 3D feature points are represented in spherical coordinates with reference to the uniquely determined sphere by themselves, which are further iteratively refined via 3D morphing. Due to the spherical parameterization, the coordinates of feature points could be morphed along all the three directions effectively. Finally, the rotation matrix indicating the head pose is obtained by minimizing the Euclidean distance between the normalized 2D feature points and the 2D re-projections of morphed 3D feature points.

论文关键词:Head pose estimation,Spherical parameterization,3D facial model

论文评审过程:Received 31 January 2019, Revised 31 December 2019, Accepted 24 February 2020, Available online 27 February 2020, Version of Record 3 March 2020.

论文官网地址:https://doi.org/10.1016/j.patcog.2020.107316