Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the updraftplus domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /var/www/lmi_wordpress/wp-includes/functions.php on line 6114

Notice: Function _load_textdomain_just_in_time was called incorrectly. Translation loading for the polylang domain was triggered too early. This is usually an indicator for some code in the plugin or theme running too early. Translations should be loaded at the init action or later. Please see Debugging in WordPress for more information. (This message was added in version 6.7.0.) in /var/www/lmi_wordpress/wp-includes/functions.php on line 6114
Simultaneous multi-descent regression and feature learning for facial landmarking in depth images – Laboratory for Machine Intelligence

Simultaneous multi-descent regression and feature learning for facial landmarking in depth images

Abstract

Face alignment (or facial landmarking) is an important task in many face-related applications, ranging from registration, tracking and animation to higher-level classification problems such as face, expression or attribute recognition. While several solutions have been presented in the literature for this task so far, reliably locating salient facial features across a wide range of posses still remains challenging. To address this issue, we propose in this paper a novel method for automatic facial landmark localization in 3D face data designed specifically to address appearance variability caused by significant pose variations. Our method builds on recent cascaded-regression-based methods to facial landmarking and uses a gating mechanism to incorporate multiple linear cascaded regression models each trained for a limited range of poses into a single powerful landmarking model capable of processing arbitrary posed input data. We develop two distinct approaches around the proposed gating mechanism: i) the first uses a gated multiple ridge descent mechanism in conjunction with established (hand-crafted) histogram of gradients features for face alignment and achieves state-of-the-art landmarking performance across a wide range of facial poses, ii) the second simultaneously learns multiple-descent directions as well as binary features that are optimal for the alignment tasks and in addition to competitive landmarking results also ensures extremely rapid processing. We evaluate both approaches in rigorous experiments on several popular datasets of 3D face images, i.e., the FRGCv2 and Bosphorus 3D Face datasets and image collections F and G from the University of Notre Dame. The results of our evaluation show that both approaches compare favorably to the state-of-the-art, while exhibiting considerable robustness to pose variations.

Overview

An overview of our landmarkers is presented in Fig. 1.

Figure 1: Multiple landmarking models (each containing a cascade of regression models) are trained during the learning stage. At run-time a gating function is used to select the landmarking model that best fits the characteristics of the test data.

The qualitative results in Fig. 2 show that the proposed solutions exhibit high robustness to different types of appearance variations and display competitive performance when compared to the state-of-the-art.

Fig. 2: Sample results of the proposed landmarking approach. Our model is able to reliably estimate the location of salient facial features in 3D face data even in the presence of large pose variations, i.e., with yaw angles up to 90°.

Download

For more details have a look at the complete paper, while the support code can be found here.

Publication

Janez Križaj, Peter Peer, Vitomir Štruc, Simon Dobrišek: Simultaneous multi-descent regression and feature learning for facial landmarking in depth images, in Neural Computing and Applications, Springer, Oct. 2019