Abstract
We propose a new framework to decompose 3D facial shape into identity and expression.
Existing 3D face disentanglement methods assume the presence of a corresponding neutral (i.e. identity) face for each subject. Our method designs an identity discriminator to obviate this requirement. This is a binary classifier that determines if two input faces are from the same identity, and encourages the synthesised identity face to have the same identity features as the input face and to approach the `apathy' expression.
To this end, we take advantage of adversarial learning to train a PointNet-based variational auto-encoder and discriminator. Comprehensive experiments are employed on CoMA, BU3DFE, and FaceScape datasets. Results demonstrate state-of-the-art performance with the option of operating in a more versatile application setting of no known neutral ground truths. Code is available at \url{https://github.com/rmraaron/FaceExpDisentanglement}.
Existing 3D face disentanglement methods assume the presence of a corresponding neutral (i.e. identity) face for each subject. Our method designs an identity discriminator to obviate this requirement. This is a binary classifier that determines if two input faces are from the same identity, and encourages the synthesised identity face to have the same identity features as the input face and to approach the `apathy' expression.
To this end, we take advantage of adversarial learning to train a PointNet-based variational auto-encoder and discriminator. Comprehensive experiments are employed on CoMA, BU3DFE, and FaceScape datasets. Results demonstrate state-of-the-art performance with the option of operating in a more versatile application setting of no known neutral ground truths. Code is available at \url{https://github.com/rmraaron/FaceExpDisentanglement}.
Original language | English |
---|---|
Title of host publication | International Conference on Automatic Face and Gesture Recognition 2023 |
Publisher | IEEE |
Publication status | Accepted/In press - 11 Sept 2022 |
Event | International Conference on Automatic Face and Gesture Recognition 2023 - Waikoloa Beach Marriott Resort, Waikoloa, Hawaii, United States Duration: 5 Jan 2023 → 8 Jan 2023 https://fg2023.ieee-biometrics.org/ |
Conference
Conference | International Conference on Automatic Face and Gesture Recognition 2023 |
---|---|
Abbreviated title | FG-2023 |
Country/Territory | United States |
City | Waikoloa, Hawaii |
Period | 5/01/23 → 8/01/23 |
Internet address |