By the same authors

From the same journal

Real-Time 3D face fitting and texture fusion on in-the-wild videos

Research output: Contribution to journalArticlepeer-review

Author(s)

  • Patrik Huber
  • Philipp Kopp
  • William Christmas
  • Matthias Rätsch
  • Josef Kittler

Department/unit(s)

Publication details

JournalIEEE Signal Processing Letters
DateAccepted/In press - 18 Dec 2016
DateE-pub ahead of print - 21 Dec 2016
DatePublished (current) - 1 Apr 2017
Issue number4
Volume24
Number of pages5
Pages (from-to)437-441
Early online date21/12/16
Original languageEnglish

Abstract

We present a fully automatic approach to real-time 3D face reconstruction from monocular in-the-wild videos. With the use of a cascaded-regressor-based face tracking and a 3D morphable face model shape fitting, we obtain a semidense 3D face shape. We further use the texture information from multiple frames to build a holistic 3D face representation from the video footage. Our system is able to capture facial expressions and does not require any person-specific training. We demonstrate the robustness of our approach on the challenging 300 Videos in the Wild (300-VW) dataset. Our real-time fitting framework is available as an open-source library at http://4dface.org.

    Research areas

  • 3D face reconstruction, 3D Morphable Face Model, Face model fitting, open source software, real-time

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations