Practical Measurement and Reconstruction of Spectral Skin Reflectance

Yuliya Gitlina; Giuseppe Claudio Guarnera; Daljit Singh Dhillon; Jan Hansen; Alexandros Lattas; Dinesh Pai; Abhijeet Ghosh

doi:10.1111/cgf.14055

Practical Measurement and Reconstruction of Spectral Skin Reflectance

Yuliya Gitlina, Giuseppe Claudio Guarnera, Daljit Singh Dhillon, Jan Hansen, Alexandros Lattas, Dinesh Pai, Abhijeet Ghosh

Computer Science

Research output: Contribution to journal › Article › peer-review

Abstract

We present two practical methods for measurement of spectral skin reflectance suited for live subjects, and drive a spectral BSSRDF model with appropriate complexity to match skin appearance in photographs, including human faces. Our primary measurement method employs illuminating a subject with two complementary uniform spectral illumination conditions using a multispectral LED sphere to estimate spatially varying parameters of chromophore concentrations including melanin and hemoglobin concentration, melanin blend-type fraction, and epidermal hemoglobin fraction. We demonstrate that our proposed complementary measurements enable higher-quality estimate of chromophores than those obtained using standard broadband illumination, while being suitable for integration with multiview facial capture using regular color cameras. Besides novel optimal measurements under controlled illumination, we also demonstrate how to adapt practical skin patch measurements using a hand-held dermatological skin measurement device, a Miravex Antera 3D camera, for skin appearance reconstruction and rendering. Furthermore, we introduce a novel approach for parameter estimation given the measurements using neural networks which is significantly faster than a lookup table search and avoids parameter quantization. We demonstrate high quality matches of skin appearance with photographs for a variety of skin types with our proposed practical measurement procedures, including photorealistic spectral reproduction and renderings of facial appearance.

Original language	English
Pages (from-to)	75-89
Number of pages	15
Journal	Computer graphics forum
Volume	39
Issue number	4
Early online date	20 Jul 2020
DOIs	https://doi.org/10.1111/cgf.14055
Publication status	Published - Jul 2020

Bibliographical note

Access to Document

10.1111/cgf.14055

v39i4pp075-089
© 2020 The Author(s)
Final published version, 37.9 MBLicence: CC BY

https://diglib.eg.org/handle/10.1111/cgf14055Licence: CC BY

Cite this

@article{74f105b8c19545dab1fab55e3b0129b6,

title = "Practical Measurement and Reconstruction of Spectral Skin Reflectance",

abstract = "We present two practical methods for measurement of spectral skin reflectance suited for live subjects, and drive a spectral BSSRDF model with appropriate complexity to match skin appearance in photographs, including human faces. Our primary measurement method employs illuminating a subject with two complementary uniform spectral illumination conditions using a multispectral LED sphere to estimate spatially varying parameters of chromophore concentrations including melanin and hemoglobin concentration, melanin blend-type fraction, and epidermal hemoglobin fraction. We demonstrate that our proposed complementary measurements enable higher-quality estimate of chromophores than those obtained using standard broadband illumination, while being suitable for integration with multiview facial capture using regular color cameras. Besides novel optimal measurements under controlled illumination, we also demonstrate how to adapt practical skin patch measurements using a hand-held dermatological skin measurement device, a Miravex Antera 3D camera, for skin appearance reconstruction and rendering. Furthermore, we introduce a novel approach for parameter estimation given the measurements using neural networks which is significantly faster than a lookup table search and avoids parameter quantization. We demonstrate high quality matches of skin appearance with photographs for a variety of skin types with our proposed practical measurement procedures, including photorealistic spectral reproduction and renderings of facial appearance.",

author = "Yuliya Gitlina and Guarnera, {Giuseppe Claudio} and Dhillon, {Daljit Singh} and Jan Hansen and Alexandros Lattas and Dinesh Pai and Abhijeet Ghosh",

note = "{\textcopyright} 2020 The Author(s)",

year = "2020",

month = jul,

doi = "10.1111/cgf.14055",

language = "English",

volume = "39",

pages = "75--89",

journal = "Computer graphics forum",

issn = "0167-7055",

publisher = "Wiley-Blackwell",

number = "4",

}

TY - JOUR

T1 - Practical Measurement and Reconstruction of Spectral Skin Reflectance

AU - Gitlina, Yuliya

AU - Guarnera, Giuseppe Claudio

AU - Dhillon, Daljit Singh

AU - Hansen, Jan

AU - Lattas, Alexandros

AU - Pai, Dinesh

AU - Ghosh, Abhijeet

PY - 2020/7

Y1 - 2020/7

N2 - We present two practical methods for measurement of spectral skin reflectance suited for live subjects, and drive a spectral BSSRDF model with appropriate complexity to match skin appearance in photographs, including human faces. Our primary measurement method employs illuminating a subject with two complementary uniform spectral illumination conditions using a multispectral LED sphere to estimate spatially varying parameters of chromophore concentrations including melanin and hemoglobin concentration, melanin blend-type fraction, and epidermal hemoglobin fraction. We demonstrate that our proposed complementary measurements enable higher-quality estimate of chromophores than those obtained using standard broadband illumination, while being suitable for integration with multiview facial capture using regular color cameras. Besides novel optimal measurements under controlled illumination, we also demonstrate how to adapt practical skin patch measurements using a hand-held dermatological skin measurement device, a Miravex Antera 3D camera, for skin appearance reconstruction and rendering. Furthermore, we introduce a novel approach for parameter estimation given the measurements using neural networks which is significantly faster than a lookup table search and avoids parameter quantization. We demonstrate high quality matches of skin appearance with photographs for a variety of skin types with our proposed practical measurement procedures, including photorealistic spectral reproduction and renderings of facial appearance.

AB - We present two practical methods for measurement of spectral skin reflectance suited for live subjects, and drive a spectral BSSRDF model with appropriate complexity to match skin appearance in photographs, including human faces. Our primary measurement method employs illuminating a subject with two complementary uniform spectral illumination conditions using a multispectral LED sphere to estimate spatially varying parameters of chromophore concentrations including melanin and hemoglobin concentration, melanin blend-type fraction, and epidermal hemoglobin fraction. We demonstrate that our proposed complementary measurements enable higher-quality estimate of chromophores than those obtained using standard broadband illumination, while being suitable for integration with multiview facial capture using regular color cameras. Besides novel optimal measurements under controlled illumination, we also demonstrate how to adapt practical skin patch measurements using a hand-held dermatological skin measurement device, a Miravex Antera 3D camera, for skin appearance reconstruction and rendering. Furthermore, we introduce a novel approach for parameter estimation given the measurements using neural networks which is significantly faster than a lookup table search and avoids parameter quantization. We demonstrate high quality matches of skin appearance with photographs for a variety of skin types with our proposed practical measurement procedures, including photorealistic spectral reproduction and renderings of facial appearance.

U2 - 10.1111/cgf.14055

DO - 10.1111/cgf.14055

M3 - Article

SN - 0167-7055

VL - 39

SP - 75

EP - 89

JO - Computer graphics forum

JF - Computer graphics forum

IS - 4

ER -