An automatic sustained attention prediction (ASAP) method for infants and toddlers using wearable device signals

TY - JOUR

T1 - An automatic sustained attention prediction (ASAP) method for infants and toddlers using wearable device signals

AU - Zhang, Yisi

AU - Martinez Cedillo, Priscilla

AU - Mason, Harry Thomas

AU - Vuong, Quoc

AU - Garcia De Soria Bazan, Maria Del Carmen

AU - Mullineaux, David Ross

AU - Knight, Marina Iuliana

AU - Geangu, Elena

N1 - This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy.

PY - 2025/4/17

Y1 - 2025/4/17

N2 - Sustained attention (SA) is a critical cognitive ability that emerges in infancy and affects various aspects of development. Research on SA typically occurs in lab settings, which may not reflect infants’ real-world experiences. Infant wearable technology can collect multimodal data in natural environments, including physiological signals for measuring SA. Here we introduce an automatic sustained attention prediction (ASAP) method that harnesses electrocardiogram (ECG) and accelerometer (Acc) signals. Data from 75 infants (6- to 36-months) were recorded during different activities, with some activities emulating those occurring in the natural environment (i.e., free play). Human coders annotated the ECG data for SA periods validated by fixation data. ASAP was trained on temporal and spectral features from the ECG and Acc signals to detect SA, performing consistently across age groups. To demonstrate ASAP’s applicability, we investigated the relationship between SA and perceptual features - saliency and clutter - measured from egocentric free-play videos. Results showed that saliency in infants’ and toddlers’ views increased during attention periods and decreased with age for attention but not inattention. We observed no differences between ASAP attention detection and human-coded SA periods, demonstrating that ASAP effectively detects SA in infants during free play. Coupled with wearable sensors, ASAP provides unprecedented opportunities for studying infant development in real-world settings.

AB - Sustained attention (SA) is a critical cognitive ability that emerges in infancy and affects various aspects of development. Research on SA typically occurs in lab settings, which may not reflect infants’ real-world experiences. Infant wearable technology can collect multimodal data in natural environments, including physiological signals for measuring SA. Here we introduce an automatic sustained attention prediction (ASAP) method that harnesses electrocardiogram (ECG) and accelerometer (Acc) signals. Data from 75 infants (6- to 36-months) were recorded during different activities, with some activities emulating those occurring in the natural environment (i.e., free play). Human coders annotated the ECG data for SA periods validated by fixation data. ASAP was trained on temporal and spectral features from the ECG and Acc signals to detect SA, performing consistently across age groups. To demonstrate ASAP’s applicability, we investigated the relationship between SA and perceptual features - saliency and clutter - measured from egocentric free-play videos. Results showed that saliency in infants’ and toddlers’ views increased during attention periods and decreased with age for attention but not inattention. We observed no differences between ASAP attention detection and human-coded SA periods, demonstrating that ASAP effectively detects SA in infants during free play. Coupled with wearable sensors, ASAP provides unprecedented opportunities for studying infant development in real-world settings.

KW - sustained attention

KW - infant development

KW - computational model

KW - electrocardiogram

KW - wearable sensors

KW - naturalistic studies

KW - visual saliency

U2 - 10.1038/s41598-025-96794-x

DO - 10.1038/s41598-025-96794-x

M3 - Article

SN - 2045-2322

VL - 15

JO - Scientific Reports

JF - Scientific Reports

M1 - 13298 (2025)

ER -