Paperdoi:10.1093/sleepadvances/zpaf021
A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography
Sleep Advances 6(2):zpaf021 (published 2025-03-22)
(opens in a new tab)An-Marie Schyvens et al., "A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography", doi:10.1093/sleepadvances/zpaf021, CC BY 4.0
TL;DR
Cohort: 62 adults (52 M / 10 F, 46.0 ± 12.6 y, BMI 28.8 ± 5.6). The group mixed people referred for suspected sleep apnea with healthy volunteers. Each person did one night of in-lab PSG while wearing 2–4 devices at once.
- Form factor: wrist
Abstract
Study Objectives
The aim of this study is to assess the performance of six different consumer wearable sleep-tracking devices, namely the Fitbit Charge 5, Fitbit Sense, Withings Scanwatch, Garmin Vivosmart 4, Whoop 4.0, and the Apple Watch Series 8, for detecting sleep parameters compared to the gold standard, polysomnography (PSG).
Methods
Sixty-two adults (52 males and 10 females, mean age ± SD = 46.0 ± 12.6 years) spent a single night in the sleep laboratory with PSG while simultaneously using two to four wearable devices.
Results
The results indicate that most wearables displayed significant differences with PSG for total sleep time, sleep efficiency, wake after sleep onset, and light sleep (LS). Nevertheless, all wearables demonstrated a higher percentage of correctly identified epochs for deep sleep and rapid eye movement sleep compared to wake (W) and LS. All devices detected >90% of sleep epochs (ie, sensitivity), but showed lower specificity (29.39%–52.15%). The Cohen’s kappa coefficients of the wearable devices ranged from 0.21 to 0.53, indicating fair to moderate agreement with PSG.
Conclusions
Our results indicate that all devices can benefit from further improvement for multistate categorization. However, the devices with higher Cohen’s kappa coefficients, such as the Fitbit Sense (κ = 0.42), Fitbit Charge 5 (κ = 0.41), and Apple Watch Series 8 (κ = 0.53), could be effectively used to track prolonged and significant changes in sleep architecture.
Verbatim from the publisher's DOI record (opens in a new tab) · Publisher licence: https://creativecommons.org/licenses/by/4.0/
Results on ChatPPG leaderboards
All leaderboardsNo results from this paper on ChatPPG leaderboards yet. Browse the leaderboards.
Tasks & signals
Tasks
Signals
Keywords
How it works
Cite this paper
Schyvens, A. M., Peters, B., Van Oost, N. C., Aerts, J. M., Masci, F., Neven, A., Dirix, H., Wets, G., Ross, V., & Verbraecken, J. (2025). A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography. Sleep Advances 6:zpaf021. https://doi.org/10.1093/sleepadvances/zpaf021
Schyvens, A M, B Peters, N C Van Oost, J M Aerts, F Masci, A Neven, H Dirix, G Wets, V Ross, and J Verbraecken. 2025. "A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography." Sleep Advances 6:zpaf021. https://doi.org/10.1093/sleepadvances/zpaf021.
Schyvens, A. M., Peters, B., Van Oost, N. C., Aerts, J. M., Masci, F., Neven, A., Dirix, H., Wets, G., Ross, V. and Verbraecken, J. (2025) 'A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography', Sleep Advances 6:zpaf021. doi: 10.1093/sleepadvances/zpaf021.
Schyvens, A M, et al. "A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography." Sleep Advances 6:zpaf021, 2025. https://doi.org/10.1093/sleepadvances/zpaf021.
A. M. Schyvens et al., "A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography," Sleep Advances 6:zpaf021, 2025, doi: 10.1093/sleepadvances/zpaf021.
@article{schyvens2025performance,
title = {{A performance validation of six commercial wrist-worn wearable sleep-tracking devices for sleep stage scoring compared to polysomnography}},
author = {Schyvens, A. M. and Peters, B. and Van Oost, N. C. and Aerts, J. M. and Masci, F. and Neven, A. and Dirix, H. and Wets, G. and Ross, V. and Verbraecken, J.},
year = {2025},
journal = {Sleep Advances 6:zpaf021},
doi = {10.1093/sleepadvances/zpaf021}
}Added to the ChatPPG research hub
