Paperdoi:10.1145/3242969.3242985
Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
ICMI 2018 (ACM International Conference on Multimodal Interaction)
TL;DR
WESAD records 15 lab participants wearing a chest RespiBAN (ECG, EDA, EMG, respiration, temperature, accelerometer) and a wrist Empatica E4 (BVP 64 Hz, EDA, temperature, accelerometer) through baseline, amusement (funny clips), stress (Trier Social Stress Test) and meditation. The paper sets the reference baselines: hand-crafted features with five classic classifiers under leave-one-subject-out validation, for a 3-class baseline / stress / amusement task and a binary stress task. Using only wrist physiology (BVP, EDA, temperature) a Random Forest reaches 76.2% accuracy and 66.3% macro F1 on the 3-class task; wrist BVP alone reaches 70.2% accuracy with LDA.
Abstract
Affect recognition aims to detect a person's affective state based on observables, with the goal to e.g. improve human-computer interaction. Long-term stress is known to have severe implications on wellbeing, which call for continuous and automated stress monitoring systems. However, the affective computing community lacks commonly used standard datasets for wearable stress detection which a) provide multimodal high-quality data, and b) include multiple affective states. Therefore, we introduce WESAD, a new publicly available dataset for wearable stress and affect detection. This multimodal dataset features physiological and motion data, recorded from both a wrist- and a chest-worn device, of 15 subjects during a lab study. The following sensor modalities are included: blood volume pulse, electrocardiogram, electrodermal activity, electromyogram, respiration, body temperature, and three-axis acceleration. Moreover, the dataset bridges the gap between previous lab studies on stress and emotions, by containing three different affective states (neutral, stress, amusement). In addition, self-reports of the subjects, which were obtained using several established questionnaires, are contained in the dataset. Furthermore, a benchmark is created on the dataset, using well-known features and standard machine learning methods. Considering the three-class classification problem ( baseline vs. stress vs. amusement ), we achieved classification accuracies of up to 80%,. In the binary case ( stress vs. non-stress ), accuracies of up to 93%, were reached. Finally, we provide a detailed analysis and comparison of the two device locations ( chest vs. wrist ) as well as the different sensor modalities.
Verbatim from Semantic Scholar (opens in a new tab) · Abstract via Semantic Scholar; © the authors/publisher
Results on ChatPPG leaderboards · 1
All leaderboards| Leaderboard | Method | Result | Rank |
|---|---|---|---|
| WESAD macro-F1Emotion recognition (valence/arousal) | Introducing WESAD, a Multimodal Dataset for… | 0.6633macro-F1, higher is better | #1 of 1 |
1 row is credited to this paper. Ranks apply within each leaderboard only, as reported by the source.
Tasks & signals
Tasks
Signals
Devices
Keywords
Datasets used
How it works
Cite this paper
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., & Van Laerhoven, K. (2018). Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection. ICMI 2018. https://doi.org/10.1145/3242969.3242985
Schmidt, Philip, Attila Reiss, Robert Duerichen, Claus Marberger, and Kristof Van Laerhoven. 2018. "Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection." ICMI 2018. https://doi.org/10.1145/3242969.3242985.
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C. and Van Laerhoven, K. (2018) 'Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection', ICMI 2018. doi: 10.1145/3242969.3242985.
Schmidt, Philip, et al. "Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection." ICMI 2018, 2018. https://doi.org/10.1145/3242969.3242985.
P. Schmidt, A. Reiss, R. Duerichen, C. Marberger, and K. Van Laerhoven, "Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection," ICMI 2018, 2018, doi: 10.1145/3242969.3242985.
@article{schmidt2018introducing,
title = {{Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection}},
author = {Schmidt, Philip and Reiss, Attila and Duerichen, Robert and Marberger, Claus and Van Laerhoven, Kristof},
year = {2018},
journal = {ICMI 2018},
doi = {10.1145/3242969.3242985}
}Added to the ChatPPG research hub