Paperdoi:10.1109/ACIIW63320.2024.00043

Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition

Venue listed2024Added Nov 9, 2026

  • YH
  • KY
  • TI
  • YK

Authors: Yasuhide Hyodo, Kiyoshi Yoshikawa, Tomoya Ikuta, Yota Komoriya

ACII Workshops 2024

TL;DR

Wrist-worn PPG pulse-rate-variability DNN for mental fatigue, with a feature capturing temporal accumulation of arousal states; accuracy 0.90, F1 0.91 in their experiments.

  • Form factor: wrist

Abstract

Mental fatigue recognition by heart rate variability analysis in a photoplethysmography (PPG) device in terms of pulse rate variability (PRV) is gathering interest for stress relief and well-being applications. To realize mental fatigue recognition systems, many studies have been conducted, which showed the high accuracy of such systems evaluations. However, there are limitations in generalization due to the lack of consideration of the physiological mechanism. In this study, we developed a framework for investigating mental fatigue recognition using physiologically interpretable deep neural network (DNN) in a wrist-worn PPG device. Furthermore, we developed a novel feature extraction method that captures the temporal accumulation of arousal states to consider the perspective of cognitive resource consumption. The results suggest that the method we developed improved the mental fatigue recognition performance of the wrist-worn PPG device throughout our experiments (an accuracy of 0.90 and an F1 score of 0.91). In addition, it was observed that the method for the wrist-worn PPG device enhanced the contribution of HRV indices, known to be associated with cognitive function. The findings demonstrate that the proposed approach enhances not only accuracy but also the physiological interpretability of the model in PPG devices.

Verbatim from Semantic Scholar (opens in a new tab) · Abstract via Semantic Scholar; © the authors/publisher

Results on ChatPPG leaderboards

All leaderboards

No results from this paper on ChatPPG leaderboards yet. Browse the leaderboards.

Tasks & signals

Tasks

Stress

Signals

Keywords

FatigueMental FatigueWrist PPGPRVHRVDNN

Models

How it works

How Hyodo 2024 interpretable PRV DNN for mental fatigue (wrist PPG) works: Setup → Method → TargetSetup: Signals (PPG); Form factor (wrist). Method: Hyodo 2024 interpretable PRV DNN for mental fatigue (wrist PPG). Target: Stress.SetupSignals: PPGSignalsPPGForm factor: wristForm factorwristMethodHyodo 2024 interpretable PRV…TargetStressStress

Cite this paper

Cite this paper with the fields recorded here. Check it against the publisher before submitting.

Hyodo, Y., Yoshikawa, K., Ikuta, T., & Komoriya, Y. (2024). Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition. ACII Workshops 2024. https://doi.org/10.1109/ACIIW63320.2024.00043
Hyodo, Yasuhide, Kiyoshi Yoshikawa, Tomoya Ikuta, and Yota Komoriya. 2024. "Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition." ACII Workshops 2024. https://doi.org/10.1109/ACIIW63320.2024.00043.
Hyodo, Y., Yoshikawa, K., Ikuta, T. and Komoriya, Y. (2024) 'Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition', ACII Workshops 2024. doi: 10.1109/ACIIW63320.2024.00043.
Hyodo, Yasuhide, et al. "Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition." ACII Workshops 2024, 2024. https://doi.org/10.1109/ACIIW63320.2024.00043.
Y. Hyodo, K. Yoshikawa, T. Ikuta, and Y. Komoriya, "Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition," ACII Workshops 2024, 2024, doi: 10.1109/ACIIW63320.2024.00043.
@article{hyodo2024investigation,
  title         = {{Investigation of Physiologically Interpretable Deep Neural Network Using Pulse Rate Variability in Mental Fatigue Recognition}},
  author        = {Hyodo, Yasuhide and Yoshikawa, Kiyoshi and Ikuta, Tomoya and Komoriya, Yota},
  year          = {2024},
  journal       = {ACII Workshops 2024},
  doi           = {10.1109/ACIIW63320.2024.00043}
}

Added to the ChatPPG research hub