PaperarXiv:2112.07252
A Deep Knowledge Distillation framework for EEG assisted enhancement of single-lead ECG based sleep staging
arXiv preprint (cs/eess), Dec 2021
TL;DR
U-Time-derived fully convolutional teacher (C3-A2/C4-A1 EEG) and student (Lead-I ECG), both at 200 Hz, using 30 s epochs. Step 1: attention-transfer (AT) loss trains student feature maps to mimic the frozen EEG teacher. Step 2: weighted CE plus softened-softmax KL distillation (SD), with α = 0.5 and T = 1.
Abstract
Automatic Sleep Staging study is presently done with the help of Electroencephalogram (EEG) signals. Recently, Deep Learning (DL) based approaches have enabled significant progress in this area, allowing for near-human accuracy in automated sleep staging. However, EEG based sleep staging requires an extensive as well as an expensive clinical setup. Moreover, the requirement of an expert for setup and the added inconvenience to the subject under study renders it unfavourable in a point of care context. Electrocardiogram (ECG), an unobtrusive alternative to EEG, is more suitable, but its performance, unsurprisingly, remains sub-par compared to EEG-based sleep staging. Naturally, it would be helpful to transfer knowledge from EEG to ECG, ultimately enhancing the model's performance on ECG based inputs. Knowledge Distillation (KD) is a renowned concept in DL that looks to transfer knowledge from a better but potentially more cumbersome teacher model to a compact student model. Building on this concept, we propose a cross-modal KD framework to improve ECG-based sleep staging performance with assistance from features learned through models trained on EEG. Additionally, we also conducted multiple experiments on the individual components of the proposed model to get better insight into the distillation approach. Data of 200 subjects from the Montreal Archive of Sleep Studies (MASS) was utilized for our study. The proposed model showed a 14.3% and 13.4% increase in weighted-F1-score in 4-class and 3-class sleep staging, respectively. This demonstrates the viability of KD for performance improvement of single-channel ECG based sleep staging in 4-class(W-L-D-R) and 3-class(W-N-R) classification.
Verbatim from arXiv (opens in a new tab) · arXiv metadata (abstracts are released under CC0)
Results on ChatPPG leaderboards
All leaderboardsNo results from this paper on ChatPPG leaderboards yet. Browse the leaderboards.
Tasks & signals
Tasks
Signals
Keywords
How it works
Cite this paper
APA
Joshi, V., Vijayarangan, S., Preejith, S. P., & Sivaprakasam, M. (2021). A Deep Knowledge Distillation framework for EEG assisted enhancement of single-lead ECG based sleep staging. arXiv preprint , Dec 2021. https://arxiv.org/abs/2112.07252
BibTeX
@misc{joshi2021deep,
title = {{A Deep Knowledge Distillation framework for EEG assisted enhancement of single-lead ECG based sleep staging}},
author = {Joshi, Vaibhav and Vijayarangan, Sricharan and Preejith, S. P. and Sivaprakasam, Mohanasankar},
year = {2021},
howpublished = {arXiv preprint , Dec 2021},
eprint = {2112.07252},
archivePrefix = {arXiv}
}Built from the hub record. Check it against the publisher before submitting.
Added to the ChatPPG research hub