ECGFM-U-Lite (1D-MobileViT student distilled from a unified ECG FM)

Recent electrocardiogram (ECG) foundation models have extended ECG analysis from rhythm and morphology recognition to cardiac structure-function assessment, but the computational and memory requirements limit their use in resource-constrained settings. This study aimed to reduce the size and inference cost of a unified ECG foundation model while retaining its multitask performance and clinically relevant representations. We developed the ECGFM-U-Lite, a compact 1D-MobileViT student, using a three-stage compression procedure. Task outputs and intermediate representations were firstly transfered from teacher through structure-function consistent distillation, redundant channels were than removed by using physiologic attention-guided pruning while retaining anatomically informative pathways, and the structure-function-aware quantization strategy achieves adaptive precise quantification by leveraging the sensitivity discrepancies across different modules finally. The model was evaluated on six locked external cohorts. Its computational profile was examined on a laptop GPU and under Android- and Jetson-Nano-oriented ONNX Runtime simulations. ECGFM-U-Lite achieved an overall AUC of 0.862, compared with 0.918 for the teacher, and retained 93.8% and 93.5% of teacher AUC for rhythm/morphology and structure/function tasks, respectively. ECG-to-Text and Text-to-ECG R@1 values were 0.766 and 0.762 in the teacher-derived semantic consistency probe. The parameter count decreased from 86.4 M to 655.7 K, model size from 345.6 MB to 1.7 MB, and peak RAM from 320 MB to 4.4 MB. The inference process was 3.6-fold faster on the laptop GPU and approximately 3.7-fold faster in the simulated edge-oriented profiles. U-Lite substantially reduces the resource requirements of a unified ECG foundation model while preserving most of its external discrimination and teacher-derived cross-modal representation structure, providing a practical basis for subsequent evaluation on resource-constrained hardware.

Verbatim fromSemantic Scholar· Abstract via Semantic Scholar; © the authors/publisher