Role of language-derived semantics in knowledge distillation on wearable sensor data (Biomimetics 2026)

This Biomimetics 2026 study tests where to inject language-derived class semantics into knowledge distillation for wearable human activity recognition on GENEActiv and PAMAP2. Class descriptions are generated with an LLM, embedded with a frozen text encoder, and used to condition the teacher, the student, or both. Teacher-side semantic guidance was the most consistent strategy; gains are modest and no code is released.

• Form factor: wrist (GENEActiv) / multi-site (PAMAP2)

Wearable sensor-based human activity recognition (HAR) has been widely studied for understanding human activities from time-series data. However, wearable sensor data exhibit substantial inter-individual variations, while the signal differences between activities can be relatively subtle. These characteristics make it challenging to learn effective representations for activity recognition. Considering these limitations, human cognition provides a useful motivation, as raw signals are interpreted together with prior knowledge and contextual expectations, suggesting that language-derived semantics can complement the information contained in time-series data. However, incorporating such semantic information into wearable systems requires careful consideration of the computational and memory constraints of edge devices. In this regard, knowledge distillation (KD) enables richer information to be exploited during training while retaining a compact student model for inference. Nevertheless, how language-derived semantics contribute to KD on wearable sensor data remains underexplored. In this study, we systematically investigate how textual semantics can be incorporated into KD through a Semantic Guidance Module (SGM), considering three different strategies: teacher-side (T-SG), student-side (S-SG), and both-side (B-SG). We examine these strategies through various evaluations, including analyses of teacher–student architectures, prompt types, and window lengths. Our findings demonstrate that language-derived semantics provide complementary knowledge for student learning and offer insights into how semantic information can be effectively incorporated into KD for wearable sensor-based HAR.

Verbatim from the publisher's DOI record (opens in a new tab) · Publisher licence: https://creativecommons.org/licenses/by/4.0/

No results from this paper on ChatPPG leaderboards yet. Browse the leaderboards.

• PAMAP2Physical Activity Monitoring (n=9, 3× IMU + HR)9 subjects · IMU · Temp · HR