wHuBERT
HuBERT-style Conformer for 25 Hz wearable PPG + accelerometry
PPGIMU
Key facts
- Pretraining Data
- PPG + accelerometry at 25 Hz (consumer-wearable rate); corpus not named in abstract
- Venue
- ICLR 2027 submission (under review)
Summary
Iterative HuBERT masked prediction (cluster pseudo-labels → second iteration on intermediate-layer clusters). Paper proposes a cheap probe-based layer-selection protocol at regular checkpoints; best sleep-staging layer sits just below the top, rarely the final layer; 7 label-free stats (incl. effective rank/RankMe) unreliable for selection.