Andrea Madotto
Andrea Madotto has 1 paper in the ChatPPG research atlas (2022), linked to 1 model and 6 co-authors in the atlas. Main topics: IMU, accelerometer, CLIP, multimodal, contrastive, Meta-AI.
Papers
- IMU2CLIP: Multimodal Contrastive Learning for IMU Motion Sensors from Egocentric Videos and Text2022 · arXiv preprint
IMU2CLIP aligns IMU motion recordings with egocentric video and text by projecting them into CLIP's joint embedding space. This lets it translate motion into text and matching video, and fine-tuning it improved downstream tasks such as activity recognition.
- Published: ArXiv preprint, 2022
- Signals: Accelerometer
- Venue: arXiv preprint