IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity Recognition

Zikang Leng, Amitrajit Bhattacharjee, Hrudhai Rajasekhar, Lizhe Zhang, Elizabeth Bruda, Hyeokhyen Kwon, Thomas Plötz (Georgia Tech / Emory)

Summary

Georgia Tech / Plötz lab practical upgrade of IMUGPT (Leng et al. ISWC 2023 best-paper honorable mention): LLM generates diverse activity text → text-to-motion (e.g. T2M-GPT) → virtual IMU (IMUTube / IMUSim backend) for HAR training.