PaperarXiv:2304.05088
WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition
Proc. ACM IMWUT 8(4), Article 175, November 2024
TL;DR
Introduces WEAR: 22 participants, 18 outdoor workout activities (running, stretching, strength, with variations), 11 locations, ~19 hours. Sensing is 3-axis acceleration only at a target 50 Hz ±8 g from four Bangle.js watches (both wrists and both ankles), plus head-mounted egocentric video. Sessions are untrimmed with breaks (NULL class).
- Form factor: wrist
Abstract
Research has shown the complementarity of camera- and inertial-based data for modeling human activities, yet datasets with both egocentric video and inertial-based sensor data remain scarce. In this paper, we introduce WEAR, an outdoor sports dataset for both vision- and inertial-based human activity recognition (HAR). Data from 22 participants performing a total of 18 different workout activities was collected with synchronized inertial (acceleration) and camera (egocentric video) data recorded at 11 different outside locations. WEAR provides a challenging prediction scenario in changing outdoor environments using a sensor placement, in line with recent trends in real-world applications. Benchmark results show that through our sensor placement, each modality interestingly offers complementary strengths and weaknesses in their prediction performance. Further, in light of the recent success of single-stage Temporal Action Localization (TAL) models, we demonstrate their versatility of not only being trained using visual data, but also using raw inertial data and being capable to fuse both modalities by means of simple concatenation. The dataset and code to reproduce experiments is publicly available via: mariusbock.github.io/wear/.
Verbatim from arXiv (opens in a new tab) · arXiv metadata (abstracts are released under CC0)
Results on ChatPPG leaderboards
All leaderboardsNo results from this paper on ChatPPG leaderboards yet. Browse the leaderboards.
Tasks & signals
Tasks
Signals
Keywords
Datasets used
How it works
Cite this paper
Bock, M., Kuehne, H., Van Laerhoven, K., & Moeller, M. (2024). WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition. Proc. ACM IMWUT 8, , November 2024, 175. https://doi.org/10.1145/3699776
Bock, Marius, Hilde Kuehne, Kristof Van Laerhoven, and Michael Moeller. 2024. "WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition." Proc. ACM IMWUT 8, , November 2024, 175. https://doi.org/10.1145/3699776.
Bock, M., Kuehne, H., Van Laerhoven, K. and Moeller, M. (2024) 'WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition', Proc. ACM IMWUT 8, , November 2024, p. 175. doi: 10.1145/3699776.
Bock, Marius, et al. "WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition." Proc. ACM IMWUT 8, , November 2024, 2024, p. 175. https://doi.org/10.1145/3699776.
M. Bock, H. Kuehne, K. Van Laerhoven, and M. Moeller, "WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition," Proc. ACM IMWUT 8, , November 2024, p. 175, 2024, doi: 10.1145/3699776.
@inproceedings{bock2024wear,
title = {{WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition}},
author = {Bock, Marius and Kuehne, Hilde and Van Laerhoven, Kristof and Moeller, Michael},
year = {2024},
booktitle = {Proc. ACM IMWUT 8, , November 2024},
pages = {175},
doi = {10.1145/3699776},
eprint = {2304.05088},
archivePrefix = {arXiv}
}Added to the ChatPPG research hub