Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors

By Muhammad Shoaib, Stephan Bosch, Özlem Durmaz Incel, Hans Scholten, Paul J. M. Havinga. Italian National Conference on Sensors, 2016

420 citations recorded by the source corpus.

The position of on-body motion sensors plays an important role in human activity recognition. Most often, mobile phone sensors at the trouser pocket or an equivalent position are used for this purpose. However, this position is not suitable for recognizing activities that involve hand gestures, such as smoking, eating, drinking coffee and giving a talk. To recognize such activities, wrist-worn motion sensors are used. However, these two positions are mainly used in isolation. To use richer context information, we evaluate three motion sensors (accelerometer, gyroscope and linear acceleration sensor) at both wrist and pocket positions. Using three classifiers, we show that the combination of these two positions outperforms the wrist position alone, mainly at smaller segmentation windows. Another problem is that less-repetitive activities, such as smoking, eating, giving a talk and drinking coffee, cannot be recognized easily at smaller segmentation windows unlike repetitive activities, like walking, jogging and biking. For this purpose, we evaluate the effect of seven window sizes (2–30 s) on thirteen activities and show how increasing window size affects these various activities in different ways. We also propose various optimizations to further improve the recognition of these activities. For reproducibility, we make our dataset publicly available.

Subfields: Law, Public Health, Environmental and Occupational Health

View Paper: https://www.semanticscholar.org/paper/e4338af0ee599c29515b40c67a2777499aa0021b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Privacy and Utility Preserving Sensor-Data Transformations (2019, methodology): “Utwente [42] includes the data of 6 participants performing several activities, including potentially sensitive smoking activity, while wearing a smart-phone on their wrist.”