ArmTrak: tracking arm postures with a smartwatch

Shen, Sheng

Permalink

https://hdl.handle.net/2142/97546 Copy

Description

Title

ArmTrak: tracking arm postures with a smartwatch

Author(s)

Shen, Sheng

Issue Date

2017-04-05

Director of Research (if dissertation) or Advisor (if thesis)

Choudhury, Romit Roy

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

• Gesture
• Tracking
• Smartwatch

Abstract

We aim to track the 3D posture of the entire arm - both wrist and elbow - using the motion and magnetic sensors on smartwatches. We do not intend to employ machine learning to train the system on a specific set of gestures. Instead, we aim to trace the geometric motion of the arm, which can then be used as a generic platform for gesture-based applications. The problem is challenging because the arm posture is a function of both elbow and shoulder motions, whereas the watch is only a single point of (noisy) measurement from the wrist. Moreover, while other tracking systems (like indoor/outdoor localization) often benefit from maps or landmarks to occasionally reset their estimates, such opportunities are almost absent here. While this appears to be an under-constrained problem, we find that the pointing direction of the forearm is strongly coupled to the arm's posture. If the gyroscope and compass on the watch can be made to estimate this direction, the 3D search space can become smaller; the IMU sensors can then be applied to mitigate the remaining uncertainty. We leverage this observation to design ArmTrak, a system that fuses the IMU sensors and the anatomy of arm joints into a modified hidden Markov model (HMM) to continuously estimate state variables. Using Kinect 2.0 as ground truth, we achieve around 9.2 cm of median error for free-form postures; the errors increase to 13.3 cm for a real-time version. We believe this is a step forward in posture tracking, and with some additional work, could become a generic underlay to various practical applications.

Graduation Semester

2017-05

Type of Resource

text

Permalink

http://hdl.handle.net/2142/97546

Copyright and License Information

Copyright 2017 Sheng Shen

Owning Collections