EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing, 2026, Mahmud et al.

Chandelier

Senior Member (Voting Rights)
EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing

Mahmud, Saif; Kim, Jiwan; Yu, Tianhong Catherine; Liang, Qikang; Parikh, Vineet A.; Guimbretiere, Francois; Zhang, Cheng

Abstract
Full-body pose tracking on wearables enables fitness tracking, rehabilitation, and activity logging on the go, but remains challenging as it requires capturing movements across the torso, arms, legs, and head. Existing solutions often rely on specialized suits or multiple sensors, limiting practicality.

We present EchoMotion, an active acoustic sensing system that enables full-body pose tracking using only a wrist-worn smartwatch. By leveraging the built-in speaker and microphone to emit inaudible ultrasonic signals and process their reflections, EchoMotion employs a lightweight deep learning pipeline to infer the 3D positions of 12 body joints.

We first validated the approach with 10 participants using a custom hardware prototype, achieving a mean per-joint position error (MPJPE) of 5.36 cm and rotation error (MPJRE) of 11.68°. We then confirmed feasibility with 15 participants on a commercial smartwatch (MPJPE 5.99 cm, MPJRE 11.92°).

Finally, in a semi-in-the-wild study with 10 participants, EchoMotion maintained comparable performance (MPJPE 6.41 cm, MPJRE 13.18°), suggesting its potential for future real-world use.

Web | DOI | Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies | Open Access
 


Researchers track whole body movement with just a smartwatch​


For the first time, researchers can track the movement of a person’s entire body with ultrasonic sound waves, using just an off-the-shelf smartwatch and a lightweight artificial intelligence model – all while ensuring privacy and efficiency.

The new technology, called EchoMotion, was developed by Cornell’s Smart Computer Interfaces for Future Interactions (SciFi) Lab, directed by Cheng Zhang, associate professor of information science in the Cornell Ann S. Bowers College of Computing and Information Science.

It uses the built-in speaker and microphone on a commercial smartwatch to determine a person’s body position using a sonar-like sensing system. Once EchoMotion is integrated into commercial wearables or virtual reality (VR) systems, it could be used for tracking workouts, daily activities and progress on physical rehabilitation.

EchoMotion represents a scalable approach that can use AI to understand human behaviors in the real world, Zheng said.
​


Discussed on Hacker News.
 
Yes, good to see technology advance. We need the minds who can analyse the data in a creative way rather than just scoring up and down time I think. But the software for pattern recognition exists in things like the Merlin bird identification app. Maybe you will be able to diagnose ME/CFS or MS or Parkinson's with this system in a while.
 
This reminds me of you you can use your wifi router to track where people are in the room.

This might be useful for tracking body orientation in relation to orthostatic intolerance, although duvets, blankets and clothing covering the wrist might be an issue.
 
Back
Top Bottom