IMU canonicalization for everyday garments

CLOTHO

Canonicalizing IMUs from loose inertial garments for accurate human motion tracking.

Xiaoxia Gao1 Ruonan Zheng1 Qinze Zhou1 Yu Yan1 Zixuan Zeng1 Shifan Jiang1 Chengxu Zuo1 Yuan Yao1 Zhiyang Dou2 Anjun Chen1 Yipeng Qin3 Shihui Guo1 Jiawei Fang1,4

1Xiamen University, HumanPlus Lab 2MIT 3Cardiff University 4CMU

ACM Transactions on Graphics (SIGGRAPH Asia 2026)

Xiamen University MIT Cardiff University Carnegie Mellon University
Scroll to explore

Demo

See it
on the body.

01 / Abstract

Loose garments,
tight-wear signals.

Garment-mounted inertial measurement units (IMUs) offer a promising path toward comfortable, unobtrusive, and scalable human motion capture, yet their performance still lags behind tightly attached inertial systems. The central challenge is that loose-wear IMUs provide only indirect, garment-mediated measurements of the underlying body dynamics. The sensor–body coupling is configuration-dependent, varying with garment material, fit, sensor placement, and IMU layout, while long-term inertial drift further perturbs the observation space. Consequently, identical body motions can induce substantially different inertial measurements across garments, yielding heterogeneous, noisy, and temporally drifting observations. In this paper, we introduce CLOTHO, an IMU canonicalization framework for garment-based inertial motion capture. Rather than directly mapping loose-wear IMUs to body pose, CLOTHO reformulates garment-based motion capture as an IMU canonicalization problem: recovering clean, drift-corrected, and spatially complete tight-wear inertial signals from corrupted and incomplete loose-wear observations. To train and evaluate CLOTHO, we collect the largest garment-based inertial motion capture dataset to date, comprising 12.5M IMU frames, approximately 116 hours of recordings, and five garment designs with diverse materials, layouts, IMU counts, and sensing hardware. Extensive experiments show that a single fixed CLOTHO model achieves state-of-the-art accuracy, zero-shot generalization to unseen garments, and improved robustness during long-term tracking. We also find that CLOTHO demonstrates superior scaling behavior, enabling practical deployment across diverse everyday garments. We will open-source all our software codes, model weights, hardware designs, and datasets to facilitate future research.

02 / Method

Canonicalize first,
then reconstruct.

CLOTHO pipeline: Masked IMU Encoder and Latent-Conditioned IMU Canonicalizer
Given sparse and noisy loose-wear IMU observations, CLOTHO first canonicalizes them into a clean, drift-corrected, and spatially complete 10-IMU representation. The Masked IMU Encoder extracts a configuration-invariant latent representation from partial observations, and the Latent-Conditioned IMU Canonicalizer predicts residual corrections to recover canonical IMU sequences. A downstream motion reconstruction then reconstructs full-body motion from the recovered canonical IMU sequences.

03 / Hardware

Five garments,
one sensing family.

Fabrication-and-sensing pipelines and garment configurations
Fabrication-and-sensing pipelines and garment configurations. (a) The Pattern-Integrated Sensing Pipeline. (b) The Pocket-Mounted Add-on Pipeline. (c) Garment configurations used in our datasets. Green-10, Taichi-10, and White-10 use 10 low-cost BNO085 IMUs, with an approximate cost of US$19 per IMU; Purple-6 uses 6 Xsens MTi-3 IMUs, with an approximate cost of US$230 per IMU; T-Shirt-4 uses 4 Noitom PN3 sensors.

04 / Results

One model,
across garments and time.

A single CLOTHO model reaches the lowest positional error on every test garment, cutting Pos Error by 42% relative to FIP and LIP, including garments and IMU counts it never saw in that configuration.

Cross-garment generalization and long-term robustness of CLOTHO
CLOTHO tracks full-body motion from loose garments with different fabrics and IMU counts, and remains stable over long recordings where drift-sensitive baselines diverge.

Qualitative

Qualitative
comparison.

GT

Ground truth

Prediction

CLOTHO

Loading motion…

Drag to orbit · Scroll to zoom · Right-drag to pan

Long-term

Eight hours,
without drift.

Scaling

Scaling
behaviors.

Scaling behavior of CLOTHO with data and model size

Scaling is measured on matched subsets. (a), (b), and (e) report OME on the cross-garment test set; (c) and (d) report Pos Error on Green-10.

Data type. 7.07 h of paired labels lowers OME from 16.05° to 13.78°. Unlabeled IMUs scale to 101.1 h and have not saturated. The two are complementary.

Real versus synthetic. Real LIP and FIP stay ahead of their synthetic versions. 0.55 h of real pairs beats 7 h of synthetic garment data.

Formulation. Fitting ε(m) = A m−α, LIP* scales at α = 0.09, GlobalPose* at 0.15, and CLOTHO at 0.23, because canonicalization and pose reconstruction are separated.

Model size. From 10.1M to 92.0M parameters, OME drops only 1.02°. The limit is data, not capacity.

Related research