Joseph A. Paradiso, Kai-yuh Hsiao, Ari Y. Benbasat

Abstract

We describe a system that we have developed to capture detailed, multimodal gesture expressed at the foot. It is embodied in a pair of shoes, each of which measures 16 degrees of freedom (tactile, inertial, positional). No tethers or wires are attached to the shoes; data is directly telemetered wirelessly off each foot to a remote base station and host computer, yielding full state updates at 50 Hz. This system, having evolved over 3 years, has been used for real-time expressive performance by a diverse set of artists, including gymnasts, jugglers, and dancers. Ongoing work is exploring the extraction of high-level podiatric gesture