Human Operator is a human augmentation tool that allows AI to briefly take control of your body to help you learn and do things you normally cannot do. To do this, it uses a Vision-Language Model for human motor control through Electrical Muscle Stimulation (EMS). Vision-based commands are generated via open-ended speech input through the Claude API to control finger and wrist stimulation for intuitive on-body interaction.
Check out more details about the project here.
Also please check out related work from our colleague Pedro Lopes' Human-Computer Integration lab here, who has over a decade of work in this area.