Finger Talk

Finger Talk is a small experiment Future Sketches has been working on related to gestural computation. What does it mean to have code you can control with your body? For these sketches we built a hand tracking software, using coreML, and experimented with a simple gesture—pinching your fingers. We used openFrameworks to build a series of experiments to explore different ways of navigating information—moving through text, changing the size of a hamburger drawing, scaling and rotating an image, etc. The end goal is simple, playful interactions that help explore how the body and computational systems can interact.