Project

PerForm

Copyright

Caroline Rozendo

Caroline Rozendo

Groups

PerForm explores the intuitive meanings associated with the shape of objects, and how a shape-changing tool can allow for different forms of tangible interaction. Is it possible to map how ideas feel, and use the connections between senses to create more intuitive interfaces? PerForm addresses that question by allowing users to transform a physical tool to fit their intentions. This way, a user can play different musical instruments or take different actions in games, simply by varying the shape of the tool. Since the meanings associated with the shapes would be dependent on context, we are giving special focus to studying possible mappings of between the perception of sound and shape.

SOUND-SHAPE CORRESPONDENCES

Music is not limited to the world of sound. There exists a music of the visual world.

—Oskar Fischinger, 1951.

When the German-American animator and filmmaker Oskar Fischinger created musically inspired animations and works of art, he touched on the intuitive associations our minds make between all the different sensory stimuli received from the environment. There is strong evidence that our… View full description

PerForm explores the intuitive meanings associated with the shape of objects, and how a shape-changing tool can allow for different forms of tangible interaction. Is it possible to map how ideas feel, and use the connections between senses to create more intuitive interfaces? PerForm addresses that question by allowing users to transform a physical tool to fit their intentions. This way, a user can play different musical instruments or take different actions in games, simply by varying the shape of the tool. Since the meanings associated with the shapes would be dependent on context, we are giving special focus to studying possible mappings of between the perception of sound and shape.

SOUND-SHAPE CORRESPONDENCES

Music is not limited to the world of sound. There exists a music of the visual world.

—Oskar Fischinger, 1951.

When the German-American animator and filmmaker Oskar Fischinger created musically inspired animations and works of art, he touched on the intuitive associations our minds make between all the different sensory stimuli received from the environment. There is strong evidence that our brains forge relationships between shapes and seemingly corresponding sounds.

PerForm explores how the associations between visual and auditory perception can be used in interaction design. We developed a physical interface that users can transform by bending to create geometric shapes or symbols. By investigating possible correlations, natural or forged, between perceptual components of shape and its correlates in sound, we enable the tool to become a new instrument, with different sound timbre depending on the geometry of the object.

A SHAPE-SHIFTING GAMING CONTROLLER

One of the applications of this shape-shifting device would be to enable different modes of interaction through changes in shape. Instead of having to buy multiple controller devices for each genre of gaming or kind of interaction, or simply using a single, fixed-form controller that limits the embodied experience, a device capable of transformation would enable users to have a more imaginative and creative gaming experience, even enabling new kinds of games in which the user can invent tools by varying shapes.