Project

PerForm

Copyright

Caroline Rozendo

Caroline Rozendo

Music is not limited to the world of sound. There exists a music of the visual world.
—Oskar Fischinger, 1951.

Almost 70 years ago, when the German-American animator and film-maker Oskar Fischinger created musically inspired animations and works of art, he touched on the intuitive associations our minds make between all the different sensory stimuli received from the environment.

While the psychology of perception has been widely explored in the context of visual technology, visual-auditory associations remain mostly underexplored in the field. There is strong evidence, though, that our brains forge relationships between shapes and seemingly correspondent sounds.

PerForm explores one possibility of how the associations between visual and auditory perception can be used in interaction design. We developed a physical interface that users can transform by bending to create geometric shapes or symbols. Those shapes can then be played as percussion instruments of different sound frequencies, directly related to the shape created.

This deformable interface is responsive to shaking, enabling users to manipulate it as a percus… View full description

Music is not limited to the world of sound. There exists a music of the visual world.
—Oskar Fischinger, 1951.

Almost 70 years ago, when the German-American animator and film-maker Oskar Fischinger created musically inspired animations and works of art, he touched on the intuitive associations our minds make between all the different sensory stimuli received from the environment.

While the psychology of perception has been widely explored in the context of visual technology, visual-auditory associations remain mostly underexplored in the field. There is strong evidence, though, that our brains forge relationships between shapes and seemingly correspondent sounds.

PerForm explores one possibility of how the associations between visual and auditory perception can be used in interaction design. We developed a physical interface that users can transform by bending to create geometric shapes or symbols. Those shapes can then be played as percussion instruments of different sound frequencies, directly related to the shape created.

This deformable interface is responsive to shaking, enabling users to manipulate it as a percussion instrument. For the future, we envision the possibility of enabling the creation of more complex shapes, which would enable specific modes of interaction—piano, winds, and metals, for example.