PerForm: Deformable Interface for the Exploration of Sound through Shapes

Wicaksono, I., Rozendo, C., Ye, R., Trapp, J., Bove Jr., M. V., Dagdeviren, C., Ishii, H., Proceedings of ACM CHI Conference on Human Factors in Computing Systems, Montreal, Canada, 2018.


In this paper, we describe a novel electronic musical interface, consisting of a strand-like object that can be physically transformed by bending to create various shapes and signifiers. Users are encouraged to explore a visual language in a musical context, as each new shape portrays a different musical instrument with unique sonic behavior. We apply concepts from research in the area of cross-modal perception as guidance for mapping shapes and signifiers to corresponding sounds. 

Related Content