Xiao Xiao, Hayoun Noh, Adrien Lefevre, Lucy Li, Holly McKee, Alaa Algargoosh, and Hiroshi Ishii. 2025. ReMirrorFugue: Examining the Emotional Experience of Presence and (Illusory) Communications Across Time. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 1149, 1–26. https://doi.org/10.1145/3

Abstract

This paper examines how strategies for simulating social presence across distance can evoke a sense of presence and facilitate illusory interactions across time. We conducted a mixed-methods study with 28 participants, exploring their emotional experience of interacting with decade-old recorded piano performances on MirrorFugue—a player piano enhanced with life-sized projections of the pianist’s hands and body, creating the illusion of a virtual refection playing the instrument. Data were collected via wearable sensors, questionnaires, and interviews. Results showed that participants felt a strong presence of past pianists, with some experiencing the illusion of two-way communication and an overall increase in connection. The emotional experience was signifcantly infuenced by the participant’s relationship with the recorded pianist and the pianist’s vital status. These fndings suggest that telepresence technologies can foster connections with the past, ofering spaces for memory recall, self-refection, and a sense of “time travel.”