https://dl.acm.org/doi/full/10.1145/3800645.3813032

Abstract

Many spatial interaction systems privilege visual representation, leaving other sensory modalities underexplored as design materials. This paper presents an interactive research prototype and its evaluation, examining how sound can support memory evocation, place attachment, and social connection within a virtual representation of a shared space. The prototype combines a navigable three-dimensional environment with location-specific ambient sounds and spoken narratives through a two-stage process. First, participatory workshops were conducted with members of a lab community to collect meaningful sonic memories and associate sounds with the corresponding locations in the virtual environment. Second, the resulting audiovisual prototype was evaluated through a controlled study with two conditions: visual-only interaction and audiovisual interaction. The evaluation combined quantitative measures of the autobiographical memory experience, place attachment, and social connection with qualitative accounts of the user experience. The results show that audiovisual interaction was associated with stronger emotional engagement and perceived connection. Qualitative findings further illustrate how everyday sounds supported a sense of shared presence and continuity across non-overlapping occupants of the same space.