Project

LipSync

Groups

LipSync is an interactive broadcast of famous monologues available in many different languages to multiple users at the same time. Users direct their smartphones to "tune in" to their desired language, either audio or closed captioning, by simply pointing them at the relevant part of the screen. This allows intuitive selection of the speaker and language preference. The precise synchronization between the video and the audio streams creates a seamless experience, where the user's natural motions give voice to moving lips. Multiple people can listen to different audio streams associated with the video toward which the mobile phone camera is pointed. This demonstrates with two technologies developed in the Viral Spaces group: CoSync and VRCodes.

LipSync is an interactive broadcast of famous monologues available in many different languages to multiple users at the same time. Users direct their smartphones to "tune in" to their desired language, either audio or closed captioning, by simply pointing them at the relevant part of the screen. This allows intuitive selection of the speaker and language preference. The precise synchronization between the video and the audio streams creates a seamless experience, where the user's natural motions give voice to moving lips. Multiple people can listen to different audio streams associated with the video toward which the mobile phone camera is pointed. This demonstrates with two technologies developed in the Viral Spaces group: CoSync and VRCodes.