Project

Large User Interface with Gesture and Voice Feedback

Google

LUI is a new human-computer interface for interactive media on large screens and AR/VR platforms. It utilizes voice and gestures to naturally control UI elements such as maps, photos, and YouTube. This operating system removes the boundary introduced by remotes and controllers and hopes to be a standard for large screens and heads-up displays in self-driving cars. The user can imagine "opening the hand" to separate the display into multiple windows, or asking Google to pull up your favorite photo or places to eat nearby. 

For more information, contact graduate researcher Vik Parthiban at vparth@mit.edu.

Advisors
V. Michael Bove, Director, Object-Based Media group
John Underkoffler, CEO, Oblong Industries; Scientific advisor, Minority Report and Iron Man interface

LUI is a new human-computer interface for interactive media on large screens and AR/VR platforms. It utilizes voice and gestures to naturally control UI elements such as maps, photos, and YouTube. This operating system removes the boundary introduced by remotes and controllers and hopes to be a standard for large screens and heads-up displays in self-driving cars. The user can imagine "opening the hand" to separate the display into multiple windows, or asking Google to pull up your favorite photo or places to eat nearby. 

For more information, contact graduate researcher Vik Parthiban at vparth@mit.edu.

Advisors
V. Michael Bove, Director, Object-Based Media group
John Underkoffler, CEO, Oblong Industries; Scientific advisor, Minority Report and Iron Man interface