We have become reliant on digital information for communication, commerce, and entertainment. This information needs to be always available, whether stored locally on our computers, on enterprise servers at work, or via third-party services like GMail. Most importantly, we should have choices beyond desktop computers or smartphones to access it. The Information Ecology group explores ways to connect our physical environments with information resources. Through the use of low-cost, ubiquitous technologies such as sensors and consumer electronics, we are creating seamless and pervasive ways to interact with our information—and with each other.
Research Projects
Air Mobs
Andy Lippman, Henry Holtzman and Eyal ToledanoAir Mobs is a community-based P2P cross-operator, cross-device approach for cases where the normal mobile operator network fails to provide service, when no open WiFi Internet is available, or roaming costs are too high. Air Mobs barter air time between mobile phone users to get you the link that you need when you need it. Air Mobs uses proximal radio to locate and establish a link though another device that routes to the Internet. The member that provides the routing link will gain air time credit points that he can later use to get a link though another member when he is out of service. Air Mobs creates synergies between different operator networks that otherwise wouldn't exist. Air Mobs tries to maximize the overall social value of community members and empower users to take ownership on their devices and the networks they use.
ATTN-SPAN
Henry Holtzman and Daniel E. SchultzHow do you get from a TV channel to a rich video archive, how do you get there automatically, and how can you use that content to create augmented media experiences? ATTN-SPAN converts C-SPAN into a series of overlapping video segments that are identified in terms of state, politician, topic, party, action, and legislative item. Those clips are then used to augment and personalize media experiences, providing information layers that have been crafted to fit the context and consumer.
BiDi Screen
Henry Holtzman, Matt Hirsch, Douglas Lanman and Ramesh RaskarThe BiDi Screen is an example of a new type of thin I/O device that possesses the ability both to capture images and display them. Scene depth can be derived from BiDi Screen imagery, allowing for 3D gestural and 2D multi-touch interfaces. This bidirectional screen extends the latest trend in LCD devices, which has seen the incorporation of photo-transistors into every display pixel. Using a novel optical masking technique developed at the Media Lab, the BiDi Screen can capture light field-like quantities, unlocking a wide array of applications from 3D gesture and touch interaction with CE devices, to seamless video communication.
Bird's-Eye-View
Henry Holtzman, Polychronis Ypodimatopoulos and Boris KizelshteynA collage of face pictures provides a bird's-eye-view over the Media Lab community, displayed on a public touch-screen. Contrary to hierarchical directories, this collage provides one-click access to personal information for anyone in the community, lending itself more towards browsing than specific searching. We connect to individual Twitter accounts and mobile phone numbers, allowing the visitor to view a person's status and place a call to them. We also highlight the people that happened to walk by the screen up to five minutes ago by detecting their RFID tags.
Brin.gy: What Brings Us Together
Henry Holtzman, Andy Lippman and Polychronis YpodimatopoulosWe investigate a protocol that allows people to form dynamic groups focused on topics that emerge serendipitously during everyday life and perhaps flower only for a short time. Group examples include people interested in buying the same product, with similar expertise, in the same location, or any intersection of these examples. We termed this the Human Discovery Protocol (HDP). Similar to how computers follow well-established protocols like DNS in order to find other computers that carry desired information, HDP presents an open protocol for people to announce bits of information about themselves, and have them aggregated and returned back in the form of a group of people that match against the user’s specified criteria. We experiment with a web-based implementation (brin.gy) that allows users to join and communicate with groups of people based on their location, profile information, and items they may want to buy or sell.
CAMIT
Henry Holtzman, Greg Elliott, David Carr, and David CranorCAMIT is a web-based front-end to milling machines like the Model-A and for our own in-house $75 milling machine, the Mantis Machine. It allows drag-and-drop "printing" of circuit boards in seconds. It also captures all uploaded designs and allows anyone to optimize, modularize, change, or simply re-print them. CAMIT is a circuit-board design anyone can use.
CommenTV
Jee Yeon Hwang, Pol Pla i Conesa, Henry Holtzman and Marie-José MontpetitCommenTV is a social commenting system for audiovisual content. CommenTV is able to take and display texts, images, and related videos as social comments.
DepthJS
Pattie Maes, Henry Holtzman, Aaron Zinman, Doug Fritz, Greg Elliott and Roy ShilkrotDepthJS is a framework that allows any web page to interact with Microsoft Kinect via Javascript. Navigating the web is only one application of the framework - we envision all sorts of applications that run in the browser, from games to specific utilities for specific sites. Using DepthJS, web developers who specialize in Javascript can work with Kinect without having to learn any special languages or code. We hope this will allow a new set of interactions beyond what was first developed.
Dual-Space Drawing
Jee Yeon Hwang, Henry Holtzman, Mitchel Resnick and Sherry TurkleDual-Space Drawing supports creative drawing and reflective learning experiences using dual layers: a screen display and a transparent display. Dual-Space Drawing users can reflect themselves and embody their ideas while designing scenes and drawing objects.
E-MotionInfo
Jee Yeon Hwang and Henry Holtzmane-MotionInfo enables users to explore the harmonization of their movements, digital information, and responsive objects. e-MotionInfo creates links between motions, digital content, and associated objects to improve upon expressive and natural user interactions.
Ego
Henry Holtzman, Andy Lippman and Polychronis YpodimatopoulosEgo presents an agent-based, user-centered architecture for storing, discovering, and sharing information about an expandable set of applications, such as location, reviews, or buying and selling goods. Users can fluidly create agents that hold information relevant to their intentions. For example, for buying or selling, users could announce a product they are interested in, then the system creates a group of users interested in the same product, allowing direct discovery and analysis. Tradeoffs between factors such as reputation and physical location are considered. We demonstrate an interactive, tabletop visualization of different urban scenarios involving 1,000 agents that discover each other in the context of some personal interest.
Ghosts of the Past
Henry Holtzman, Andy Lippman, Julia Shuhong Ma, Daniel Edward Schultz and Nathaniel AtnafuWhat if you could see what the past looked like from where you are standing? What if you could relive any event that happened at your current location? Rather than just reading about an event, we want to be immersed in it and experience it ourselves. Ghosts of the Past allows you to create, save, and geotag panoramic canopies. Anyone who subsequently visits that space can see what you have seen, joining with you to create time-lapsed socialization. Since each canopy is time-stamped and geotagged, it gives the user an anchor in space while they explore history. Any event, special or mundane, can be captured for anyone in the same location to view. QR codes are posted in building locations with an active canopy.
Home Fabratory
Henry Holtzman and David CarrUsing your personal fabratory, explore a world in which 3D printers cost as little as today's inkjets and are found in every home. We've developed several sub-$100 machines that demonstrate the practicality of this future, and greatly expand the range of items that can be created on your desktop. These new capabilities have far-reaching implications for personalization of products, direct-to-consumer production, and the creation of "information objects."
HR3D: Glasses-Free 3DTV
Douglas Lanman, Matthew Hirsch, Yunhee Kim, and Ramesh RaskarFor 3D displays to be successful, they must be bright enough to compete with 2D displays and not diminish display resolution. To date, stacked-LCD displays have employed parallax barriers, which use pinhole or stripe patterns to provide view-dependent imagery. We show a prototype that adapts the imagery on both layers to multi-view 3D content, increasing brightness while maintaining display resolution. This promises a future of devices with sharp 2D screens and 3D displays with full horizontal and vertical parallax.
If These Walls Could Tweet
Henry Holtzman and Daniel SchultzWhat if a building could sense what was happening inside of it, and tell the world? This project explores the concept of automated micro blogging–automatically generating and triggering short messages about what is going on in a particular context. The current platform is built around a modular sensor network which combines proximity, temperature, light, and sound values to make guesses about an environment and put those guesses to words.
Konbit
Greg Elliott, Aaron Zinman, Henry Holtzman and Pattie MaesKonbit is a service that helps communities rebuild themselves after a crisis by indexing the skillsets of local residents, allowing NGOs to find and employ them. Haitians, their diaspora, and the international community can volunteer their skills via phone, SMS, or Web. Skills can then be searched in real time and location by NGOs such as the American Red Cross and Partners-in-Health. Konbit is language and medium neutral, where Kreyol voice and text messages may be translated into other languages through the Konbit phone, text, or Web interface.
MatchMaker
Li Bian and Henry HoltzmanMatchMaker is an automated collaborative filtering system that recommends friends to people on Facebook by analyzing and matching people's online profiles with the profiles of TV characters. The goal of MatchMaker is to produce friend recommendations with rich contextual information through collaborative filtering in the existing social network. Using relationships in TV programs as a parallel comparison matrix, MatchMaker projects these relationships into reality to help people find friends whose personality and characteristics have been voted to suit them well by their social network. MatchMaker also encourages more TV content viewing by using the social network context and connections to provoke people's curiosity of TV characters whom they have been matched with in their social network.
Meta Meta Project
Henry Holtzman and Daniel E. SchultzThe Meta Meta Project is an open-source movement aimed at accomplishing a simple, powerful goal: take in media, spit back metadata. The system can power any project that needs to be smart with its content. For instance, identifying important themes, building smart associations between chunks, and augmenting content with additional information layers. Using a single standardized API, programmers can submit multiple forms of media (text, image, video, audio), and extract information from that media (keywords, OCR, entities). For more information about the project and the contributors visit http://www.metametaproject.org.
MindRider
Arlene Ducao and Henry HoltzmanMindRider is a helmet that translates electroencephalogram (EEG) feedback into an embedded LED display. For the wearer, green lights indicate a focused, active mental state, while red lights indicate drowsiness, anxiety, and other states not conducive to operating a bike or vehicle. Flashing red lights indicate extreme anxiety (panic). As many people return to cycling as a primary means of transportation, MindRider can support safety by adding visibility and increased awareness to the cyclist/motorist interaction process. In future versions, MindRider may be outfitted with an expanded set of EEG contacts, proximity sensors, non-helmet wearable visualization, and other features that will increase the cyclist's awareness of self and environment. These features may also allow for hands-free control of cycle function. A networked set of MindRiders may be useful for tracking, trauma, and disaster situations.
NeXtream: Social Television
Henry Holtzman, ReeD Martin and Mike ShafranFunctionally, television content delivery has remained largely unchanged since the introduction of television networks. NeXtream explores an experience where the role of the corporate network is replaced by a social network. User interests, communities, and peers are leveraged to determine television content, combining sequences of short videos to create a set of channels customized to each user. This project creates an interface to explore television socially, connecting a user with a community through content, with varying levels of interactivity: from passively consuming a series, to actively crafting one's own television and social experience.
PalimPost
Li Bian, Roy Shilkrot, Pattie Maes and Henry HoltzmanPalimPost is a converged system for storing, searching, and sharing digital and physical world information using sticky notes and mobile devices. PalimPost extracts contextual cues from a user’s physical environment and activities, connects them to the user’s digital world research, and subsequently presents to the user systematically categorized, relevant, and JIT information. Whether a user is writing down a shopping list on a sticky note after surfing the internet at home, or checking out hundreds of products at hand in a physical store, whether a user is preparing a list of dinner ingredients in the kitchen or buying food outside in the market, PalimPost integrates information from different time and location to form a seamlessly connected experiences for the user.
Part.Preview
Henry Holtzman and David CarrPart.Preview adds three-dimensional input and output devices to traditional 3D printers and fabrication machines. These enhanced capabilities enable users to "print preview" 3D objects before actually creating them.
Protocol
Greg Elliott, Hugo Van Vuuren and Henry HoltzmanThe quality of communication, in all its various forms, is heavily dependent on the appropriate medium, timing, and level of trust between parties. Protocol is a tool that helps you, and society at large, understand and share preferences–personal or professional protocol–to communicate more effectively. Protocol is a dynamic and syndicated contact sheet, seen most often as an email signature or status update; it also functions as an independent site. More specifically, we see it as a preference page to share how and where you want to be contacted. Soon you will be able to embed your protocol in your site of choice (hey about.me, flavours.me, linkedin.com and wordpress.com).
Proverbial Wallets
Henry Holtzman, John Kestner, Daniel Leithinger, Danny Bankman, Emily Tow and Jaekyung JungWe have trouble controlling our consumer impulses, and there's a gap between our decisions and the consequences. When we pull a product off the shelf, do we know our bank-account balance, or whether we're over budget for the month? Our existing senses are inadequate to warn us. The Proverbial Wallet fosters a financial sense at the point of purchase by embodying our electronically tracked assets. We provide tactile feedback reflecting account balances, spending goals, and transactions as a visceral aid to responsible decision-making.
Qooqle
Li Bian and Henry HoltzmanQooqle allows people to reshape their interactions with computing and reorganize the world’s information through their casual conversations and habitual gestures. Qooqle combines mobile, cloud, and social media to draw people closer to computing and make computers more invisible. The multi-modal user interface of Qooqle allows people to engage with one another and the information world more naturally.
Queen's New Clothes
Li Bian, Matt Hirsch, Lining Yao, Henry Holtzman and Hiroshi IshiiInspired by the Danish fairy tale "The Emperor's New Clothes" and Lady Gaga’s Orbit dress, we have designed and implemented a costume, The Queen’s New Clothes, which appears plain to the naked eye but exhibits changing patterns on photos taken at different times and locations. The process of making this costume has taken us on a journey of exploring the digital aspect and dual status of fashion, fashion as a dynamically changing and embodied visual communication tool, and the relationship between the fashion trendsetter and the audience.
Soundaround
Henry Holtzman, Ramesh Raskar, Matt Hirsch, Alex Olwal and Thomas A. BaranRecently, multi-view display hardware has made compelling progress in graphics. Soundaround is a multi-viewer interactive audio system, designed to be integrated into unencumbered multi-view display systems, presenting localized audio/video channels with no need for glasses or headphones. Our technical work describes a framework for the design of multi-viewer interactive audio systems that is general and supports optimization of the system for multiple observation planes and room responses.
Tableau
Henry Holtzman and John KestnerRemember when we made a connection by handing someone a photo? Now we fiddle with too many cables, menus, and communication channels, and those individual connections get drowned out. Can we return to physical experiences while retaining the collective intelligence of the network? Tableau is a side table that stores and retrieves memories. It may put friends' photo postcards in the drawer, or post mementos to your online scrapbook. This is an example of task-centric computing, where the interface is distributed across connected physical objects. Apps that run in the cloud can weave available objects into environmental I/O, giving users computing experiences that fit into the flow of life.
Takeover TV
Henry Holtzman, Greg Elliott and David CarrTakeover TV heralds a new era of bar patronage where you and your like-minded friends are in charge of the screens. When you check in at a location, your likes and dislikes automatically influence what is being shown on local displays. If you want more control, start a vote to pick a new show using your beer glass—or your iPhone. Create season-premiere nights for your favorite shows, or work with friends to define the types of shows that play at your local bars. Sick of watching sports? Assemble enough fans of your favorite show at the local pub and take over the TV.
Tastes Like Rain
Henry Holtzman, David Carr and David ZafrillaWhat if the taste of your toothpaste told you the weather? Leave your smart phone weather app in your pocket. Tastes Like Rain dynamically alters the flavor and color of your morning toothpaste to give you today's temperature and weather. No LCD required.
The Glass Infrastructure
Henry Holtzman, Andy Lippman, Matthew Blackshaw, Jon Ferguson, Catherine Havasi, Julia Ma, Daniel Schultz and Polychronis YpodimatopoulosThis project builds a social, place-based information window into the Media Lab using 30 touch-sensitive screens strategically placed throughout the physical complex and at sponsor sites. The idea is get people to talk among themselves about the work that they jointly explore in a public place. We present Lab projects as dynamically connected sets of "charms" that visitors can save, trade, and explore. The GI demonstrates a framework for an open, integrated IT system and shows new uses for it.
ThoughtSort
Henry Holtzman and Robert HemsleySearch engines often return millions of results to a query. Organizing these results is a challenge, particularly for visual imagery. Search engines typically use textual annotations, rather than the visual characteristics of the images to perform the search. ThoughtSort uses gaze detection and inferred points of interest to dynamically adjust the results of a search query. The user implicitly steers the system by showing more visual interest in some results than others. With ThoughtSort, search becomes a more dynamic experience as results self adjust before the user's eyes. This application is part of a framework which aims to provide developers with the necessary tools to create dynamic and considerate content that can adjust to the natural responses of the user.
Truth Goggles
Henry Holtzman and Daniel E. SchultzTruth Goggles attempts to decrease the polarizing effect of perceived media bias by forcing people to question all sources equally by invoking fact -checking services at the point of media consumption. Readers will approach even their most trusted sources with a more critical mentality by viewing content through various "lenses" of truth.
Twitter Weather
Henry Holtzman, John Kestner and Stephanie BianThe vast amounts of user-generated content on the Web produce information overload as frequently as they provide enlightenment. Twitter Weather reduces large quantities of text into meaningful data by gauging its emotional content. This Website visualizes the prevailing mood about top Twitter topics by rendering a weather-report-style display. Comment Weather is its counterpart for article comments, allowing you to gauge sentiment without leaving the page. Supporting Twitter Weather is a user-trained Web service that aggregates and visualizes attitudes on a topic.
Wall Paper
Henry Holtzman and Daniel SchultzHow will life change as our surfaces become dynamic information displays? How will we use space tastefully and what kinds of interactions will be possible? Wall Paper explores the ability to selectively display information based on proximity and user attention, making it possible to delve deeper into information as people interact with the wall. By intelligently switching modes based on user behavior, the wall avoids being the cause of information overload despite the vast amount of information it can provide.