Copyright
Brian Mayton
I am developing a computational framework that acts as a real-time front end analysis system to a musical synthetic performer that ...
TransparenSea is an AI system that uses video from tuna longline vessels as input to identify dangerous fishing practices while at sea.Co...
Lighting conditions in an indoor environment have been shown to affect our cognition and behaviors in a variety of ways. On average, we s...
New generative AI technologies (such as the Generative Adversarial Network, or GAN) can allow us to imagine new species. Hidden within th...
Sound and space are fundamentally intertwined, at both a physical and perceptual level. Sound radiates from vibrating materials, fillin...
Digital machine knitting is a highly programmable manufacturing process that has been utilized to produce apparel, accessories, and footw...
ListenTree is an audio-haptic display embedded in the natural environment. Visitors to our installation notice a faint sound emerging fro...
Rotational musical instrument interfaces are a very intuitive representation of the fundamentals of music itself, as they are in...
A transhumanist project towards co-evolution, rooted in desireI want to become a cephalopod is a trans-humanist proposal for using ...
YOUR URGE TO BREATHE IS A LIE (a direct quote from my free-diving instructor) is a progressive approach towards innovation, human respons...
¡ONWARDS + UNDER! proposes that as sea levels rise, particularly in highly populated coastal cities, the current plan to keep nature at b...
SoundFORMS creates a new method for composers of electronic music to interact with their compositions. Through the use of a&nbs...
We introduce a family of fragile electronic musical instruments designed to be “played” through the act of destruction. Each Fragile Inst...
Can tattoos embrace technology in order to make the skin interactive?The DermalAbyss project was the result of a collaboration between MI...
KickSoul is a wearable device that maps natural foot movements into inputs for digital devices. It consists of an insole with embedded se...
Skrin is an exploration project on digitalized body skin surface using embedded electronics and prosthetics. Human skin is a means for pr...
Fluxa is a compact wearable device that exploits body movements, as well as the visual effects of persistence of vision (POV), to generat...
MMODM is an online drum machine based on the Twitter streaming API, using tweets from around the world to create and perform musical sequ...
As part of the Living Observatory ecological sensing initiative, we've been developing new approaches to mobile, wearable sensor data vis...
GroupLoop is a browser-based, collaborative audio feedback control system for musical performance. Upon logging in, GroupLoop users send ...
We are exploring the work piece as an interface to digital fabrication and digital modeling. Possible advantages include a more intuitive...
Touch sensing has become established for a range of devices and systems both commercially and in academia. In particular, multi-touch sce...
The virtual messenger system acts as a portal to subtly communicate messages and pass information between the digital, virtual, and physi...
Gestures Everywhere is a multimodal framework for supporting ubiquitous computing. Our framework aggregates the real-time data from a wid...
In a series of psychometric experiments, we tested subjects' perception of lighting in a virtual environment to assess the possibility of...
We developed a music control surface which enables integration between any musical instruments via a versatile, customizable, and inexpen...
At present, luminous efficacy and cost remain the greatest barriers to broad adoption of LED lighting. However, it is anticipated that wi...
Aerial imaging and sensor nodes each present a unique view point into the world. Using Unmanned Aerial Vehicles (UAVs) to navigate the sa...
Current sports-medicine practices for understanding the motion of athletes while engaged in their sport of choice are limited to camera-b...
We propose cutting as a novel paradigm for ad hoc customization of printed electronic components. As a first example we created a printed...
The FreeD is a hand-held, digitally controlled milling device that is guided and monitored by a computer while still preserving the craft...
In DoppelLab, we are developing tools that intuitively and scalably represent the rich, multimodal sensor data produced by a building and...
This project is a system of compact, wearable, wireless sensor nodes, equipped with full six-degree-of-freedom inertial measurement units...
In the Living Observatory installation at the Other Festival, we invite participants into a transductive encounter with a wetland environ...
Our glass building lets us see across spaces�through the walls that enclose us and beyond. Yet invisibly, networks of sensors inside and ...
Over the last decade, tracking people has attracted considerable research interest. Cameras enable efficient tracking of people but it is...
The tongue has extremely dense sensing resolution, as well as an extraordinary degree of neuroplasticity�the ability to adapt to and inte...
Rapidnition is a new way of thinking about gesturally controlled interfaces. Rather than forcing users to adapt their behavior to a pred...
Funk2 is a novel process-description language that keeps track of everything that it does. Remembering these causal execution traces allo...
Using machine learning, computer vision, and wrist-worn, smaller, time-of-flight cameras, we can recover hand pose and micro-gesture (sma...
The SEC is an extension to the free open-source program EyesWeb�that contains a large number of machine learning and signal processing al...
We demonstrate the design and implementation of a new versatile, scalable, and cost-effective sensate surface. The system is based on a n...
Expressive musical re-performance is about enabling a person to experience the creative aspects of a playing a favorite song regardless o...
How can traditional values be embedded into a digital object? We explore this concept by implementing a special guitar that combines phys...
Increasing numbers of networked appliances are bringing about new opportunities for control and automation. At the same time, an increase...
We are developing an opt-in camera network, in which users carrying wearable tags are visible to the network and everyone else is invisib...
How do we leverage people to make systems more intelligent, efficient, and successful? Is it worthwhile to involve people heavily in the ...
We are working with sponsor Schneider Electric to deploy a dense, low-power wireless sensor network aimed at environmental monitoring for...
Digito is a gesturally controlled virtual musical instrument, controlled through a number of intricate hand gestures which provide both d...
We are developing a system for inferring safety context on construction sites by fusing data from wearable devices, distributed sensing i...
We have turned our building into a living laboratory by distributing 45 Ubiquitous Media Portals throughout our facility. These sensor-ri...
While many wearable sensors have been developed, few are actually worn by people on a regular basis. WristQue is a wristband sensor that ...
This project addresses human cognitive models of reflective problem solving in terms of psychology, neuroscience, and artificial intellig...
The Dual Reality Lab is an experiment aimed at an interface between distributed sensor networks (which collect information about the real...
The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, c++ machine-learning library that has been specifically designed ...
This project takes advantage of our group's Ubiquitous Media Portals platform, which enables a large suite of research around the broad t...
The Sensor Network Application Retasking Framework (or SNARF) is a collection of tools for embedding a variant of the Python programming ...
This project explores the wide-scale distribution of low-power, low-cost sensor nodes that can measure temperature, humidity, light level...
This is a suite of devices and protocols to support applications in wearable human/social sensing linked to a distributed camera and visi...
Spinner is a Lab-wide sensor network platform designed to detect and capture fragmented events of human behavior that can be collected an...
This project presents a new approach for the design and fabrication of the acoustic instrument, using digital fabrication technologies, a...
Tricorder Net is a handheld sensor-network interface inspired by Star Trek's tricorder, a device that provided Science Officer Spock with...
This project focuses on the development of a low-cost system to track the precise 3-D position of large numbers of objects tagged with pa...
We have built a configurable infrastructure to protect users' dynamic levels of�privacy in a pervasive sensor network. Our system is base...
We have developed an extremely low-power and low-cost wireless sensor network aimed at applications in asset tracking and ubiquitous acti...
This project demonstrates how sensor networks can couple the real world with virtual worlds. A complete sensor network system (hardware a...
Wireless sensor systems are currently being deployed in a wide variety of lightweight mobile applications such as detecting degenerative ...
The ubiquitous sensor network and media explorer integrates sound, images, and diverse data sampled throughout the Media Lab into a visua...
We have developed a simple modular platform for wireless sensing. This system allows for easy prototyping and testing of embedded sensor ...
The UbER-Badge is a small, wearable-computing platform for experimentation with distributed systems, and the analysis and enhancement of ...
Most sensory data has limited utility without location information, and manual node localization becomes impossible for large, inaccessab...
We can use sensor networks as a way of building a comprehensive picture of a physical space to transmit a sense of that space into a virt...
We have developed tightly coupled sensor network that tries to mimic some of the sensory characteristics of a natural skin. Developed in ...
Distributed sensor networks offer many new capabilities for monitoring environments with applicability to medical, industrial, military, ...
Although RFID technology is well established, there are some niches where RFID doesn't perform well (in the presence of metallic objects,...
This research focuses on developing a smart material capable of sensing, distilling, and interpreting environmental stimuli while offerin...
Miniature sensors are so sophisticated that a wristwatch-mounted inertial measurement system can differentiate subtle actions such as sha...
We have built a compact piezoelectric push button and associated minimal circuitry that is able to transmit a digital RFID code to the im...
The Pushpin Computing project demonstrates several concepts in distributed, embedded, and ubiquitous computing and dense sensor networks....
Roboverse is a physical artificial intelligence simulation. The environment supports rigid body physical simulation of wheeled and legged...
A prime goal of ubiquitous computing is the embedding of sensing, communication, and computation into everyday objects. One consequence o...
We are investigating a novel pixellated vibrotactile device based on the hardware and software infrastructure developed in previous MLE-U...
The massive sensor network assumed by most advanced scenarios of ubiquitous computing must first be innocously deployed in devices used f...
This project aims to create an electronic controller with many different sensor affordances that adapts to the gestural preferences of th...
Touch screen systems allow users to interact directly with content displayed on a 2-D surface. However, current systems have severe limit...
Pushpin Computing is a research platform for exploring sensing techniques and algorithms on a dense sensor network of one hundred nodes d...
The Nanogate is a micro electromechanical systems (MEMS) device capable of accurately and repeatedly controlling a nanometer gap between ...
We are developing a wireless system of devices to monitor the condition of patients with chronic diseases. The patient will use these dev...
Motion and gait analyses have a number of applications in the medical field. For example, change in gait over extended time is used in ne...
The Tribble project demonstrates the application of dense, distributed sensor networks to electronic skins. The Tribble is a one-foot dia...
We are developing a set of very low-cost, wireless, wearable sensors that enable a large group of people (e.g., hundreds or thousands) to...
The Media Matrix project draws on ideas from distributed, embedded, and parallel computing in order to address the creation and managemen...
This project pushes our work on the miniaturization of low-power radios and sensors for embedded intelligence into very small form factor...
Building on our Expressive Footwear project, we have constructed a low-cost, compact, wireless inertial measurement unit, featuring three...
We are building a prototype infrastructure for real-time collection and distribution of comprehensive information about road traffic and ...
This project explores the application of new commercial RF chipsets and research devices being developed at the MIT Microelectronics Labo...
This project is developing a very novel noncontact microwave sensor system that detects the presence and activity of participants in fron...
A very simple and inexpensive scanning laser rangefinder system has been developed for use as a precise gestural interface in front of a ...
This effort has resulted in a compact, wireless, low-power sensor card that transmits 8 analog sensor channels (4 are conditioned for pre...
Current 3-D laser scanning systems require a lengthy interval to complete each scan and require a clear line-of-sight, thereby severing t...
This project explores different applications for tapered-aperture audio transducers, where incoming acoustic wavefronts correlate with sp...
This project explores the use of passive acoustic sensing in automobiles. We are building acoustic sensing equimpment suitable for automo...
As the power requirements for microelectronics continue decreasing, environmental energy sources can begin to replace batteries in certai...
The Atmosphere installation presents a large cloud of information on a wide presentation screen that can be manipulated by three handheld...