Making Context Work

MIThril, a borglab production. Richard W. DeVaul, Jonathan Gips, Michael Sung, Sandy Pentland

the foundation for context aware applications

In order to build effective context-aware applications, it is necessary to identify, sense, classify, and model the relevant context. Which context is relevant depends on the application, and the selection of sensing techniques, classifiers, and modeling techniques must be done carefully to minimize the demands on computational resources, power consumption, and ergonomic constraints.

Defining Context

not all context is created equal

One of the central problems in building context-aware applications is defining what context is relevant and how can it be sensed/classified/modeled. Without an understanding of how context and application interact nothing else can be done. In addition, some types of context are relatively easy to determine (such as location) and some may be quite hard (such as "talking to my friend Bob").

Sensing Context

measurement: high vs. low bandwidth sensing

The selection of effective sensors and signal processing techniques is a topic worthy of at least two graduate level courses alone. One of the most important decisions is in how to measure the context of interest; can the context be extracted from low-bandwidth sensors using relatively simple techniques, or are more expensive and complex approaches required?

For example, if the context of interest is "talking to Bob," a number of sensing strategies are possible. Cameras and expensive computer vision techniques may be employed, or (if the situation is appropriate) a simple low-bandwidth tag and tag-reader might solve the problem.

Classification and Modeling

translating from signal to understanding

The result of measurement is a signal, and this signal requires interpretation. The method of interpretation depends on the type of signal (low or high bandwidth, the dimensionality of the signal, type and quantity of noise, etc.) and the context of interest. If the sensor is a tag reader, the interpretation may be as simple as a table lookup. In the case of a camera, most contexts of interest (such as "talking to Bob") will require expensive and sophisticated computer vision techniques.

  Back Up Next  
Context Awareness and Applications
Richard W. DeVaul
The second annual "I Wanna Be a Cyborg" event, a borglab production.