Skip to content
Article

As AI fears rise, a composer puts it on stage at Symphony Hall

ILLUSTRATION BY LUIS G. RENDON/GLOBE STAFF; ADOBE 

By A.Z. Madonna

In a new classical work premiering Thursday with the Boston Symphony Orchestra, an AI system listens to the players and adds improvised music of its own.

Tod Machover gets why so many Americans see artificial intelligence as an existential threat.And yet the composer and faculty director of the Media Lab at MIT is installing it in the last place that would seem to want or need it: on stage at Symphony Hall, playing alongside some of the most accomplished classical musicians in the world.

In his composition “already and not yet,” premiering Thursday with the Boston Symphony Orchestra, an AI system will improvise and add its own music as the players perform. Under the baton of Kent Nagano, the piece will be performed through Saturday and comes amid the orchestra’s week of “Technology and Our Humanity” themed programming.

And even Machover cannot predict exactly the music it will play.

But he wants to be clear: He is not out to show that human musicians can be replaced by machines. To the contrary, he says, he wants to demonstrate that the technology so many rightly fear “can be musical, shaped by and for people.”

The AI system that will play during the performance uses microphones to listen to individual musicians and orchestral sections,and then elaborate on that with its own sound that will be broadcast over a bank of surround-sound speakers.

“If no audio gets in, no audio gets out,” said MIT Media Lab PhD researcher Manaswi Mishra, who designed the system.

“You can shape how close what comes out is to what comes in,” said Machover. “We designed this system to make variations on the sound that’s coming in, or make connections between different parts of the sound that comes in.”

Still, there is an element of unpredictability.Machover knows the “kind of thing” it’s going to do, “but it’s going to do it differently every single time.”

Mishra will be on stage controlling the AI during the performances, while graduate student Ana Schon will mix the sound in the hall. 

Machover, Mishra, and Schon demonstrated the “already and not yet” system at Symphony Hall last week, inviting BSO musicians to play with it. The moment was somewhat anxiety-inducing for the composer.

“Even saying the word AI now, and saying it to musicians — it’s understandably scary,” Machover said. But the BSO players were “open and inquisitive.”

As a composer, Machover continues to be inspired by the possibilities and innovations AI might offer. But in his daily life, he uses almost no AI tools. He doesn’t interact with chatbots, and he manages his own calendar manually.

“For a lot of things I do, I think every detail matters, and I don’t particularly like to automate most of it,” said Machover, who has never owned a car with an automatic transmission.

And he keeps close a belief that his mother, a piano teacher, instilled in him as a child. During group lessons, she would direct him and the other children to find objects around the house, then ask them what sounds they could make.

Related Content