Jehan, T., Schoner, B.

Abstract

A real-time synthesis engine is presented which models and predicts the timbre of acoustic instruments based on perceptual features. The paper describes the modeling sequence including the analysis of natural sounds, the inference step that nds the mapping between control and output parameters, the timbre prediction step, and the sound synthesis. Demonstrations include the timbre synthesis of stringed instruments and the singing voice, as well as the cross-synthesis and timbre morphing between these instruments.