inSight: Deep Neurofeedback

Mostafa Mohsenvand


inSight is a brain decoding system. It uses  generative models (BigGAN and MusicVAE) to stimulate the brain with synthetic, but natural-looking videos and melodies. The brain activity of the user is then recorded using an EEG headset. The recorded data is then processed to train an encoder to interpret the brain activity in terms of the latent space of the generative model, effectively allowing the system to generate video and music from the user's brain activity. inSight can be used for applications such as neurofeedback therapies, creativity, human-human communication and search.