Project

Personalized Interaction for Language Learning

Groups

The process by which children learn native languages is markedly different from the process of learning a second, or non-native, language. Children are typically immersed in their native languages. They receive input from the adults and other children surrounding them, based on immediate need and interaction, during every waking hour.  

Second language learners are exposed to input from the new language in very different ways, most commonly in a classroom setting. The second language learner relies heavily on memory skills with sparse interaction, in contrast to the first language learner that can rely on environmental reinforcement and social interaction to learn words. 

Social robots have the potential to drastically improve on this paradigm, making the second-language learning experience more like the experience of learning a native language by engaging the child in a rich, interactive exposure to the target language, especially aspects not typically covered by traditional technological solutions, such as prosody, fundamental phonetics, common linguistic structures, etc.

Thus, our project explores how to… View full description

The process by which children learn native languages is markedly different from the process of learning a second, or non-native, language. Children are typically immersed in their native languages. They receive input from the adults and other children surrounding them, based on immediate need and interaction, during every waking hour.  

Second language learners are exposed to input from the new language in very different ways, most commonly in a classroom setting. The second language learner relies heavily on memory skills with sparse interaction, in contrast to the first language learner that can rely on environmental reinforcement and social interaction to learn words. 

Social robots have the potential to drastically improve on this paradigm, making the second-language learning experience more like the experience of learning a native language by engaging the child in a rich, interactive exposure to the target language, especially aspects not typically covered by traditional technological solutions, such as prosody, fundamental phonetics, common linguistic structures, etc.

Thus, our project explores how to design child-robot  interactions that encourage child-driven second language learning, that adapt and personalize each child’s learning experience. We incorporate game design and machine learning into the child-robot interaction design. The child and robot will work on some educational games together. Machine learning will be used to model the child's learning states and emotional states, and then inform the robot's decision making during the game play with the child. Thus, the robot's behaviors will be tailored to individual child based on his/her learning styles, personality and learning/emotional states during the game play.