EMPLOYING TEXTUAL AND FACIAL EMOTION RECOGNITION TO DESIGN AN AFFECTIVE TUTORING SYSTEM

ABSTRACT

Emotional expression in Artificial Intelligence has gained lots of attention in recent years, people applied its affective computing not only in enhancing and realizing the interaction between computers and human, it also makes computer more humane. In this study, emotional expressions were applied into intelligent tutoring system, where learners’ emotional expression in learning process was observed in order to give an appropriate feedback. Emotional intelligent not only gives high flexibility to the interaction of tutoring system, it also to deepen its level of human interaction.

This study uses dual-mode operation: facial expression recognition, and text semantics as the main elements in affective computing to understand users’ emotions. Text semantics are used to understand learner’s learning status, and the results would contribute to course management agents in order to choose the most appropriate teaching strategies and feedback to the users. Facial expression recognition allows interactive agents to provide users a complete sound and animation feedback..