김기락, 연희연, 은태영, 정문열.(2022).감정에 기반한 가상인간의 대화 및 표정 실시간 생성 시스템 구현.컴퓨터그래픽스학회논문지,28(3),23-29.
Kim Kirak, Yeon Heeyeon, Eun Taeyoung, Jung Moonryul. Emotion-based Real-time Facial Expression Matching Dialogue System for Virtual Human. J Korea Comput Graph Soc 2022;28(3):23-29.
Abstract
Virtual humans are implemented with dedicated modeling tools like Unity 3D Engine in virtual space (virtual reality, mixed reality, metaverse, etc.). Various human modeling tools have been introduced to implement virtual human-like appearance, voice, expression, and behavior similar to real people, and virtual humans implemented via these tools can communicate with users to some extent. However, most of the virtual humans so far have stayed unimodal using only text or speech. As AI technologies advance, the outdated machine-centered dialogue system is now changing toa human-centered, natural multi-modal system. By using several pre-trained networks, we implemented an emotion-based multi-modal dialogue system, which generates human-like utterances and displays appropriate facial expressions in real-time.
