[3Yin-A] Poster 5

[3Yin-A-38] A VR-Based Multimodal Interaction System for Studying Non-Verbal Communication Among International Students to Reduce the Illusion of Transparency

〇Mehedi Hassan Rico¹, Yoshimasa Ohmoto¹ (1. Shizuoka University)

Keywords:

Virtual Reality,Human-computer interaction,Intelligent interface,Intelligent learning aid,Communication aid

This paper presents a work-in-progress study of the design and implementation of a virtual reality (VR) based intelligent system to investigate non-verbal communication in interactive social scenarios. The objective is to examine international students from diverse cultural backgrounds and how their differences of dialogue intent, timing and actions combinedly affect the observed communication appropriateness especially when mismatches between the internal intention and external expression lead to illusion of transparency.The proposed system places participants in immersive VR scenarios where they interact with non-player characters using multimodal inputs synchronized into a single interaction event. The interaction events are evaluated using a rule-based logic combinedly. Physiological signals such as heart rate variability are recorded and aligned with interaction events to understand the mismatch of internal intentions and external expressions.Future work will use this framework to investigate if VR interaction and biofeedback can help reduce illusion-of-transparency effects and improve cross-cultural communication accuracy. The expected outcome is a flexible platform for studying multimodal social interaction in VR that allows interactions to be more organic and accurate.