講演情報

[P3-21]不一致なco-speech gestureは発話に明示されない時点情報を補うのか?

*小林 春美1、浅野 知仁1、安田 哲也2 (1. 東京電機大学、2. 山口大学)

キーワード:

ジェスチャー、発話随伴ジェスチャー

This study examined whether incongruent co-speech gestures help listeners infer time-related information that is not explicitly expressed in speech. Twenty Japanese adults viewed short videos in which speech and gesture were either congruent or incongruent, while speech referred to either the present or the future. After each video, participants judged what the speaker wanted “now” and “next” from multiple alternatives. We predicted that, in incongruent trials, listeners would rely on speech for the time point explicitly mentioned in speech, but would use gesture to infer information about the unmentioned time point. The results supported this prediction: when speech and gesture were incongruent, participants tended to interpret the time point not explicitly expressed in speech on the basis of gesture. In contrast, when speech and gesture were congruent, speech-based interpretations remained dominant. These findings suggest that incongruent co-speech gestures can supplement temporally unexpressed information in utterance comprehension.