Proceedings of the International Display Workshops Volume 31 (IDW '24)

Proceedings of the International Display Workshops Volume 31 (IDW '24)

Dec 4 - Dec 6, 2024Sapporo Convention Center
The International Display Workshops
Proceedings of the International Display Workshops Volume 31 (IDW '24)

Proceedings of the International Display Workshops Volume 31 (IDW '24)

Dec 4 - Dec 6, 2024Sapporo Convention Center

[MVS4-2(Invited)]REXR: Realistic and Expressive 3D Avatar for Immersive Telepresence

*Hiroshi Ando1, Michal Joachimczak1, Juan Liu1(1. National Institute of Information and Communications Technology (Japan))
https://doi.org/10.36463/idw.2024.1655

Keywords:

realistic 3D avatar,immersive telepresence,facial expressions and gestures

We propose REXR (Realistic and EXpressive 3D avataR) technology, which leverages AI-based methods to create a photo-realistic 3D avatar of a person from 2D webcam images and reproduce his/her subtle facial expressions and gestures through the 3D avatar in real time, enabling 3D immersive experiences of telecommunication.