VASA-Rig: Audio-Driven 3D Facial Animation with 'Live' Mood Dynamics i...
Автор: IEEE Virtual Reality Conference
Загружено: 2025-04-28
Просмотров: 235
Описание:
📅 Session: Teleoperation and telepresence
📖 Title: VASA-Rig: Audio-Driven 3D Facial Animation with 'Live' Mood Dynamics in Virtual Reality
👨🏫 Authors: Ye Pan: Shanghai Jiaotong University , Chang Liu: Shanghai Jiao Tong University, Sicheng Xu: Microsoft Research Asia, Shuai Tan: Shanghai Jiao Tong University, Jiaolong Yang: Microsoft Research Asia
📜 Abstract:
Audio-driven 3D facial animation is key to enhancing realism and interactivity in the metaverse. While existing methods excel at 2D talking head videos, they lack adaptability to 3D environments. We present VASA-Rig, which advances lip-audio synchronization, facial dynamics, and head movements. Using a novel rig parameter-based emotional talking face dataset, our Latents2Rig model transforms 2D facial animations into 3D. Unlike mesh-based models, VASA-Rig outputs 174 Metahuman rig parameters, ensuring compatibility with industry-standard pipelines. Experiments show that VASA-Rig surpasses state-of-the-art methods in realism and accuracy, offering a robust solution for 3D animation in interactive virtual environments.
https://ieeevr.org/2025/
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
