Virtual Triplets: A Mixed Modal Synchronous and Asynchronous Collaboration with Human-Agent Inter...

Описание: Virtual Triplets: A Mixed Modal Synchronous and Asynchronous Collaboration with Human-Agent Inter...
Jingjing Zhang, Binyang Han, Ze Dong, Ruoyu Wen, Gun A. Lee, Simon Hoermann, Wendy Zhang, Thammathip Piumsomboon

CHI 2024: The ACM CHI Conference on Human Factors in Computing Systems
Session: Late-Breaking Work: Immersive Realities

We introduce the Virtual Triplets (VTs), a multi-user Virtual Reality system designed for both synchronous and asynchronous interaction and collaboration between humans and human-agent. A single instructor supervises two students in a showcased virtual cooking class scenario. The system enables the instructor to switch control between avatars in two separate environments, and a virtual agent takes over in the instructor's absence, ensuring continuous support. VTs facilitate the recording and playback of the instructor's demonstrations for students, coupled with a feature that allows the instructor to adopt a top-down view for effective classroom management. Analysis of observational data and interviews from our pilot study indicates good system usability, ease of avatar management for instructors, and a strong sense of continuous support among students. We discuss potential improvements and broader applications of VTs, aiming to enhance user experience in multitasking scenarios involving multiuser human-human and human-agent collaboration.

Web:: https://programs.sigchi.org/chi/2024/...

Video teaser for late-breaking works at CHI 2024