Watch Your Mouth: Silent Speech Recognition with Depth Sensing
Автор: UCLA HiLab
Загружено: 2024-05-07
Просмотров: 410
Описание:
Watch Your Mouth: Silent Speech Recognition with Depth Sensing (CHI 2024)
Xue Wang, Zixiong Su, Jun Rekimoto, Yang Zhang
Silent speech recognition is a promising technology that decodes human speech without requiring audio signals, enabling private human-computer interactions. In this paper, we propose Watch Your Mouth, a novel method that leverages depth sensing to enable accurate silent speech recognition. By leveraging depth information, our method provides unique resilience against environmental factors such as variations in lighting and device orientations, while further addressing privacy concerns by eliminating the need for sensitive RGB data. We started by building a deep-learning model that locates lips using depth data. We then designed a deep learning pipeline to e!ciently learn from point clouds and translate lip movements into commands and sentences. We evaluated our technique and found it e"ective across diverse sensor locations: On-Head, On-Wrist, and In-Environment. Watch Your Mouth outperformed the state-of-the-art RGB-based method, demonstrating its potential as an accurate and reliable input technique.
Please see our paper here: https://hilab.dev/research/WatchYourM...
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
![Обработка речи и звука в неинвазивных интерфейсах «мозг-компьютер» в компании Meta [Майкл Мандель]](https://image.4k-video.ru/id-video/AFEJh4Qec2c)
![[2026] Feeling Good Mix - English Deep House, Vocal House, Nu Disco | Emotional / Intimate Mood](https://image.4k-video.ru/id-video/cxLdtvzf2sI)
