dotLumen self-driving glasses for the blind with Nvidia AI, LiDAR, haptics, stereo vision edge

Описание: Dot Lumen, a company based in Cluj-Napoca, Romania, is developing a new class of assistive technology for the blind: wearable guidance glasses powered by the same AI and computer vision technologies found in self-driving cars. Founded by Cornel Amariei, who grew up in a family with disabilities, the initiative aims to fill a major gap in accessibility tools. Despite 300 million visually impaired people worldwide, most still rely on the same two options used for centuries: the white cane and guide dogs. However, guide dogs are scarce and costly to train—up to $200,000 per dog—so Dot Lumen proposes a scalable and affordable alternative. Learn more at https://www.dotlumen.com

The device operates as a “self-driving car for the pedestrian world,” using a vision system with six cameras, LiDAR sensors, and infrared depth sensing to map and understand the surroundings. These sensors, arranged in stereo pairs, feed data to an onboard Nvidia-powered computing module. This compact unit runs advanced visual perception algorithms entirely offline, without requiring cloud connectivity. As such, the device maintains privacy and ensures uninterrupted operation in any environment.

Dot Lumen glasses emulate the guidance behavior of a trained guide dog. Instead of verbal or tactile warnings about obstacles, the system physically steers the user’s head using an array of haptic feedback motors. These motors gently guide the user away from obstacles or along a clear path, replicating how a guide dog pulls its user’s hand. Unlike audio-based aids, this head-mounted haptic interface avoids cluttering the user’s auditory space, which is vital for the blind to interpret their environment.

Audio feedback is used sparingly and only to deliver necessary contextual cues—such as indicating stairs or curbs. Additionally, audio tutorials are integrated to teach the user how to operate the glasses. This hybrid approach ensures both intuitive operation and minimal sensory overload, unlike previous experimental assistive devices that overwhelmed users with excessive information delivered through unconventional channels like the tongue or chest.

In terms of user experience, more than 500 blind individuals have tested prototypes extensively, with the system being praised for its real-world effectiveness. One test user remarked they didn’t expect such technology to be possible within their lifetime. The head was ultimately chosen as the best point of contact for haptic guidance after extensive testing on various parts of the body, reinforcing the intuitive nature of head-centered spatial orientation.

The glasses also support basic integration with smartphones. For example, users can select a destination on Google Maps and share it directly to the glasses, which then autonomously guide them to the location. This functionality leverages standard accessibility tools on the phone but shifts all mobility control to the wearable once navigation begins, ensuring smooth and independent movement for the user.

Designed with mass-market affordability in mind, the first-generation model is positioned as a reimbursable medical device. In countries like Romania, it will be available at no cost for qualifying individuals. Dot Lumen plans to release this initial version within three months, with ongoing development aiming to further miniaturize the device and reach hundreds of thousands of users with future iterations.

Artificial intelligence plays a central role in the system’s operation, combining traditional computer vision methods with modern AI models for robust navigation and situational understanding. While the device is edge-based, it incorporates federated learning principles by sharing data between units to improve collective behavior over time. However, specific details of this data-sharing mechanism remain confidential due to the sensitive nature of assistive safety technologies.

My full AI For Good 2025 video coverage is here:    • AI For Good 2025 video coverage  

This video was filmed using the DJI Pocket 3 ($669 at https://amzn.to/4aMpKIC using the dual wireless DJI Mic 2 microphones with the DJI lapel microphone https://amzn.to/3XIj3l8 ), watch all my DJI Pocket 3 videos here    • Filmed with DJI Pocket 3  

Join https://www.youtube.com/charbax/join for Early Access to my videos and to support my work, or you can Click the "Super Thanks" button below the video to send a highlighted comment under the video! Brands I film are welcome to support my work in this way 😁

Check out my video with Daylight Computer about their revolutionary Sunlight Readable Transflective LCD Display for Healthy Learning:    • Daylight Computer CEO interview: Healthy C...