Build an AI Onboarding Assistant with Anam Avatar, LiveKit & Gemini Live

Описание: 🤖 Demo: AI-Powered Employee Onboarding with Anam Avatar + LiveKit
Watch an AI avatar named Maya guide a user through an employee onboarding form — filling fields, clicking buttons, and reading the screen in real-time using just voice commands.
What's Happening Under the Hood:
Anam Avatar renders a lifelike AI assistant with synchronized lip movements
Gemini Live handles multimodal input (audio + screen share) and tool calling
LiveKit powers real-time communication between all components
Next.js frontend displays the form and receives browser control commands

Architecture:
User Audio + Screen Share → Gemini Live (LLM + Vision) ↓ Tool Calls (fill_form_field, click_element) ↓ Anam Avatar (TTS + Video) ↓ LiveKit → Next.js Client

Features Demonstrated:
✅ Voice-driven form filling
✅ Screen share analysis (AI can see the form)
✅ Real-time avatar with natural speech
✅ Browser control via data channels
✅ Multi-step form navigation

Note:
Gemini Live's function calling can occasionally require nudging for complex async operations, but works well for straightforward use cases.
Links:
🔗 GitHub Repo: https://github.com/anam-org/anam-live...
🔗 Anam AI: https://anam.ai
🔗 LiveKit: https://livekit.io
🔗 LiveKit Agents Docs: https://docs.livekit.io/agents

Tech Stack:
Python (LiveKit Agents SDK)
Next.js / React / TypeScript
Anam Avatar Plugin
Google Gemini Live (gemini-2.0-flash-exp)
LiveKit Cloud

#AI #Avatar #LiveKit #GeminiLive #VoiceAI #Onboarding #AnamAI #NextJS #Python #RealtimeAI