I'm Building a Smart Speaker w/ the OpenAI Realtime API

Описание: #openai #alexa #maker
I'm designing my own version of a smart speaker, like the Amazon Echo or Google Home, based on OpenAI's Realtime API. Can we build an open-source ambient computer that is more conversational than Alexa?

This is the first video in the series, which walks through the problems with existing smart speakers and demonstrates how the OpenAI Realtime API works. Please subscribe to follow this project!

LINKS
I may make a small commission if you clicked on a link marked as an affiliate link

• Steven Bennett's DIYson Project:    • Open Task Light Build Logs  
• OpenAI Realtime API Playground (must add credits): https://platform.openai.com/playgroun...
• OpenAI Realtime API Docs: https://platform.openai.com/docs/guid...
• Raspberry Pi 5 (*Affiliate link): https://amzn.to/3CtD3kz
• 128GB SD Card (*Affiliate link): https://amzn.to/3YYCVCJ
• Adafruit Voice Bonnet: https://www.adafruit.com/product/4757
• 3 Watt Speaker: https://www.adafruit.com/product/3351

TIMESTAMPS

00:00 Project Intro
03:09 Problems with Smart Speakers
07:01 Realtime API Demo
13:04 Speech-to-Speech vs. the Traditional Approach
20:40 Function Calling
22:38 Function Calling Demo
28:10 Realtime API Downsides
30:02 Hardware Considerations
33:52 Like and Subscribe