SImracing is better with Commentary

Описание: Sim racing is just better with commentary. Here Alex Snakes and Joyless Palmer are in the commentary booth as it's week 2 of Raceroom's daily races this season.

It's using race data via shared memory to capture racing events such as overtakes and accidents. I then check the race footage to add in a few more human created events, or to help it understand how an overtake happened. For example. Born dives to the inside and makes the overtake. These events are then sent through multiple rounds of automatic AI filtering. These inject analysis events, extra information for the LLM and merge and delete unnecessary events. The app then prepares a file to be sent automatically back to the LLM which creates a text file of the commentary, which is then automatically sent to a TTS ai which produces voice files. The app then splices these together automatically and I have to stick it into an editing program to sync with the race footage.

Right now it's mostly automatic. The only work I have to do is to help it understand a handful of events and to sync the video with the audio.

I have a live version of this too, but the voice is terrible, there's a bit of a delay and it chews through tokens. Plus it has to use a pretty dumb AI to keep the latency down. And it puts extra strain on my GPU which is already cooking.