SAGE XR Proto2

Описание: This is the latest prototype of the SAGE XR system. This is running on an Oculus Quest 3. Sage work with a structured system prompt that instructs the LLM to return, not only its chat response, but also commands, like "Start a Lesson", or "Show a Model". The system supports structured presentation of educational information. During the course of regular conversation it's free to show whatever models or images fit best with the context of the conversation.

Users can use the microphone to send messages, or there's a virtual Keyboard. There's also a set of 'Word Tiles' that users can use to build messages. The word tiles are generated from the knowledge base. It can't make everything a user might want to say or ask, but for things that are repeated often, it's a pretty neat feature. It was also completely designed and implemented by Claude 3.5 Sonnet.

Claude 3.5 Sonnet doesn't just generate code. It's more like a collaborator than a tool. A year ago I would work with prompts like "I have a class that does XYZ, and I need a method to...". With Claude I start with a conversation about the requirements, architecture, technical dependencies and class structure.
Claude has a problem-solving approach that's in many ways better and faster than mine. Claude writes log files, can work with screenshots of error messages, uses meticulous error handling.
With this iteration of SAGE, Claude wrote all the front-end smarts. It designed the elements of the UI (except for the virtual keyboard}

I'm not sure if working with Claude is making me a better program. I wrote maybe 6 lines of code for this project myself. But I do feel like it's making me a better developer and engineer. If that comes at the cost of the nuts and bolts of typing in code, then I will gladly pay it.