MCP server to let any LLM control your robot

Описание: I created an MCP server that lets any LLM (GPT, Gemini, Claude, etc.) control my real 3D-printed robot 🤖

This is a deep dive video that walks you through the entire process — from concept and setup to hands-on demos and real-world results.

MCP is like a universal API for LLMs. With a robot-controlling MCP server, I can ask an LLM to "move my robot up 5 cm" or "grab the bottle in front of you", and it can execute the command zero-shot, relying only on the camera feed — no finetuning or special training required.

But this video is not just about the results — I go through every step so you can replicate it yourself.

🧠 Along the way, we explore:
What is MCP and how it works with LLMs + clients (GPT, Claude, Gemini, Cursor, Windsurf)
How inverse kinematics makes robot commands more intuitive
Walkthrough of my open-source code + how to test calibration and control the robot with your keyboard
Full guide to implementing the MCP server and testing it with the built-in dev inspector
Demos using different clients: Claude Desktop, Cursor, Windsurf, LibreChat
Simple zero-shot tasks (like pick-and-place) and more reasoning-heavy challenges
✅ Successes and 💥 lots of failures — plus insights on why they happened
Discussion of System 1 vs. System 2 roles in robot reasoning and how LLMs fit in

⚙️ Code + Setup Instructions:
👉 https://github.com/IliaLarchenko/robo...

🧵 Short summary thread on X:
https://x.com/IliaLarchenko/status/19...

🔗 Links & Resources
MCP docs: https://modelcontextprotocol.io/intro...
HuggingFace MCP course: https://huggingface.co/learn/mcp-cour...
LeRobot library: https://huggingface.co/lerobot
SO-ARM100 robot: https://github.com/TheRobotStudio/SO-...
My robot overview video:    • Running AI robotics experiments at home wi...  
List of MCP-compatible clients: https://github.com/punkpeye/awesome-m...
(Unofficial list, in theory, you can control the robot from any of them, but I didn't try most of them)

💬 Tried MCP or LLM-based robot control? Share your experience below!
🔔 Subscribe for more robotics + AI experiments
👍 Like if you enjoyed the video

00:00 - Introduction & Demo
02:13 - What is the MCP Protocol and how does it work with LLMs
13:43 - Robot Description
18:08 - Inverse Kinematics Theory
27:08 - Code Implementation
31:51 - Calibration Testing
35:06 - Keyboard Control Demo
38:54 - MCP Server Development
41:50 - MCP Inspector Testing
45:36 - MCP in practice
46:57 - Claude Desktop Client
51:05 - Windsurf IDE Client
54:43 - Cursor IDE Client
1:00:21 - LibreChat & GPT Client
1:01:31 - Systems 1 and 2
1:11:30 - Summary

#AI #Robotics #LLM #MCP #Claude #Gemini #GPT #RobotControl #InverseKinematics #ToolUse #HuggingFace #LeRobot #Cursor #Windsurf #LibreChat #System1 #System2 #EmbodiedAI #EmbodiedReasoning