I built an 8x NVIDIA GB10 cluster for massive Local AI

Описание: We built a "massive" 8x NVIDIA GB10 cluster with 1TB of memory, 160 Arm cores, eight Blackwell GPUs, many TBs of storage, and around 1.7Tbps of networking. Thank you to Micro Center for sponsoring this video. What is fun, you do not even need to set it up yourself anymore as we had AI agents handle all of the configuration after we got the initial username and password on each system.

STH Main Site Article: https://www.servethehome.com/big-clus...

Substack: https://axautikgroupllc.substack.com/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel:    / @servethehomevideo  
Professional Users Substack: https://axautikgroupllc.substack.com/

----------------------------------------------------------------------
Links to Micro Center Advertisement
----------------------------------------------------------------------
Shop Micro Center’s Desktop deals: https://micro.center/2e788f
Sign up for a FREE 128gig Flash Drive at Micro Center’s Austin Location: https://micro.center/114615
Sign up for a FREE 128gig Flash Drive at Micro Center’s New Jersey Store: https://micro.center/524449
Visit Micro Center News: https://micro.center/507a9c

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: https://forums.servethehome.com
Follow on Twitter:   / servethehome  
Follow on LinkedIn:   / servethehome-com  
Follow on Facebook:   / servethehome  
Follow on Instagram:   / servethehome  

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
I let OpenClaw set up this homelab:    • I Let OpenClaw Have Its Way With a 56TB Mi...  
Dell Pro Max with GB10:    • This Dell Pro Max with GB10 is Already Pay...  
NAS for NVIDIA GB10 cluster:    • SUPER Studio NAS with 360TB of SSD Storage...  
Touring MikroTik in Latvia:    • Touring the COOLEST Networking Company  
MikroTik CRS812 DDQ:    • 400GbE is CHEAP Now MikroTik CRS812 DDQ Re...  
Dell Pro Max with GB10 overview: https://www.servethehome.com/dell-pro...
Unboxing short:    • The HOTTEST NVIDIA AI Workstation Dell Pro...  
NVIDIA ConnectX-8 review: https://www.servethehome.com/nvidia-c...
NVIDIA GB10 Networking Deep-Dive: https://www.servethehome.com/the-nvid...
NVIDIA DGX Spark:    • 128GB with 200GbE NVIDIA DGX Spark is GREA...  
Lenovo PGX: https://www.servethehome.com/lenovo-t...
Gigabyte AI TOP: https://www.servethehome.com/gigabyte...
ASUS GX10: https://www.servethehome.com/asus-asc...

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
02:49 Hardware Overview
04:09 200GbE RDMA Networking with MikroTik CRS804 DDQ
07:53 Micro Center Ad
08:56 10GbE Network Setup
09:28 Power Consumption
11:45 NVIDIA GB10 Cluster Setup
15:38 Performance Kimi K2.5, Kimi K2.6, Qwen3.5-397B, GPT-OSS-120B
22:14 Key Lessons Learned