You Don't Need an Expensive GPU Anymore (Strata 100 tok/s)

Описание: Strata runs DeepSeek V4.1 Flash, a 763B model, on a 12GB GPU. But the viral "100+ tok/s" was the reading speed, and the part that got expensive isn't your graphics card anymore.

In this video I test the claim behind "you don't need an expensive GPU anymore." Strata is a free, MIT-licensed local AI engine that splits a mixture-of-experts model across three tiers: the hot core on your GPU, the busy experts in RAM, and DeepSeek's 110 GB Engram lookup table on your SSD. That's how a 763 billion parameter model fits on 12 GB of VRAM. It's also why a 12 GB RTX 3060 PC writes twice as fast as an RTX 5070 PC, and why a $700 AMD MI50 from 2018 can match an RTX 5090.

What's covered:
• How Strata fits DeepSeek V4.1 Flash 1017 on 12GB of VRAM (GPU, RAM and SSD offloading)
• Prefill vs decode: why 110 tok/s reading becomes 4–6 tok/s writing
• Qwen 3.8 Flash-Next at ~94 tok/s on an RTX 5070 vs DeepSeek at 4.7 tok/s
• Price per gigabyte: VRAM vs DDR5 vs DDR4 vs NVMe SSD
• RTX 3060 vs RTX 5070, and AMD MI50 vs RTX 5090
• When renting DeepSeek through the API beats running it locally
• What you can run with 16, 32, 64 and 128 GB of RAM

Chapters:
0:00 The 24GB VRAM wall
1:37 What Strata is (63 releases in 38 days)
3:13 How a 763B model fits on 12GB (GPU, RAM, SSD)
5:45 The viral 100+ tok/s number
8:05 What 4.7 tok/s actually feels like
10:26 The price tag moved to RAM
13:53 Why the older RTX 3060 is faster
17:10 Qwen 3.8 Flash-Next vs DeepSeek V4.1 Flash
20:00 Should you just rent it?
21:45 What your RAM gets you (16GB to 128GB)
24:35 So, do you need an expensive GPU?

Watch next:
▶ Avalon Just Beat Strata by 47% on AMD (9x Faster) —    • Avalon Just Beat Strata by 47% on AMD (9x ...  
▶ llama.cpp Just Made 125B MoE Models 4× Faster! —    • llama.cpp Just Made 125B MoE Models 4× Fas...  
▶ Local AI Hardware Just Got Way More Expensive Than You Think —    • Local AI Hardware Just Got Way More Expens...  

Sources:
Strata (GitHub): https://github.com/Niko1221/Strata
DeepSeek V4.1 Flash 1017: https://huggingface.co/deepseek-ai/De...
ISTA-DASLab GSQ-RCO quants: https://huggingface.co/ISTA-DASLab/De...
DeepSeek API pricing: https://api-docs.deepseek.com/quick_s...
RTX 5090 test (Strata issue #4170): https://github.com/Niko1221/Strata/is...
AMD MI50 test (r/LocalLLM):   / 1xie9ya  
Prices checked late October 2026. RAM and SSD prices are moving fast, so check today's before you buy.

What GPU and how much RAM are you running? Tell me in the comments.

#DeepSeek #LocalAI #Strata