Easiest way to install local LLM

Описание: Link to Resources: https://thenextnewthing.ai/my-resources
Presented by Zapier: https://zapier.com/
Learn how to install a complete local AI stack in minutes and run coding agents, deep research, and AI workflows without paying for API tokens.

Andrew Warner is joined by Mike Bradley to demonstrate ODS (Open Deployment Stack) by Osmatic, an open-source platform that makes local AI deployment as simple as copying and pasting a single command. They walk through installing ODS on Windows, automatically selecting the right model for your hardware, and using tools like Hermes Agent, Open WebUI, Perplexica, ComfyUI, OpenCode, and n8n. The conversation also covers running AI on affordable hardware, self-hosting, model management, background workflows, enterprise deployments, and why open-source AI gives users more flexibility, privacy, and control.

Links featured:

Osmatic: https://osmantic.com/
Free ODS software we showed: https://github.com/Osmantic/ODS
Perplexica
Hermes Agent

00:00 - Local AI Setup: Install a complete local AI stack with one command.
00:36 - ODS: Open-source deployment for self-hosted AI applications.
01:21 - Windows Installation: Install ODS from PowerShell in minutes.
02:51 - Included Apps: Automatically install Hermes Agent, Open WebUI, ComfyUI, OpenCode, Perplexica, and n8n.
05:06 - Hardware Detection: Automatically choose the best AI model for your computer.
07:12 - ODS Dashboard: Monitor GPU usage, memory, temperatures, and AI performance.
08:33 - Open WebUI: Run local AI chat models without cloud APIs.
12:54 - Hermes Agent: Automate coding, research, email, scheduling, and everyday tasks.
16:21 - Perplexica: Perform deep AI research locally with web search.
20:06 - Model Management: Download and switch between local AI models.
21:45 - ODS Enterprise: How Osmantik supports organizations while keeping ODS free.
22:57 - The Future of Local AI: Why self-hosting creates more competition, privacy, and user control.

Media/Sponsorship Inquiries: https://thenextnewthing.ai/l/sponsor

👉 Join us: https://thenextnewthing.ai/