Part 2: Linux Mint AI Rig - Install Script Guide - llama.cpp | Odysseus | LACT | AI Budget Build
Автор: Daniel Parke
Загружено: 2026-06-12
Просмотров: 398
Описание:
In Part 2 of the Local AI Budget Build Project, we will go from a fresh Linux Mint install, to a fully functioning local AI workstation. We will complete the initial Linux Mint setup steps, and then walkthrough the install script to set up our AI workstation.
I have created a dedicated install/uninstall script (see links below) which I will demonstrate how to use in this guide.
This will complete the following set up, allowing full interactivity throughout:
• Standard Linux updates and setup
• GPU driver updates
• Gemma 4 model downloads (E2B, E4B, 12B, 31B)
• llama.cpp installation, deployment and service
• LACT for GPU monitoring and control
• Odysseus for a first entry UI to interact with our locally deployed AI.
Script download links:
Install - https://github.com/Daniel-Parke/Patte...
Uninstall - https://github.com/Daniel-Parke/Patte...
Link to project repo:
https://github.com/Daniel-Parke/PatterOS
****************************************
The long term goals of this project are as follows:
• How cheap can we make the final hardware build, while still maintaining sufficient quality and token generation speeds?
• How much can we reduce the required power with GPU tuning whilst maintaining sufficient performance?
• Can we profile the power/energy consumption of local AI hardware relative to model complexity and inference intensity?
• What is the smallest model that can be run to generate reliable and consistent high quality outputs?
• Can we design an OS that is an extension of Linux Mint, that will simplify the installation and set up process for a range of rig configurations (Multi GPU, mixed manufacturers, etc.).
• When everything is said and done, is it worth the bother for users compared to cloud based offerings?
The hypothesis: 1 high quality token/s is infinitely more valuable than 0. Everything after that is just impressive gains with diminishing returns.
The budget build project aims to see how far we can take this concept with local hardware, whilst maintaining an acceptable level of output quality
*****
GUIDES:
To follow this guide and the entire project you will need to install an Ubuntu based Linux distro.
For this project I select Linux Mint - Cinnamon edition:
Linux Mint ISO: https://www.linuxmint.com/edition.php...
To flash a USB drive with the Linux iso you will need to use either Rufus, or Balena Etcher. I prefer Rufus as it works more reliably with old hardware, but Balena etcher will work fine here also.
Download ISO flasher:
Rufus: https://rufus.ie/en/
https://etcher.balena.io/
Flashing the USB drive with Linux is very straightforward, please following the below guides for specific instructions if this is your first time installing Linux:
https://linuxmint-installation-guide....
*****
BOM & Build Guide:
https://github.com/Daniel-Parke/Patte...
AI Rig Parts List:
• Machinist X99 PR9-H mini-ATX motherboard (£47.02)
• Xeon E5-2650 v4 CPU (Bundled with CPU)
• TR-AXP120 CPU Cooler (£22.99)
• SK Hynix 64GB DDR4 RAM (£112.46)
• Micron 512GB NVMe SSD (£36.65)
• RTX 2070 Super / RX 7900 XTX / RTX 3090 Ti (£140 | £665 | £843)
• Corsair RM850e 850W Gold Power Supply (£86.99)
• Open Frame Test Bench (£26.99)
• Artic MX-7 Thermal Paste (£7.39)
• CR2302 CMOS Battery (£3.33)
Total Platform Build Cost for each GPU:
NVIDIA RTX 3090 Ti - £1,187
AMD RX 7900 XTX - £1,009
NVIDIA RTX 2070 Super - £484
****************************************
00:00 Introduction
00:16 Screen Recorder Download
00:41 Linux Mint Setup
04:40 Project Repo
05:49 Install Script - Setup
09:16 Install Script - Explanation
11:26 Install Script - Runtime
15:31 Moment of truth!
16:15 Why Vulkan instead of ROCm
17:44 Model download whoopsie...
17:56 Back on track
18:21 Uninstall - Reset
18:51 Picking up where we left off - Install
19:09 Odysseus - Introduction
20:18 LACT Introduction
22:43 Services
23:35 Odysseus Account
23:58 Firewall and Ports
25:11 Where to save new Models
26:02 Odysseus - Model set up & test run
27:43 First run & LACT monitoring
29:08 Outro
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке: