build dual GPUs system for AI: dual 3060ti run LLaMA (exllama)

Описание: Dual 3060Ti system to run large language model using Exllama. Upcoming videos will try dual AMD GPU. Subscribe to stay tuned!
The github repo link is: https://github.com/turboderp/exllama
👉ⓢⓤⓑⓢⓒⓡⓘⓑⓔ Thank you for watching! please consider to subscribe. thank you!

For Linux Ubuntu install, please see    • Ubuntu Linux Desktop installation part 1 -...  
For Linux ROCm install, see    • AMD GPU Linux ROCm installation - step by ...  
For Pytorch Install, see    • AMD GPU install Pytorch (2.0 or 1.13.1) - ...  

Affiliate links: buy on Amazon
4600G https://amzn.to/45LhGFa
5600G: https://amzn.to/3LgnFtC (same iGPU, better CPU)
5700G: https://amzn.to/3Z9gUiM (better iGPU, and better CPU)
ssd drive: https://amzn.to/3MVJdg2
DDR4 drive: https://amzn.to/3sKNufi
AM4 motherboard: https://amzn.to/3GfrPit
PSU (power supply unit): https://amzn.to/3Gd87UA
PC Case: https://amzn.to/3QPDNnF
if you are interested in discrete GPU: https://amzn.to/3QT1wDp

0:6 Intro
0:15 showcase of the dual gpu system
2:30 list the gpu available in the system
4:20 Running exllama powered chat app

Please join the discord server at   / discord   where you can ask questions and also try out my recently developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!