Fine-Tune Llama 3.1 and Deploy Using NVIDIA NIM Directly From Your Laptop
Автор: Brev
Загружено: 2024-07-29
Просмотров: 24707
Описание:
NVIDIA Developer Program: https://developer.nvidia.com/nim
Get Access To The NIM: https://build.nvidia.com/meta/llama-3...
Follow Along: https://brev.dev/llama3-1-nim
In this tutorial, we walk through getting access to the NVIDIA Developer program to gain access to the cutting edge Llama3.1 8B Instruct Model NIM. We fine-tune Llama 3.1 using a PEFT technique called LoRA using the NVIDIA Nemo Framework. And we deploy the fine-tuned model on an NVIDIA NIM.
This video serves as an example for how you might develop an AI application with a fine-tuned LLAMA 3.1 model and deploy it for the fastest production level inference speeds on your own infrastructure.
If you have any questions please leave them in the comment section below!
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
