Introduction to nanoGPT
Автор: ProgrammingWizards TV
Загружено: 2024-03-20
Просмотров: 369
Описание:
Welcome, in this video we will learn about nanoGPT comprehensively.
What we cover 1
What is nanoGPT?
Installation
Training a Character-level GPT on Shakespeare
Step 1. Prepare the Shakespeare dataset:
Step 2. Train the GPT model:
Step 3. Sample from the trained model:
What we cover 2
Reproducing GPT-2 124M
Step 1. Prepare the OpenWebText dataset:
Step 2. Train the GPT-2 124M model:
Step 3. Sample from the trained model:
What we cover 3
Finetuning Pre-trained Models
Step 1. Prepare the Shakespeare dataset:
Step 2. Run the finetuning script:
Step 3. Sample from the finetuned model:
Sampling and Inference
Efficiency and Troubleshooting
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке:
