LLAMA 2 paper explained - first free commercial model vs ChatGPT!

Описание: Meta has just announced, LLAMA 2 - the largest ever open-source Language model. Though there have been several open-source LLMs released since ChatGPT, what makes LLAMA 2 special is that it is available completely free for commercial use.

In this video lets take a fist look at the LLAMA2 Model, an overview of the training process, a demo of LLAMA 2 and finally how to download and setup LLAMA 2 locally.

LLAMA 2 Paper: https://shorturl.at/EGST4
LLAMA 2 Website: https://ai.meta.com/llama
LLAMA 2 Research blog: https://ai.meta.com/blog/large-langua...
Demo App: https://llama2.ai
Replicate Models: https://replicate.com/a16z-infra
LLAMA 2 Code: https://github.com/facebookresearch/l...

LLAMA 1 Paper: https://arxiv.org/pdf/2302.13971.pdf
GQA Paper: https://arxiv.org/pdf/2305.13245.pdf


⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️
0:00 - Intro
1:20 - LLAMA 2 First Impressions
2:24 - LLAMA 2 Training
3:22 - RLHF
3:40 - Grouped-Query Attention
4:50 - Training Curves
5:30 - CO2 Emission
5:50 - Evaluations
7:14 - LLAMA 2 Demo
9:47 - LLAMA 2 Model Download
10:50 - Extro

🧸 🧸 🧸 TOYS OF THE TRADE 🧸 🧸 🧸

📝 XP-Pen for my scribbles - https://amzn.to/3HNOpPH
⌨️🐭 My Keyboard & Mouse - https://amzn.to/3XKZ3wF
🖥 My Monitor - https://amzn.to/3YdVpvT
💻 My GPUs - https://amzn.to/3YE2aXX
🎤 My Mic - https://amzn.to/3YCdDHA
My work desk - https://amzn.to/3GWF1IP

🛠 🛠 🛠 MY SOFTWARE TOOLS 🛠 🛠 🛠
✍️ Notion - https://affiliate.notion.so/aibites-yt
✍️ Notion AI - https://affiliate.notion.so/ys9rqzv2vdd8
📹 OBS Studio for video editing - https://obsproject.com
📼 Manim for some animations - https://www.manim.community
🎵 My music - https://www.bensound.com and

📚 📚 📚 BOOKS I HAVE READ, REFER AND RECOMMEND 📚 📚 📚
📖 Deep Learning by Ian Goodfellow - https://amzn.to/3Wnyixv
📙 Pattern Recognition and Machine Learning by Christopher M. Bishop - https://amzn.to/3ZVnQQA
📗 Machine Learning: A Probabilistic Perspective by Kevin Murphy - https://amzn.to/3kAqThb
📘 Multiple View Geometry in Computer Vision by R Hartley and A Zisserman - https://amzn.to/3XKVOWi

MY KEY LINKS
YouTube:    / @aibites  
Twitter:   / ai_bites​  
Patreon:   / ai_bites​  
Github: https://github.com/ai-bites​

WHO AM I?
I am a Machine Learning Researcher / Practioner who has seen the grind of academia and start-ups equally. I started my career as a software engineer 15 years back. Because of my love for Mathematics (coupled with a glimmer of luck), I graduated with a Master's in Computer Vision and Robotics in 2016 when the now happening AI revolution just started. Life has changed for the better ever since.

#machinelearning #deeplearning #aibites