Adam Optimizer in 20 min

Описание: Don't like the Sound Effect?:    • Adam Optimizer in 20 min [No SFX]  
Text: https://github.com/The-Pocket/PocketF...

0:00:00 - Intro
0:01:32 - Momentum
0:07:07 - Adagrad
0:12:15 - Adam
0:21:20 - Conclusion

Social media:
X: https://x.com/ZacharyHuang12
LinkedIn:   / zachary-h-23aa37172  
Github: https://github.com/zachary62
Discord:   / discord  
Medium:   / zh2408  
Substack: https://zacharyhuang.substack.com/

About Me:
👋 I'm Zach, an AI researcher at Microsoft Research AI Frontiers. I currently work on LLM Agents & Systems. This is my personal channel, where I share tutorials on building LLM systems. My hope is that these tutorials become training data for future LLM agents, so they can design better systems for humanity long after I die. Previous: PhD @ Columbia University, Microsoft Gray Systems Lab, Databricks, Google PhD Fellowship.