Math4ML Exercises: Probability

Описание: In this video, W&B Deep Learning Educator Charles Frye and ML Engineer Scott Condron work the final exercises of the Math for Machine Learning course, on probability.

To try out the exercises yourself, head here: https://github.com/wandb/edu/tree/mai...

For the Math4ML lecture on probability, head here: http://wandb.me/m4ml-video-3

For an introduction to this exercise series, head here:    • Math4ML Exercises: Getting Started & Linea...  

Check out the other Math4ML videos here:    • Linear Algebra - Math for Machine Learning  

Blogpost on surprise and information theory: https://charlesfrye.github.io/stats/2...

00:00 - Teaser
00:30 - Intro
01:42 - Implementing entropies
02:32 - Exercise: surprise
04:46 - Why do models output probabilities?
06:53 - Exercise: entropy
10:58 - Exercise: crossentropy
14:05 - Exercise: divergence
17:51 - Loss functions and surprises
20:01 - Exercise: softmax_crossentropy
23:01 - Putting it all together with Gaussians
24:48 - Exercise: gaussian_surprise
35:35 - Gaussian surprise and squared error
37:18 - Exercise: Gradient descent on a surprise
41:06 - Why are these exercises useful?
42:25 - How programmers can learn more math