Neural Arithmetic Logic Units

Описание: Deepmind released a paper just a few days ago describing a module for neural networks called the Neural Arithmetic Logic Unit (NALU). Although deep neural networks can learn to represent and manipulate numerical information, they don't generalize well outside of the range of numbers encountered during training. Meaning train it on the numbers 1-10 and it won't be able to count to 11. To improve this ability, the researchers created an architecture that represents numerical quantities as linear activations which are manipulated using primitive arithmetic operators, controlled by learned gates. Its really fascinating stuff, i'll detail how it works in this video.

Code for this video:
https://github.com/llSourcell/Neural_...

Please Subscribe! And like. And comment. That's what keeps me going.

Want more education? Connect with me here:
Twitter:   / sirajraval  
instagram:   / sirajraval  
Facebook:   / sirajology  

This video is apart of my Machine Learning Journey course:
https://github.com/llSourcell/Machine...

More Learning Resources:
https://arxiv.org/abs/1808.00508
https://github.com/search?l=Python&q=...
https://deepmind.com/blog/
   • How to Make a Prediction - Intro to Deep L...  

Join us in the Wizards Slack channel:
http://wizards.herokuapp.com/

Sign up for the next course at The School of AI:
https://www.theschool.ai

And please support me on Patreon:
https://www.patreon.com/user?u=3191693
Signup for my newsletter for exciting updates in the field of AI:
https://goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz