The Neuroscience of “Attention”

Описание: What is "attention" and why did our brains evolve to prioritize things? This is the Episode 0 of the series "Visual Guide to Transformer Neural Networks" that delved into the mathematics of the "Attention is All You Need" (Vaswani, 2017) paper. This video discusses the neuroscience and the psychology related aspects of "Attention".

Visual Guide to Transformer Neural Networks (Series) - Step by Step Intuitive Explanation

Episode 0 - [OPTIONAL] The Neuroscience of "Attention"
   • The Neuroscience of “Attention”  

Episode 1 - Position Embeddings
https://www.youtube.com/watch?v=dichI...

Episode 2 - Multi-Head & Self Attention
https://www.youtube.com/watch?v=mMa2P...

Episode 3 - Decoder’s Masked Attention
https://www.youtube.com/watch?v=gJ9ka...


Credits - Video
1. Cosmos: Possible Worlds -    • Official Trailer | Cosmos: Possible Worlds...  
2. Transport inside the brain: The basic mechanisms of neuronal trafficking -    • Transport inside the brain: The basic mech...  
3. Zoom Into Eye Effect Premiere Pro -    • Zoom Into Eye Effect Premiere Pro  
4. The Beauty Of Earth -    • The Beauty Of Earth  
5. Norway | Mountains -    • Norway | Mountains  
6. Icheon Master Hand -    • Icheon Master Hand  
7. Labs of Cognitive Neuroscience - Nelson Lab - Boston Children's Hospital -    • Labs of Cognitive Neuroscience - Nelson La...  
8. UCSF Dyslexia Center Phenotyping Project - Brain Imaging -    • UCSF Dyslexia Center Phenotyping Project -...  
9. Dissecting Brains -    • Dissecting Brains  
10. Hypatia | The Philosopher -    • Hypatia | The Philosopher  
11. Visual Attention -    • Visual Attention  
12. Optical illusions show how we see | Beau Lotto -    • Optical illusions show how we see | Beau L...  
13. Zoom Into Eye Effect [After Effects 2020 Transition Tutorial] No Plugins Required -    • ZOOM INTO EYE EFFECT [After Effects 2020 T...  
14. Baby's Choice - Toys Vs Literally Anything Else -    • Видео  
15. Infant Looking Time Habituation. Activity 2 from "What Babies Can Do" -    • Infant Looking Time Habituation. Activity ...  
16. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] -    • Karl Loxley - Never Enough (from The Great...  
17. Funny Phone Accidents Texting While Walking Fail!1 -    • Funny Phone Accidents   Texting While Walk...  
18. TFL Viral - Awareness Test (Moonwalking Bear) -    • TFL Viral - Awareness Test (Moonwalking Bear)  
19. Selective Attention Test -    • Selective Attention Test  
20. Misdirection and Inattentional Blindness -    • Misdirection and Inattentional Blindness  
21. World's Most Famous Magic Tricks Revealed! -    • World's Most Famous Magic Tricks Revealed!  
22. Smoothini's Top 7 Magic Tricks Finally Revealed | America's Got Talent -    • SMOOTHINI'S TOP 7 MAGIC TRICKS FINALLY REV...  
23. The art of misdirection | Apollo Robbins -    • The art of misdirection | Apollo Robbins |...  
24. The extraordinary final test to become a Shaolin Master | Sacred Wonders – BBC -    • The extraordinary final test to become a S...  
25. Horse Riding Cinematic - Red Scarlet-    • HORSE RIDING CINEMATIC  - RED SCARLET-W  
26. Hidden Figures Official Trailer 1 (2017) - Taraji P. Henson Movie -    • Hidden Figures Official Trailer #1 (2017) ...  
27. 11 | Desiertos-Directors Cut | Directed By Diego Pernía -    • 11 | Desiertos-Directors Cut | Directed By...  
28. Inception - Ariadne Learns How To Build Dreams -    • Inception - Ariadne Learns How To Build Dr...  
29. The Neuroscience of Learning -    • The Neuroscience of Learning  
30. The Most Insane Piano Pieces (Vol. 1) -    • The Most Insane Piano Pieces (Vol.  1)  
31. Markus Eder's The Ultimate Run - The Most Insane Ski Run Ever Imagined -    • The Most Insane Ski Run Ever Imagined - Ma...  
32. Muhammad Ali Dodges 21 Punches In 10 Seconds -    • Muhammad Ali Dodges 21 Punches In 10 Seconds  
33. Collaborative Video Object Segmentation by Foreground-Background Integration -    • Collaborative Video Object Segmentation by...  
34. My Tips for Prompts, Part 1 (Invent Good Prompt for Disco Diffusion) -    • My Tips for Prompts, Part 1 (Invent Good P...  



Credits - Music
1. Royalty Free Cinematic Trailer Music | Cinematic Trailer Background Music By Music4video -    • Видео  
2. Whitesand - Eternity (Epic Beautiful Dramatic Emotional Instrumental) [Copyright Free] -    • Whitesand - Eternity (Epic Beautiful Drama...  
3. Science & Technology Background Music For Presentation No Copyright Royalty Free -    • Science & Technology Background Music For ...  
4. Anastasiya Lunes - Desert Rose (Sting Cover Mix) With Lyrics (No Copyright) -    • Anastasiya Lunes - Desert Rose (Sting Cove...  
5. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] -    • Karl Loxley - Never Enough (from The Great...  
6. Sufi dance -    • Sufi dance