Vision Transformer (ViT) Implementation In TensorFlow

Описание: In this video, we will implement the Vision Transformer (ViT) from scratch in the TensorFlow framework using the Keras API.

Vision transformer (ViT) is a transformer-based architecture used in the field of computer vision, it is directly inspired by the use of Transformers in NLP tasks.

Code: https://github.com/nikhilroxtomar/Vis...
Blog Post: https://idiotdeveloper.com/vision-tra...
Vision Transformer Research Paper: https://arxiv.org/pdf/2010.11929.pdf

Timeline:
00:00 - Introduction
00:25 - What is Vision Transformer?
02:47 - Input Image to Patch Processing used in Vision Transformer
06:05 - Transformer Encoder
07:14 - Variants of Vision Transformer: ViT-Base, ViT-Large, ViT-Huge
07:44 - Importing all required libraries
08:43 - Begining with the _main_ and writing ViT variants configuration
09:32 - Vision Transformer Implementation
35:00 - Ending - SUBSCRIBE

Support:
   / @idiotdeveloper  
https://www.buymeacoffee.com/nikhilro...

Follow Me:
BLOG: https://idiotdeveloper.com https://sciencetonight.com
TELEGRAM: https://t.me/idiotdeveloper
FACEBOOK:   / idiotdeveloper  
TWITTER:   / nikhilroxtomar  
INSTAGRAM: https://instagram/nikhilroxtomar
PATREON:   / idiotdeveloper