Attention IS Optimal Transport
Автор: Dr. Mikey Bee
Загружено: 2026-02-21
Просмотров: 15
Описание:
A visual history of optimal transport in transformers.
From Monge (1781) to Kantorovich (1942) to Cuturi (2013) to Vaswani (2017) to Litman (2025) — the proof that softmax attention solves entropic optimal transport.
Music: Ravel — String Quartet in F major, 2nd movement (Budapest String Quartet, 1948)
Made with Manim Community Edition.
References:
• Litman (2025): arXiv:2508.08369
• DeepSeek signal amplification: arXiv:2512.24880
• ESPFormer: arXiv:2502.07962
• FlashSinkhorn: arXiv:2602.03067
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке: