Category Theory and LLMs | Tech talk with Tai-Danae Bradley

Описание: What is category theory, and what does it have to do with Large Language Models (LLMs)? Join Tai-Danae Bradley, Research Mathematician at SandboxAQ, as she describes a connection, starting with a friendly introduction to this modern branch of mathematics and closing with a new result on categorical magnitude, which is joint work with mathematician Juan Pablo Vigneaux (Caltech).

Originating in the 1940s, category theory provides a framework or “template” that unites many ideas, constructions, and themes across the mathematical landscape. A category theoretical viewpoint can also extend to disciplines outside of mathematics, providing new ways to think about new (and old) problems. Mathematical structure in natural language is one example, as some ideas behind today’s large language models seem to be pleasantly compatible with existing tools in category theory.

If you're interested in learning more, watch Tai-Danae's full talk at UCLA here:
   • Tai-Danae Bradley - An Enriched Category T...  

And you can check out the papers referenced in the video here:
https://arxiv.org/abs/2106.07890
https://arxiv.org/abs/2501.06662

Learn more about all of the other deep tech work happening at SandboxAQ in our publication library:
https://pub.sandboxaq.com/