How to use LLMs for Fact Checking

Описание: ➡️ ADVANCED-inference Repo (incl. fact checking scripts in this vid.): https://trelis.com/ADVANCED-inference/
➡️ Runpod Affiliate Link: https://runpod.io?ref=jmfkcdio
➡️ One-click GPU templates: https://github.com/TrelisResearch/one...

OTHER TRELIS LINKS:
➡️ Trelis Newsletter: https://blog.Trelis.com
➡️ Trelis Resources and Support: https://Trelis.com/About

VIDEO LINKS:
Slides: https://docs.google.com/presentation/...

TIMESTAMPS:
0:00 Intro - fact checking with LLMs
0:33 Video Overview
2:15 #1 Citation Verification Technique
5:06 #2 Enforcing Structured Responses (regex / json) with OpenAI
8:54 #3 Context Focusing
11:44 Comparing Long Context vs Retrieval approaches to fact-checking
13:37 Test Document Preparation (adding errors to the Irish Constitution)
16:15 Long Context Fact Checking (whole document as context)
22:37 Long Context Fact Checking with Structured Responses
24:38 Setting up structured responses with Gemini and Openai GPT-4o
27:19 Hacking structured responses with Claude
28:26 Fact checking with bm25 and cosine similarity retrieval
38:53 Results: Long Context vs Structured vs Retrieval Approaches
40:03 Video Resources