2.2. Tutorial on LLM evaluation methods: Reference-based evals.

Описание: Notebook example: https://github.com/evidentlyai/commun...

Part 1:    • 2.3. Tutorial on LLM evaluation methods: R...  
Part 3:    • 2.3. Tutorial on LLM evaluation methods: R...  

00:03 Intro, data prep
01:53 Exact match
02:28 Semantic similarity and BERTSCore
05:00 LLM as a judge: binary correctness
07:23 LLM as a judge: multi-class correctness
10:07 Recap

COURSE PLAYLIST
Full playlist:    • Course: LLM evaluation for builders  
Instructor: Elena Samuylova, CEO Evidently AI.

LINKS:
https://www.evidentlyai.com/llm-guide... LLM evaluation methods and metrics

EVIDENTLY
Sign up for Evidently Cloud https://www.evidentlyai.com/register
Support Evidently on GitHub https://github.com/evidentlyai/evidently