MT-Bench
Benchmark for multi-turn conversation
Episodes
-
#6131: Judging the Judges: How AI Evaluates Creative WritingLLM judges match human raters — but the human ceiling is low. What that means for evaluating creative writing. -
#2354: Profiling a Ghost ModelA deep dive into Amazon Nova, a mysterious AI model family on Bedrock — and the gaps in what we know. -
#2007: AI Grading AI: The Snake Eating Its TailWe asked an AI to write this script. Then we asked another AI to grade it. Here’s what happens when the judges have biases. -
#2005: Beyond Vibes: The Hard Science of LLM EvaluationRunning the same LLM on different GPUs can produce different results. Here’s why that happens and how to test for it.