promptfoo
Matrix-style YAML config evaluation framework
Episodes
- #6068: Chinese AI Models: Refusing vs. ReframingNew studies show Chinese AI models have shifted from refusing sensitive questions to answering them — in the Party's voice.
-
#2411: Are Political Bias Benchmarks Actually Measuring Anything?Why the Political Compass Test fails, and what researchers are building instead to actually measure model bias. -
#2403: Choosing Your LLM Eval FrameworkAn architectural shootout of four major LLM evaluation harnesses — where each shines and where each breaks down.