Berkeley Function Calling Leaderboard (BFCL)
Evaluates tool use and function calling
Episodes
-
#5409: What Makes a Model "Agentic"? Atria Dawn PreviewA 744B-parameter model drops quietly on Hugging Face. Is "agentic" a real model category, or just a deployment pattern? -
#2404: What Tool-Calling Benchmarks Miss About Production FailuresBFCL, tau-bench, and Nexus each reveal different failure modes. None of them test what actually kills production agents. -
#2008: Needle-in-a-Haystack Testing for LLMsNew AI models claim to be genius-level, but can they actually find a specific fact in a massive document? -
#1930: The Agent Identity Crisis: Workflow vs. ConversationOne automates invoices silently; the other chats in Slack. Why the industry's favorite word means two totally different things. -
#1906: Is Your AI Model Agentic-Ready or Just Wearing a Suit?Native tool calling is the difference between a working product and a debugging nightmare. -
#130: How to Spot Gamed Benchmarks in Chinese AIAre Chinese AI models actually beating the West, or just gaming the system? Herman and Corn dive into the reality of modern AI benchmarks.