Arize Phoenix
Open-source LLM tracing and evaluation tool
Episodes
-
#6130: Picking a Human Labeling Tool for LLM BenchmarksBuilding a human review layer for LLM benchmarks? Here's what Argilla, Label Studio, Prodigy, and Potato actually cost in money and maintenance. -
#5623: When Your AI Cites Sources It Didn't Actually UseYour RAG pipeline cites a source — but did the model actually use it? New interpretability research says you can't tell from the trace. -
#3284: Agent Infrastructure Engineer: The New DevOpsAgentic AI is splintering into real engineering disciplines. Here's what the "DevOps of AI" actually does. -
#2185: Taking AI Agents From Demo to ProductionSixty-two percent of companies are experimenting with AI agents, but only 23% are scaling them—and 40% of projects will be canceled by 2027. The ga... -
#1939: API Drift and Agent ReliabilityWhen an API changes without warning, your AI agent can crash spectacularly. Here's how to test the new "plumbing" of the agentic age. -
#1843: Why Is My AI Pipeline Stuck? (Kanban-Style Observability)Stop digging through JSON logs. See your AI jobs moving on a board, not just server metrics. -
#1804: The Fork in the Road: Why AI Agents Check Old Receipts FirstStop your AI agent from overthinking. Learn why it checks old memories instead of booking flights—and how to fix the "eagerness" problem. -
#1472: Stop Flying Your AI Agents BlindMove past basic token counting. Learn how to monitor AI reasoning, prevent $47k loops, and build trust in autonomous agents. -
#1235: Beyond "No Training": Securing the New Agentic AI StackThink your data is safe because of a "no training" clause? We deconstruct the hidden security risks within the modern agentic AI stack.