langfuse
Open-source LLM observability platform
Episodes
-
#6130: Picking a Human Labeling Tool for LLM BenchmarksBuilding a human review layer for LLM benchmarks? Here's what Argilla, Label Studio, Prodigy, and Potato actually cost in money and maintenance. -
#5623: When Your AI Cites Sources It Didn't Actually UseYour RAG pipeline cites a source — but did the model actually use it? New interpretability research says you can't tell from the trace. -
#3284: Agent Infrastructure Engineer: The New DevOpsAgentic AI is splintering into real engineering disciplines. Here's what the "DevOps of AI" actually does. -
#2468: When Tokens Meet GPU SecondsHow to track AI spend across Open Router, Replicate, and more — without a unified dashboard. -
#2010: Building Better AI Memory SystemsWe obsess over AI inputs but treat outputs like Snapchat messages. Here's why that's a massive blind spot. -
#2004: The AI Control Plane Is Here (But Is It Safe?)Your LLM, tools, and costs are scattered across dashboards. Here’s how a unified AI control plane fixes the chaos. -
#1932: How Do You QA a Probabilistic System?LLMs break traditional testing. Here’s the 3-pillar toolkit teams use to catch hallucinations and garbage outputs at scale. -
#1843: Why Is My AI Pipeline Stuck? (Kanban-Style Observability)Stop digging through JSON logs. See your AI jobs moving on a board, not just server metrics. -
#1472: Stop Flying Your AI Agents BlindMove past basic token counting. Learn how to monitor AI reasoning, prevent $47k loops, and build trust in autonomous agents.