OpenTelemetry
Standard telemetry protocol and semantic conventions
Episodes
-
#5973: MCP Security: Tool Poisoning and Agent IdentityMCP servers trust their own tool descriptions. That design choice creates a whole new class of attack — and a new observability problem. -
#5960: There's No Such Thing as Tokens Per SecondWhy one tokens-per-second number can't describe an LLM server — and which metrics actually tell you if it's working. -
#5623: When Your AI Cites Sources It Didn't Actually UseYour RAG pipeline cites a source — but did the model actually use it? New interpretability research says you can't tell from the trace. -
#2511: Measuring AI API Latency Through the Black BoxHow to benchmark token throughput and debug slowdowns in closed CLI tools like Claude Code using OpenTelemetry and mitmproxy. -
#2254: How to Test an AI Pipeline ChangeWhen you tweak one part of a complex AI agent system, how do you know if it actually improved anything? The answer lies in engineering checkpoints. -
#1777: Claude Called My Prompt "Rambling" and I'm Not OkayWhen an AI coding tool critiques your prompt's literary quality, it raises a massive technical question about engineered personality. -
#1714: The Hidden Cost of Rolling Your OwnWhy do companies pour millions into SDKs? We explore the hidden costs of raw APIs and the strategic advantages of using software kits.