Needle in a Haystack (NIAH)
Benchmark for long-context retrieval evaluation
Episodes
-
#2406: Why Million-Token Context Windows Can't Handle 3 Reasoning StepsNeedle-in-a-haystack is dead. Here's what actually measures whether models can think across long documents. -
#2008: Needle-in-a-Haystack Testing for LLMsNew AI models claim to be genius-level, but can they actually find a specific fact in a massive document? -
#1828: Mastering 2M Token Context in Agentic PipelinesA massive context window sounds like a dream, but it can quickly become a nightmare for complex AI workflows.