Glue

NLP benchmark ModernBERT beats DeBERTaV3 on

3 episodes mention this Visit official site →

Episodes

#5624: One Forward Pass: Building a Bounded Classifier

No generation, no parsing — just label scores in a single pass. How to build a small encoder classifier that actually works.

Sep 28
#2487: Why AI Calls Everything a "Prediction" (Even Images)

Machine learning calls everything a "prediction" — even generated images. Here's why the terminology matters more than you think.

Apr 27
#260: Digital Archeology: The Primitive Power of GPT-1

Revisit the 2018 model that started it all. Herman and Corn dive into GPT-1's romance-novel roots and its 117-million-parameter legacy.

Jan 20