FineWeb-Edu

15T-token dataset filtered by fine-tuned BERT

2 episodes mention this Visit official site →

Episodes

#5431: The Other Half of Hugging Face: Why BERT Still Out-Downloads Llama

Encoder models pull over a billion downloads a month. Decoder models pull 397 million. The AI conversation and the download counter are describing ...

Sep 21
#2063: That $500M Chatbot Is Just a Base Model

That polite chatbot? It started as a raw, chaotic autocomplete engine costing half a billion dollars to build.

Apr 6