Fireworks AI
Inference platform with proprietary INT4/INT8 quantization
Episodes
-
#6001: What Do Inference Providers Actually Sell?Same open weights, 20x cost gap. What Fireworks, Together, and Groq actually sell — and when to just rent a GPU. -
#5981: Batch Inference: Four Doors, Half PriceSame tokens, half the price — and almost nobody using it properly. A tour of batch inference from OpenAI to OpenRouter. -
#5853: Who Actually Competes With Hugging Face?2.96 million model repos, and 85.6% have under 200 downloads. What ModelScope, Kaggle, and Ollama actually do differently. -
#5830: Serving Your Own Fine-Tuned Model in the CloudYou fine-tuned an open-weight model. Now how does anyone actually talk to it? Dedicated GPUs vs serverless inference, and the math that decides it. -
#5004: What Precision Is Your Model Actually Running At?When you call an API, are you getting the model you think you are? Inference providers quantize more than they admit. -
#2355: Why Open-Weight Models Are WinningDiscover how Cogito v2.1 leverages process supervision and MoE architecture to redefine reasoning efficiency in open-weight AI models. -
#48: Renting vs. Building: The Hidden Choices in AI InferenceEver wonder how AI magic happens? We demystify AI inference, exploring where and how models truly operate.