Together AI
Inference platform documenting FP16/INT8/INT4 quantization
Episodes
-
#6001: What Do Inference Providers Actually Sell?Same open weights, 20x cost gap. What Fireworks, Together, and Groq actually sell — and when to just rent a GPU. -
#5981: Batch Inference: Four Doors, Half PriceSame tokens, half the price — and almost nobody using it properly. A tour of batch inference from OpenAI to OpenRouter. -
#5853: Who Actually Competes With Hugging Face?2.96 million model repos, and 85.6% have under 200 downloads. What ModelScope, Kaggle, and Ollama actually do differently. -
#5830: Serving Your Own Fine-Tuned Model in the CloudYou fine-tuned an open-weight model. Now how does anyone actually talk to it? Dedicated GPUs vs serverless inference, and the math that decides it. -
#5004: What Precision Is Your Model Actually Running At?When you call an API, are you getting the model you think you are? Inference providers quantize more than they admit. -
#2472: When Guardrails Break: The Hidden Costs of AI Gateway FilteringPII detection at the gateway layer can block legitimate invoices. Here's how guardrails actually work and where they fail. -
#2355: Why Open-Weight Models Are WinningDiscover how Cogito v2.1 leverages process supervision and MoE architecture to redefine reasoning efficiency in open-weight AI models. -
#1946: Why LangChain Built a Three-Layer Agent StackWe unpack LangGraph, LangChain, and Deep Agents to reveal the deliberate hierarchy behind the ecosystem. -
#1078: The Agentic Throughput Gap: Why Your AI Hits a WallStop hitting 429 errors. We explore why AI agents crash into rate limits and how to build high-throughput systems that never sleep. -
#671: Keys to the Kingdom: Securing AI Model WeightsHow do AI labs share their models without losing the secret sauce? Explore the tech keeping Claude secure in the Pentagon’s hands.