← AI Inference

AI Inference

549 episodes · Page 22 of 23

#170: How PyTorch Beat TensorFlow and Became AI's Backbone

Discover why PyTorch is the "oxygen" of AI. Herman and Corn explore its history, the magic of Autograd, and the move to the PyTorch Foundation.

ai-inferencetransformer-architectureopen-sourcehistory-of-technologytraining-data

#154: From Apps to Agents: Building Your Digital Workforce

Move beyond simple prompts. Explore the architecture, autonomy, and fiscal guardrails of the next generation of AI agentic workflows.

multi-agent-systemsai-coding-assistantsworkflow-automationai-inferencelocal-ai

#142: Breaking the Voice Wall: The Future of Native Speech AI

Explore why native speech-to-speech AI is 20x more expensive than text pipelines and how "semantic VAD" is solving the awkward silence problem.

speech-recognitiontext-to-speechai-inferencegpusai-coding-assistants

#136: The Ghost in the Machine: Why AI Voices Hallucinate

Why does your AI suddenly start shouting or whispering like Darth Vader? Herman and Corn dive into the glitchy world of TTS hallucinations.

text-to-speechhallucinationsai-inferencespeech-recognition

#133: When Quantum Computing Becomes Accessible

Discover how quantum computing is transforming AI from brute-force scaling to surgical precision in this deep dive into the 2026 tech landscape.

gpusai-inferencetransformer-architecturecontext-and-memorycloud-computing

#132: How AI Learns to See Time as a Dimension

Discover how spatial-temporal tokenization and 3D world modeling are revolutionizing real-time video-to-video AI interaction.

transformer-architecturecomputer-visiongenerative-mediaai-inferencecontext-and-memory

#130: How to Spot Gamed Benchmarks in Chinese AI

Are Chinese AI models actually beating the West, or just gaming the system? Herman and Corn dive into the reality of modern AI benchmarks.

ai-evaluationtraining-datahallucinationsai-inference

#126: The Cocktail Party Problem: Why AI Forgets

Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.

transformer-architecturecontext-and-memoryai-inferencelocal-ai

#122: The Comeback of RNNs: Why Old Tech Still Matters

Herman and Corn pull back the curtain on AI to explain the mathematical "plumbing" of neural networks and the future of machine learning.

transformer-architecturetraining-dataai-inferencelocal-ai

#120: Silencing the Siren: Real-Time AI Noise Reduction

How do phones remove sirens and crying babies in real time? Explore the neural networks and hardware making crystal-clear audio possible.

speech-recognitionai-inferencelocal-aigpus

#118: AI in 2025: Is Small the New Big?

If the cost is the same, should you always use the biggest AI model? Discover why smaller models often win on speed, steering, and accuracy.

ai-inferencegpuslocal-aiai-evaluation

#111: Beyond Transformers: Solving the AI Memory Crisis

Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.

context-and-memorytransformer-architectureai-inferenceai-coding-assistants

#110: Why Agentic AI Needs More VRAM Than You Think

Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.

ai-coding-assistantslocal-aigpuscontext-and-memoryai-inference

#109: Beating Context Bloat with Dynamic Dictionaries

Tired of AI mishearing brand names? Learn how to build efficient custom dictionaries for Gemini 1.5 without breaking the bank.

speech-recognitionai-inferencecontext-and-memorylocal-ai

#108: Why Your AI Code Assistant Gets Worse

Why do AI models lose their edge over time? Herman and Corn explore the "home team advantage" and why telling your AI to "do better" actually works.

ai-coding-assistantsai-evaluationprompt-engineeringcontext-and-memoryai-inference

#107: The $5.5 Million Breakthrough: DeepSeek’s AI Disruption

Discover how DeepSeek-V3 is disrupting the AI market with massive cost savings and technical innovations like Multi-Head Latent Attention.

ai-inferenceopen-sourcegpustransformer-architecturemarket-competition

#92: Is AI Eating Its Own Trash?

Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.

training-dataai-evaluationhallucinationsai-inferencetransformer-architecture

#88: Why Won't My AI Talk to Me First?

Why is AI always waiting for us? Herman and Corn explore the technical and social hurdles of proactive AI and the "vending machine" model.

ai-alignmentcontext-and-memorylocal-aiai-inference

#87: Why Big Tech Gives Away AI for Free

Why are tech giants spending millions on AI just to give it away? Herman and Corn dive into the strategic chess game of open-source models.

open-sourcetraining-dataai-inferencelocal-ai

#84: The Silicon Arms Race: Why GPUs are the New Oil

Are high-end microchips the new enriched uranium? Herman and Corn dive into the high-stakes world of GPU export bans and global AI supremacy.

gpusai-inferenceai-securitychinasanctions

#82: The Accidental AI Engine

From video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom.

gpustransformer-architectureai-inferencehistory-of-technology

#69: Why the Gooseneck Mic Beats Studio Gear for AI

The gooseneck mic: a humble hero with surprising AI power. Discover its secret to crystal-clear speech-to-text accuracy!

speech-recognitionaudio-equipmentai-inference

#67: Scaling or Pivoting AI for Code

Are LLMs truly the future of coding, or do they need a fundamental architectural pivot? We dive into AI's programming future.

ai-coding-assistantsai-evaluationhallucinationstransformer-architectureai-inference

#64: How AI Learns to See, Hear, and Think Together

AI is evolving beyond text, learning to see, hear, and understand our world. Discover the future of human-AI interaction!

transformer-architecturecomputer-visionspeech-recognitionai-inference