Model Architecture
Transformers, LLMs, neural networks, attention mechanisms
28 episodes
The World Model Revolution: Beyond LLM Token Prediction
Herman and Corn explore why LLMs struggle with logic and how the shift to world models is giving AI a sense of physics and spatial reality.
Decoding the Transformer: From Attention to Inference
Herman and Corn dive into the mechanics of transformer inference, exploring how models turn massive matrices into meaningful conversation.
The 70-Year Overnight Success: How AI Finally Arrived
Think AI was an overnight success? Join Herman and Corn as they trace the 70-year journey from rigid logic rules to modern deep learning.
Digital Archeology: The Primitive Power of GPT-1
Revisit the 2018 model that started it all. Herman and Corn dive into GPT-1's romance-novel roots and its 117-million-parameter legacy.
Beyond the Transformer: The New AI Architecture Wars
Is the transformer’s reign ending? Herman and Corn explore Mamba, x-LSTM, and the architectures solving AI's massive memory problem.
Inside the Brain of an AI: The Rise of Reasoning Models
Discover how AI shifted from instant reflexes to deep reflection through inference-time compute and hidden reasoning steps.
The Math of Magic: Decoding AI Weights and Tensors
What actually happens inside an AI model? Corn and Herman break down the numerical "valves" and "knobs" that power modern intelligence.
The Heavy Metal of Machine Learning: Inside PyTorch
Discover why PyTorch is the "oxygen" of AI. Herman and Corn explore its history, the magic of Autograd, and the move to the PyTorch Foundation.
Quantum AI: The End of Brute Force Computing
Discover how quantum computing is transforming AI from brute-force scaling to surgical precision in this deep dive into the 2026 tech landscape.
Beyond Frames: The Rise of Real-Time Video AI
Discover how spatial-temporal tokenization and 3D world modeling are revolutionizing real-time video-to-video AI interaction.
AI’s Dial-Up Era: Looking Back from 2036
Herman and Corn explore why today's AI prompts and latency will look like "dial-up modems" to our future selves in 2036.
The Spotlight Effect: Understanding AI Attention Mechanisms
Why do AI models "lose the plot" after a few thousand words? Discover the mechanics of attention and the innovations solving context window limits.
Deep Learning Decoded: The Math Behind the Machine
Herman and Corn pull back the curtain on AI to explain the mathematical "plumbing" of neural networks and the future of machine learning.
Beyond Transformers: Solving the AI Memory Crisis
Why does AI forget your conversation every time you hit enter? Herman and Corn dive into the "stateless" nature of LLMs and the future of memory.
The $5.5 Million Breakthrough: DeepSeek’s AI Disruption
Discover how DeepSeek-V3 is disrupting the AI market with massive cost savings and technical innovations like Multi-Head Latent Attention.
The Scaling Wall: Why Bigger AI Isn’t Always Smarter
Is brute force the only path to AGI? Corn and Herman explore the limits of scaling, the risk of model collapse, and the future of world models.
The $100 Million Giveaway: Why Big Tech Opens Its AI
Why are tech giants spending millions on AI just to give it away? Herman and Corn dive into the strategic chess game of open-source models.
Why AI Lies: The Science of Digital Hallucinations
Why do smart AI systems make up fake facts? Corn and Herman explore the "feature" of digital hallucinations and how to spot them.
The Reverse Turing Test: Can AI Spot Its Own Kind?
Can a robot tell if you’re human? Herman and Corn explore the "Reverse Turing Test" and why being "messy" might be our best defense.
AI & Code: Scaling or Pivoting?
Are LLMs truly the future of coding, or do they need a fundamental architectural pivot? We dive into AI's programming future.
AI's Senses: Seeing, Hearing, Understanding
AI is evolving beyond text, learning to see, hear, and understand our world. Discover the future of human-AI interaction!
Tokenizing Everything: How Omnimodal AI Handles Any Input
Omnimodal AI: How do models process images, audio, video, and text all at once? Discover the engineering behind AI that accepts anything.
Instructional vs. Conversational AI: The Distinction Nobody Talks About
Instructional vs. conversational AI: a crucial distinction reshaping how AI is built. Discover why it matters for the future of AI development.
AI's Hidden History: Beyond the Buzz
AI isn't new. We've been using "smart software" for decades, from medical imaging to weather prediction, long before ChatGPT.
Beyond the GPU: Unpacking AI's Chip Revolution
Beyond the GPU: we're unpacking AI's chip revolution. Discover the crucial, often overlooked world of AI's fundamental building blocks.
The AI Breakthrough: Transformers & The Perfect Storm
AI's everywhere. How did chatbots, art, and video all emerge so suddenly? The secret lies in Transformers and a perfect storm.
AI: Not an Overnight Success Story
AI's "overnight success" is a myth. Unravel the true story behind its rise, from humble beginnings to today's innovations.
AGI's Crossroads: Are LLMs a "Dead End" to True AI?
Are LLMs a dead end for true AGI? We dive into the electrifying debate with AI's forefathers.