#gpu-acceleration
57 episodes · Page 2 of 3
#1992: The Sovereign Compute Shift: Owning vs. Renting AI Iron
Israel is building a sovereign AI supercomputer with 4,000 Nvidia B200 GPUs to keep startups local.
#1940: Why Google's 31B Model Fits in Your GPU
Google just dropped Gemma four, and its 31-billion-parameter size is a masterclass in hardware-aware AI design.
#1820: Renting vs. Owning GPUs: The Break-Even Math
Is it cheaper to rent serverless GPUs or buy your own hardware? We break down the math on utilization, depreciation, and hidden costs.
#1809: The TTS Developer's Dilemma: Size vs. Speed
Stop guessing. We break down the critical trade-offs between model size, latency, and sample rate for production-ready voice apps.
#1807: The ABI Trap: Why GPUs Break Docker's Promise
Docker promised "run anywhere," but GPU images make you compile for hours. Here’s why the abstraction breaks down.
#1806: Why Mac Minis Are Eating AI's Hardware Race
Apple Silicon's unified memory is crushing traditional GPUs for local LLMs. Here's why the M4 Mac Mini is the new king of affordable AI hardware.
#1752: Whisper Small Beats Whisper Large in Speed & Accuracy
A 4GPU benchmark on Ubuntu shows the 1.5B parameter Whisper Large is slower and less accurate than the tiny Whisper Small.
#1534: The Terminal Trap: When Productivity Paranoia Becomes a Full-Time Job
Stop drowning in terminal tabs. Discover how tools like Zellij and Ghostty are transforming the command line into an Agentic Development Environment.
#1224: Cracking the CUDA Code: NVIDIA’s Software Dominance
Discover why NVIDIA’s CUDA is the oxygen of the AI industry and how tools like OpenAI’s Triton are finally challenging its 20-year software moat.
#1109: The T-FLOP Trap: Measuring the Power of Modern AI
Are teraflops the "horsepower" of AI, or just a marketing gimmick? Explore why raw compute speed isn't the whole story in the race for AI power.
#1102: Beyond the Boost: Mastering Modern GPU and RAM Tuning
Is manual hardware tuning still worth it? Discover why undervolting and curve optimization are the new secrets to peak PC performance.
#1081: The K-V Cache: Solving AI’s Invisible Memory Tax
Why does your AI get slower as you chat? Discover the K-V cache, the invisible bottleneck of generative AI, and how we're fixing it in 2026.
#1021: The Python Paradox: Why AI's Backbone Is a Nightmare to Deploy
Why did a 1980s hobby project become the backbone of AI? Explore the history of Python and the chaos of modern dependency management.
#675: From Digital Libraries to Intelligence Factories
From liquid cooling to nuclear power, Herman and Corn explore how AI is transforming data centers into high-density "intelligence factories."
#663: The Three Pillars of Workstation Performance
Is a high-end desktop enough, or do you need a workstation? Herman and Corn break down the "three pillars" of professional hardware.
#633: Memory Wars: The Future of Local Agentic AI
Can your PC handle the next wave of AI agents? Herman and Corn dive into VRAM, quantization, and the future of running LLMs locally.
#484: The Silicon Sharing Economy: Inside Serverless GPUs
How do small teams run massive AI models without $50,000 chips? Corn and Herman dive into the hidden plumbing of serverless GPU providers.
#170: How PyTorch Beat TensorFlow and Became AI's Backbone
Discover why PyTorch is the "oxygen" of AI. Herman and Corn explore its history, the magic of Autograd, and the move to the PyTorch Foundation.
#162: When a Fast PC Isn't Enough: The Workstation Divide
Is your PC a workstation or just a fast desktop? Herman and Corn break down the hardware that defines professional computing in 2026.
#110: Why Agentic AI Needs More VRAM Than You Think
Learn how to build a high-performance local AI server for agentic coding, from dual-GPU PC builds to the power of Mac's unified memory.
#84: The Silicon Arms Race: Why GPUs are the New Oil
Are high-end microchips the new enriched uranium? Herman and Corn dive into the high-stakes world of GPU export bans and global AI supremacy.
#82: The Accidental AI Engine
From video game dragons to digital brains: Herman and Corn explain why your graphics card is the secret engine behind the AI boom.
#56: The Thought Experiment Nobody Runs
Building an AI model from scratch? It's a brutal reality of trillions of tokens and millions in GPUs. Discover the hidden costs of modern AI.
#55: Running Video AI at Home: The Real Technical Challenge
Video AI: Hype vs. Reality. Can your GPU handle it? We dive into the technical challenges of running video AI at home.