TensorRT
nvidia software development kit for deep learning inference
Episodes
-
#5419: The Attention Budget in Your PocketWhy phone dictation runs out of room, and how bounded attention windows buy you punctuation without blowing your memory budget. -
#5198: Counting the AI Models Nobody ReleasesYOLO is free — the labeled data isn't. Why the custom image models that matter most are the ones you'll never see on Hugging Face.