#data-integrity
96 episodes · Page 2 of 4
#3324: How Companies Actually Measure Their Carbon Emissions
Spreadsheets, supplier calls, and accounting choices that can change your reported emissions by 10x.
#3223: Handcuffed to a Petabyte: Urgent Physical Data Transfer
When data moves faster by plane than fiber, couriers handcuff petabytes in reinforced cases across oceans.
#3217: When a Truck Beats the Internet: Shipping Data at Scale
Why FedEx sometimes beats fiber for moving massive datasets across the country.
#3179: Counting Lights to Measure Empty Skyscrapers
How researchers and citizens use window light counts to estimate real building occupancy.
#3033: 3,000 Episodes, 3 Copies: Is This Backup Setup Enough?
Three copies, two clouds, one NAS. But is this setup truly protecting 3,000 podcast episodes?
#3024: How to Incrementally Back Up Google Photos to Your NAS
Build a quarterly backup pipeline for Google Photos using the Library API, hash deduplication, and your NAS.
#2935: Notebooks vs Scripts: The Real Tradeoffs
Why data scientists love notebooks but engineers distrust them — and who's right.
#2923: Structured Outputs: Taming AI's Token Lottery
Why prompt engineering isn't enough to get consistent JSON from LLMs.
#2883: Correlation Beyond Pearson: 5 Techniques You Need
Pearson, Spearman, Kendall, partial, distance correlation — when to use each one and why most people stop too soon.
#2875: How Polls Actually Make Samples "Representative
The secret behind "representative samples" — and why the margin of error is just the beginning of the story.
#2854: What Our Analytics Dashboard Reveals About Hidden Audiences
Hilbert uncovers suspicious spikes in podcast data. Are they covert ops or just university students?
#2774: Open Data That Actually Works
The gap between open data promises and reality, and the rare cases where it actually changes policy.
#2694: When AI Agents Write Your Backup Scripts
Borg, Restic, and Kopia compared for whole-server incremental backups on Ubuntu Docker hosts.
#2556: The Weird Myths of Solid-State Storage
No moving parts, no sound waves — just electrons trapped in silicon. How solid-state drives actually work.
#2550: Idempotent Pipelines: Checkpoints, Manifests & Safe Re-Runs
How to design scripts and pipelines so re-running them is safe, even after a crash mid-execution.
#2523: The OECD’s Quiet Power Over Environmental Data
How a “rich country club” became the world’s most reliable source for environmental data—and why that matters.
#2500: What Actually Counts as Hacking?
The CFAA, web scraping, and the messy line between curious URL-poking and federal crime.
#2478: MCP File Handling: Why Your Base64 Upload Breaks at 4MB
MCP has no standard file input. Base64 breaks at 4MB, presigned URLs need whitelisting, and MinIO workarounds aren't standardized.
#2465: JSON-L vs Parquet: When Each Format Wins
How far can JSON-L scale before it breaks? And why does Parquet dominate for millions of rows?
#2444: Custom IDs: UUIDs vs Human-Readable Keys
How to design database IDs that balance security, human readability, and performance — with lessons from Stripe and TypeID.
#2436: The One-in-Ten-Thousand Design Constraint
How survey-grade precision and Python tools shape local map projections — and the silent failures that break your analysis.
#2435: The Hidden Difficulty of Data Modeling
Stop designing database schemas from scratch. Here's where to find ready-made templates for common business apps.
#2434: From Spreadsheets to Databases: The Mental Shift
Stop treating databases like bigger spreadsheets. Learn the one conceptual shift that actually matters.
#2397: When Data Becomes the Decision Framework
Discover how situational awareness dashboards transform chaos into actionable insights during emergencies like earthquakes and hurricanes.