#4408: What Latency Actually Buys in Trading

Why retail trading platforms advertise microsecond speeds — and why that spec doesn't matter for most traders.

Featuring
Listen
0:00
0:00
Episode Details
Episode ID
MWP-4587
Published
Duration
22:50
Audio
Direct link
Pipeline
V5
TTS Engine
chatterbox-regular
Script Writing Agent
deepseek-v4-pro

AI-Generated Content: This podcast is created using AI personas. Please verify any important information independently.

Retail trading platforms prominently advertise market data feed latency in milliseconds, presenting it as a decisive feature for individual traders. But the gap between what's advertised and what actually determines trading outcomes is enormous. This episode breaks latency down into three tiers: what professional HFT firms actually optimize for, whether any of that trickles down to retail, and what it would take for an individual to compete.

At the professional tier, serious latency competition doesn't happen over the public internet. Firms colocate servers inside exchange data centers — Nasdaq in Carteret, NYSE in Mahwah, CME in Aurora — with fiber runs to the matching engine measured in meters. Exchanges engineer parity at the physical layer with equal-length cross-connects, but outside the building, the arms race accelerates. Microwave relay chains between Chicago and New Jersey shave roughly 1.5 milliseconds off fiber latency by transmitting through air rather than glass. At the top tier, firms compete in nanoseconds using FPGA hardware that bypasses operating system scheduling entirely.

For retail traders, the demand for low-latency feeds is mostly marketing. The difference between a five-millisecond and fifty-millisecond feed is irrelevant for executing a few hundred shares of a liquid stock — the spread and commissions dwarf any latency advantage. Even algorithmic traders face bottlenecks in their broker's API and order routing infrastructure, which add far more latency than the data feed itself. And under SEC Regulation NMS, orders may be routed through multiple venues checking for best execution, adding further delay. Most US retail orders never reach a public exchange anyway — they're internalized by wholesale market makers who pay brokers for order flow.

Building an end-to-end low-latency setup as an individual requires eliminating Wi-Fi, securing favorable ISP routing or direct cross-connects, colocating servers near exchanges ($500-$2,000/month), and tuning hardware with kernel bypass and CPU pinning. Even after thousands in monthly costs and significant engineering expertise, you'd still be orders of magnitude slower than firms with custom FPGA designs and dedicated teams optimizing nanoseconds. The latency difference between a good and bad retail setup is negligible compared to spread costs, making the pursuit economically futile for almost any individual trader.

Context

Useful verified background: serious latency competition happens via colocation in exchange data centers (NYSE in Mahwah NJ, Nasdaq in Carteret NJ, CME in Aurora IL), where firms pay for rack space and equal-length cross-connect cables; the professional race is measured in microseconds and nanoseconds, not milliseconds. Famous infrastructure: microwave relay chains between Chicago and New Jersey beat fiber because line-of-sight microwave is straighter and light travels faster in air than in glass. Retail reality: most US retail orders never race anyone — they're routed via payment-for-order-flow to wholesale market makers (e.g. Citadel Securities, Virtu) and internalized. Data-provider layer: the US consolidated tape (SIP) is measurably slower than the exchanges' direct proprietary feeds — a well-documented gap that professional firms pay large sums to bypass; many retail "real-time" quotes are SIP-derived, and plenty of free platforms still show 15-minute-delayed data. So a retail trader's "millisecond feed" typically sits on top of a feed that is already behind the direct-feed reality by design.

Downloads

Episode Audio

Download the full episode as an MP3 file

Download MP3
Transcript (TXT)

Plain text transcript file

Transcript (PDF)

Formatted PDF with styling

#4408: What Latency Actually Buys in Trading

Corn
So Daniel sent us this one — he's been looking at retail trading platforms and noticed they all advertise market data feed latency in milliseconds like it's the decisive feature. He wants to know who actually competes on microsecond advantages, what real end-to-end optimization would cost an individual, and how the data feed itself introduces latency before your trade even leaves your computer. It's a great set of questions because the gap between what's advertised and what's actually happening is enormous.
Herman
It really is. And the timing on this is interesting — you've got AI-driven trading bots being marketed directly to retail users now, promising algorithmic sophistication that used to require a quant desk. But the infrastructure those bots run on is the same public internet, the same home Wi-Fi, the same consolidated data feeds. So the latency claims and the actual edge have never been further apart.
Corn
The contradiction practically writes itself. So let's break this down into three questions that get at what latency actually buys — and for whom.
Herman
And the first thing to establish, before we even talk about retail, is what the professional tier actually looks like. Because once you see that, the retail marketing claims sort of collapse under their own weight.
Corn
First, let's look at the tier where microseconds genuinely matter — the professional HFT world — and then ask whether any of that trickles down to retail.
Herman
So the baseline reality is this: serious latency competition does not happen over the public internet. It happens inside exchange data centers. Nasdaq's colocation facility is in Carteret, New Jersey. The NYSE's is in Mahwah. The CME is out in Aurora, Illinois. And firms pay for rack space literally inside those buildings, with fiber runs to the matching engine measured in meters — under ten meters in many cases.
Corn
Ten meters. Meanwhile my home router is further from my desk than that.
Herman
And that ten-meter fiber run isn't just any cable. These are equal-length cross-connects, precisely measured so that every firm in the colocation cage gets the same physical distance to the matching engine. The exchange doesn't want one firm getting a shorter cable and a few nanoseconds of advantage just because they got a better rack assignment. So they engineer parity at the physical layer.
Corn
Which is a fascinating detail — the exchange itself is in the business of preventing a cable-length arms race inside its own building. But outside the building, it's a free-for-all.
Herman
Right, and that's where the real arms race lives. The famous example is the microwave relay chains between Chicago and New Jersey. If you want to trade across exchanges — say, arbitraging between the CME in Chicago and Nasdaq in Carteret — you need to get data between those two points as fast as possible. Fiber optic cable is fast, but it's not straight. It follows roads and railroad rights-of-way, it bends around geography. Microwave line-of-sight is straighter, and more importantly, light travels faster in air than in glass — about fifty percent faster. So microwave links shave roughly one and a half milliseconds off the fiber latency between Chicago and New Jersey.
Corn
One and a half milliseconds. That's the margin these firms are spending millions on tower leases and spectrum licenses to capture.
Herman
And we're not even talking milliseconds anymore at the top tier — it's nanoseconds. Firms compete on the exact path of the cable, the type of transceiver, the processing delay inside the network interface card. They use FPGA hardware — field-programmable gate arrays — to process market data and generate orders in hardware rather than software, because software introduces operating system scheduling delays that are just too slow.
Corn
So the professional tier is operating on infrastructure that is physically inside the exchange, connected by precisely measured fiber, with hardware that bypasses the operating system entirely. And then a retail platform says "get our low-latency feed."
Herman
Right. And this is where the demand question gets interesting. Where does the demand for low-latency feeds on retail platforms actually come from? I'd say it's mostly marketing. Latency is a measurable spec — you can put a number on it, and a smaller number sounds better. It's the trading equivalent of a car's zero-to-sixty time. Most drivers will never need that acceleration, but it sells cars.
Corn
The spec sheet arms race. My brokerage feed is five milliseconds, yours is fifty — five is a smaller number, therefore my platform is better.
Herman
And for someone executing a few hundred shares of a liquid stock, the difference between five milliseconds and fifty milliseconds is completely irrelevant. Your edge, if you have one, comes from your strategy, your analysis, your risk management — not from whether your order reached the exchange forty-five milliseconds earlier. The spread alone on most stocks is going to be a far larger cost than any latency differential you could optimize away.
Corn
But there is an exception, right? Algorithmic traders running strategies that react to market data — arbitrage between correlated assets, that kind of thing.
Herman
Yes, and that's the carve-out worth making. If you're running a strategy that depends on speed — say you're trying to capture a pricing discrepancy between an ETF and its underlying basket of stocks — then latency does matter. But even then, the bottleneck is almost certainly not the data feed your broker is advertising. It's your broker's own execution infrastructure. Their API, their order routing, their internal risk checks. All of that happens before your order ever leaves their system.
Corn
So you might have a one-millisecond data feed, but your broker's API is adding twenty milliseconds of processing before it even looks at your order.
Herman
And that's a number almost no broker advertises. They advertise the feed latency because it's the spec they can control and it sounds good. The internal routing latency is harder to measure and often less flattering.
Corn
There's also a regulatory layer here that most retail traders don't think about. The SEC's Regulation NMS — National Market System — requires brokers to route orders to the venue offering the best price. That sounds great in principle, but it means your order might get routed through multiple venues to check for best execution, and each hop adds time. A regulation designed to protect retail investors can actually add milliseconds to execution.
Herman
That's a really important point. Reg NMS was part of the response to the fragmentation of US equity markets — you've got something like sixteen different exchanges plus dozens of alternative trading systems. The "best execution" requirement means your broker has to check multiple venues. That's good for price improvement, but it's not free in terms of latency.
Corn
And that's before we even get to payment for order flow. Most US retail orders never actually race anyone to an exchange at all. They're routed to wholesale market makers — Citadel Securities, Virtu — who internalize the trade. Your order never sees the public exchange matching engine. So the advertised "low-latency feed to the exchange" is, in many cases, describing a path your order doesn't even take.
Herman
That's the quiet part nobody says out loud. The retail broker advertises the speed of their data feed and their execution, but the order itself gets sold to a market maker who fills it from their own inventory. The latency that matters in that scenario is the market maker's internal systems, not your connection to the broker. And those market makers are colocated, running FPGA hardware, competing in nanoseconds — but you're not competing with them, you're their customer. Or their revenue source, depending on how you look at it.
Corn
The broker is selling your order flow to the market maker and simultaneously selling you on the speed of the feed. It's a beautiful business model if you don't think about it too hard.
Herman
And that brings us to the second question — what would it actually take for an individual to compete on latency? Let's say you decided, against all economic sense, that you wanted to optimize end-to-end.
Corn
So if the pros are operating on a completely different infrastructure, what would it actually take for an individual to compete on latency? And more importantly, why is it almost always a fool's errand?
Herman
Let's walk through the chain. Step one: no Wi-Fi. Wi-Fi adds jitter and latency that's unpredictable — you're looking at anywhere from one to ten milliseconds just from the wireless hop, and it varies moment to moment. You need wired Ethernet, and not just any Ethernet — you want a high-quality network interface card with proper offloading capabilities.
Corn
So already you're tethered to a cable. Not exactly the mobile trading experience the apps are selling.
Herman
Step two: your ISP. A typical home internet connection adds ten to thirty milliseconds of latency just from ISP routing, before any trading infrastructure is involved. Your packets are going through your local exchange, through your ISP's backbone, through peering points, potentially across multiple ISPs. Each hop adds time, and you have almost no control over the path.
Corn
And "favorable peering" is not something you can call Comcast and request.
Herman
Right. You'd need an ISP that peers directly with the exchange's access point, or ideally, you'd bypass the public internet entirely with a direct cross-connect. That means colocating a server in the same data center as the exchange — which is what the pros do. But now you're paying for rack space, power, cooling, and cross-connect fees. That runs anywhere from five hundred to two thousand dollars a month, depending on the data center and the level of connectivity.
Corn
So before we've even talked about the trading software, we're at a couple grand a month just to get physically close to the exchange.
Herman
And we're not done. Step three: the server itself. You need hardware tuned for low latency. That means a network interface card with kernel bypass — technologies like DPDK that let your application talk directly to the network hardware without going through the operating system's network stack. You need CPU pinning, where you dedicate specific processor cores to your trading application so they're never interrupted by other tasks. You need to disable power-saving features that can cause microsecond-level delays when the CPU ramps up from a low-power state.
Corn
All of which requires a level of systems engineering expertise that is not typically found in someone who just wants to trade stocks from their laptop.
Herman
And step four: even after all that, you're still competing against firms with nanosecond-level optimization. They've got custom hardware, custom FPGA designs, microwave links, and teams of engineers whose entire job is to shave nanoseconds off the critical path. You cannot out-engineer them as an individual. It's not a question of budget — it's a question of organizational capability.
Corn
So the economic futility is baked in at every layer. You spend thousands a month to get your latency from fifty milliseconds down to five, and you're still orders of magnitude slower than the firms you're theoretically competing with, and the actual edge from those forty-five milliseconds you saved is dwarfed by the spread and commission costs of a single trade.
Herman
And that's the point that should really land for retail traders. The latency difference between a good setup and a bad one is negligible compared to other costs. If you're paying a commission of a fraction of a cent per share, and the spread on the stock is a penny, those costs are measured in dollars or at least cents per share. The latency cost, even on a bad connection, is measured in fractions of a cent — and often fractions of a fraction of a cent. It's the wrong thing to optimize.
Corn
It's like trying to improve your gas mileage by removing the antenna from your car. Technically it reduces drag. Practically, it does nothing you'll ever notice.
Herman
That's exactly the scale we're talking about. And now we get to the third question, which is the one I find most interesting — the data feed itself. Because even if you somehow solved all the networking and hardware problems, even if you had a zero-millisecond link to your broker, you're still only as fast as the data you're receiving.
Corn
This is the overlooked layer. The feed itself has latency baked in before your computer ever sees a price.
Herman
And there are really two tiers of data feed in the US equity markets. The first is the consolidated feed — the Securities Information Processor, or SIP. This is the official feed that aggregates quote and trade data from all the exchanges. It's what's used to calculate the national best bid and offer. And it is measurably slower than the exchanges' direct proprietary feeds.
Corn
How much slower?
Herman
The SIP adds roughly one to five milliseconds of latency compared to direct feeds, depending on the exchange and the time of day. That might not sound like much, but remember — the professional firms are competing in nanoseconds. One millisecond to them is an eternity. And that one-to-five-millisecond gap is well documented. The exchanges sell their direct feeds — Nasdaq has TotalView-ITCH, NYSE has its proprietary feed — and professional firms pay thousands of dollars a month for access because those direct feeds are faster than the SIP.
Corn
So if you're a retail trader looking at a "real-time" quote on your platform, and that platform is using SIP data, you're already one to five milliseconds behind the direct-feed reality. The price you're seeing is already stale before you can react to it.
Herman
And it gets worse. Under SEC rules, "real-time" data can legally be delayed by up to fifteen minutes for some data types. Most retail platforms do provide real-time quotes for the major exchanges, but plenty of free platforms still show fifteen-minute-delayed data unless you specifically enable real-time quotes. And even when you do, you're getting SIP data — which, as we just established, is behind the direct feeds.
Corn
So the retail trader's "millisecond feed" is sitting on top of a feed that is already behind the direct-feed reality by design. It's a millisecond measurement of something that arrived stale.
Herman
Right. And when a broker advertises "sub-millisecond execution," they're almost always measuring the time from when your order hits their server to when it reaches the exchange. That's the broker-to-exchange leg. It does not include the time it took for the market data to travel from the exchange to your screen, or the time it took for your order to travel from your computer to the broker's server. It's a carefully scoped measurement that excludes the two slowest parts of the chain.
Corn
The full round trip — data from exchange to your screen, your reaction time, your order from your computer to the broker, the broker's processing, and the broker-to-exchange leg — that's the number that actually matters. And nobody advertises that.
Herman
Because it would be a much larger and less impressive number. A typical retail setup, even with a good internet connection, is looking at maybe twenty to fifty milliseconds of round-trip latency just from the network. Add in the SIP delay, add in the broker's API processing, add in your own reaction time — which for a human is hundreds of milliseconds — and the "sub-millisecond execution" claim is measuring the fastest leg of a much longer journey.
Corn
It's like a restaurant advertising that their kitchen can cook your steak in ninety seconds, but they don't mention the forty-five-minute wait for a table.
Herman
And here's the thing — some of these latency improvements are real. The broker's infrastructure is fast. The colocated servers, the optimized network stacks, the direct exchange connections — those are real engineering achievements. The problem is the marketing extrapolates from "our servers are fast" to "you will trade faster," and that leap ignores everything between your computer and their servers.
Corn
So let's talk about what a retail trader can actually measure. You mentioned earlier that a simple ping test to the broker's server can tell you a lot.
Herman
Yeah, and this is practical. Open a terminal, ping your broker's server, measure the round-trip time. If it's under twenty milliseconds, your connection is fine. The rest is marketing. If it's above fifty, you might have a routing issue worth investigating. But even then, the fix is probably something mundane — switch from Wi-Fi to Ethernet, or check if your ISP has a bad peering arrangement — not upgrading to some premium data feed.
Corn
And that twenty-millisecond threshold is generous. Most strategies that a retail trader would run are not sensitive to twenty milliseconds of latency.
Herman
Not even close. The strategies that are sensitive to that level of latency are things like market making, statistical arbitrage across exchanges, latency arbitrage — all of which require colocation and direct feeds and hardware optimization to even attempt. If you're not colocated, you're not in that game, period. The twenty milliseconds from your home connection is the least of your problems.
Corn
Given all that — the infrastructure costs, the data feed limitations, the marketing spin — what should a retail trader actually care about?
Herman
Three things, I'd say. First, execution quality. That means fill rate — what percentage of your orders actually get filled — and slippage — how much the executed price differs from the price you saw when you clicked. A broker that routes orders to high-quality liquidity pools will give you better results than one with a one-millisecond-faster feed. And execution quality is something you can actually measure by looking at your trade confirmations.
Corn
So focus on the outcome, not the spec sheet.
Herman
Second, if you're running algorithmic strategies through a broker's API, test your actual round-trip latency with a timestamped order. Don't trust the advertised specs. Send a small order, log the timestamps at each stage you can measure, and see what the real numbers are. The bottleneck is almost certainly the broker's API and execution infrastructure, not your internet connection.
Corn
And third?
Herman
Understand what data feed you're actually using. If you're trading on a consolidated feed — and most retail platforms use SIP data — you're seeing prices that are already stale by milliseconds. For most strategies, that doesn't matter. But if you're running something fast-moving, like scalping or news-based trading, those milliseconds might actually be relevant. In that case, consider whether a direct feed — or a broker that uses one — is worth the cost. But be honest about whether your strategy needs it.
Corn
And for most people, the honest answer is no.
Herman
For almost everyone. The direct feeds cost thousands a month. The SIP delay is one to five milliseconds. Unless your strategy's edge is measured in fractions of a millisecond — and if it is, you already know all of this and you're probably colocated — the SIP is fine.
Corn
So where does this leave us? The latency arms race isn't going away, but for most traders, it's a distraction from what actually matters.
Herman
And what matters is strategy, risk management, and execution quality. Latency is a solved problem for the pros — they've pushed it down to nanoseconds, and the remaining gains are marginal. The next frontier isn't lower latency, it's smarter algorithms that can predict market moves without needing to react faster. If you can anticipate a price movement rather than race to respond to it, latency becomes irrelevant.
Corn
Which brings us back to the AI trading bots being marketed to retail users. The pitch is that AI gives you professional-grade strategy. But the infrastructure gap — colocation, direct feeds, hardware optimization — isn't going away. If anything, it's widening. The question is whether smarter algorithms can compensate for slower infrastructure.
Herman
And that's the open question I think Daniel's prompt points toward. As these AI tools become more accessible, will the latency arms race trickle down? Or will the infrastructure gap between professional and retail traders only widen? My suspicion is the gap widens. The professionals aren't standing still — they're adopting AI too, and they're running it on colocated hardware with direct feeds. The retail trader gets a smarter bot, but it's still running on a home internet connection with SIP data. The relative disadvantage might actually increase.
Corn
So the real edge isn't in chasing milliseconds — it's in understanding where the milliseconds actually come from, and not being sold a spec that doesn't matter for your use case. That's the takeaway.
Herman
And if you want to do one thing after listening to this, ping your broker's server. If it's under twenty milliseconds, you can stop thinking about latency entirely and focus on what actually moves the needle.
Corn
And now: Hilbert's daily fun fact.

Hilbert: In the late sixteen hundreds, natural philosophers on the Yamal Peninsula believed that the vivid blue fluorescence of local fluorite deposits was proof that frozen mammoth remains were slowly turning into gemstones underground — a theory that persisted in Russian mineralogical texts for nearly a century before being abandoned.
Corn
So mammoths were just... future sapphires.
Herman
The geological patience required for that theory is almost admirable. Thanks, Hilbert.
Corn
This has been My Weird Prompts. Thanks to our producer Hilbert Flumingtop. If you enjoyed this, find us at my weird prompts dot com. We'll be back soon.

This episode was generated with AI assistance. Hosts Herman and Corn are AI personalities.