Engineering Deep Dive: How We Achieved <65ms Global Latency and Zero Egress Fees
Engineering Deep Dive: How We Achieved <65ms Latency and Zero Egress Fees
💡 Target Audience: CTOs and Senior Engineers focused on cloud architecture and cost optimization at scale.
Run communication infrastructure long enough and you meet the same wall twice. First, outbound transfer starts costing several times more than storage. Second, latency stops being an average and starts being a distribution — the p50 looks fine while the p95 quietly ruins the experience for a tenth of your users.
This post is about the two design decisions we made in response, how we measure whether they worked, and — just as importantly — what we do *not* claim.
Decision 1: media is served at the edge, and transfer is not metered
The economics of media in chat are counter-intuitive. Storage is billed once per month; delivery is billed once per view. A single popular attachment can cost more to serve in a week than to store in a year, and you cannot predict in advance which attachment that will be.
Our position is that a customer should never have to model that. So:
- Uploaded media is stored once and served from the edge location nearest the requester, not from a single origin region.
- Outbound transfer is not metered at all — on any plan, including the free tier. Storage above quota is $0.03/GB on paid plans — Free stops new uploads at its quota instead — which prices *holding* data rather than *serving* it.
- The variable that drives your bill becomes library size, which you control, instead of popularity, which you do not.
For a customer, the practical test is simple: take last month's outbound GB and multiply by your current provider's rate. That entire line item goes to zero and stays there.
Decision 2: the critical path stays inside one region
A message that travels Seoul → central database → Seoul pays for the round trip twice. So the hot path — connection state, channel membership, message fan-out — is handled in the region the user connected to. Cross-region propagation happens off the critical path, asynchronously, so a user in Frankfurt is never waiting on a lookup in Virginia to see their own message appear.
The trade-off is explicit and worth stating plainly: cross-region consistency is eventual, on the order of the network round trip between regions. For conversation, presence and delivery ordering within a channel, that is the correct trade. For workloads that need strict global linearisability, it is not — and you should choose accordingly.
How we measure — and how you should verify
A single latency number in a marketing table is close to meaningless without its measurement conditions. Here are ours:
| Parameter | Value |
|---|---|
| Metric | client publish → client receive (end-to-end, not server-side processing) |
| Percentiles | p50 and p95, not average |
| Markets sampled | Seoul, Tokyo, Frankfurt, US East |
| Pairing | same-region client pairs |
| Result | p50 < 65 ms · p95 < 150 ms |
Three honest caveats:
- Cross-continent pairs are bounded by physics. Seoul ↔ São Paulo will not be 65 ms on our platform or anyone else's. Light in fibre plus routing is the floor, and no architecture negotiates with it.
- Averages hide the problem. If a vendor quotes only an average, ask for p95 — that is where a bad architecture shows.
- Reproduce it yourself. Instrument publish-to-receive in your own app, from your own users' devices, before any vendor's number (including ours) enters a decision document.
What we deliberately do not claim
- We do not claim a fixed number of regions or points of presence. Those numbers change, and a vendor's PoP count is not a proxy for *your* users' latency — your traffic's geography is.
- We do not claim strict global consistency. See Decision 2.
- We do not claim zero cost. We claim **zero *transfer* cost**, with everything else published as a rate card rather than quoted per deal.
What this buys you as a customer
- A bill you can model a year out. Every rate is published; nothing is per-user; transfer is free.
- A latency profile that does not degrade as you add regions of users — because their sessions terminate near them rather than at a single origin.
- No architectural work on your side. There is no CDN to configure, no cache-invalidation policy to own, no origin shield to tune. Upload a file, share it, done.
The 30-second version
Two decisions: serve media at the edge and stop metering transfer; keep the real-time critical path inside one region and reconcile across regions asynchronously. The first makes cost predictable, the second makes latency predictable — and both are worth exactly as much as your own measurements say they are.
Frequently asked questions
Is outbound transfer free up to a limit?
There is no limit. Outbound transfer is not a metered unit on any plan, including the free tier. Storage above your plan quota is billed at $0.03/GB per month on paid plans; the Free plan stops new uploads at its quota rather than billing for the excess. Either way the charge prices holding data, not serving it.
Are the latency figures guaranteed in an SLA?
No — they are measurements, not guarantees. p50 under 65 ms and p95 under 150 ms are end-to-end client-publish to client-receive figures for same-region pairs in Seoul, Tokyo, Frankfurt and US East. Cross-continent paths are bounded by physics on any platform, so instrument your own app before relying on any vendor number.
What consistency model should we assume?
Within a channel and a region, delivery ordering and presence behave as you would expect for conversation. Across regions, consistency is eventual on the order of the inter-region round trip. If your workload needs strict global linearisability, that is a genuine mismatch and you should design around it.
Do we need to configure a CDN or cache policy?
No. There is no CDN to set up, no cache-invalidation policy to own and no origin shield to tune. Media is stored once and served from the location nearest the requester automatically.
Related articles

HyperBabel vs Twilio (2026): The Terror of Fragmented SDKs and Egress Fees
Legacy infrastructures hide massive outbound data (Egress) transfer costs. Find out how HyperBabel's unified architecture paired with Global CDN Edge provides a Zero Egress, transparent experience.
Real-time AI Translation, Built Into the Wire: How HyperBabel Translates 100+ Languages Without an Add-On
Most chat APIs treat translation as a third-party plugin you bolt on after the fact. HyperBabel runs translation in the message pipeline itself — same channel, same SDK, same API key. Here's how it works and why it matters for global apps.
[Playbook] Zero-Downtime Infrastructure Migration: Running Legacy and HyperBabel in Parallel
You don't need to migrate all users at once. Discover how to safely transition with zero risk using the "Strangler Fig Pattern" by routing new chat rooms to HyperBabel while temporarily leaving older rooms on the legacy infrastructure.
