Cloudflare’s Gen 13 is a beast.
192 AMD EPYC Turin cores in a 2U box. That’s the headline. But here’s the kicker—they ditched massive L3 cache for sheer core count. With their Rust rewrite, FL2, workloads now crave threads over cache hoards. Smart? Or just chasing benchmarks?
Cloudflare Gen 13 server packs 768 GB DDR5-6400 memory, 24 TB PCIe 5.0 NVMe, dual 100 GbE NICs. Up to 2x throughput over Gen 12. 50% better performance per watt. Racks squeeze 60% more juice without power hikes. Sounds like a win. Except…
Why Trade Cache for Cores?
Gen 12’s AMD EPYC 9684X had 96 cores, 12 MB L3 per core—1152 MB total. King of cache. Gen 13’s Turin 9965? 192 cores, 2 MB per core—384 MB total. An 83% cache haircut. Ouch.
But FL2 changed everything. Cloudflare’s request layer, rewritten in Rust, scales linearly with cores. No more cache bottlenecks. They tested Turin 9755 (per-core beast), 9845 (power sipper), 9965 (core monster). 9965 won on requests per second and TCO. Aggregate throughput doubled. Per-watt? Solid at 500W TDP.
With the new software stack, Cloudflare’s request processing pipeline has become significantly less dependent on large L3 cache. FL2 workloads scale nearly linearly with core count, and the 9965’s 192 cores provide a 2x increase in hardware threads over Gen 12.
That’s their money quote. Fair. But let’s poke it.
Production evals don’t lie—or do they? Cloudflare’s lab says 9965 crushes. Yet per-core clocks dip: base 2.25 GHz vs Gen 12’s 2.4. All-core boost? 3.35 vs 3.42. You’re betting big on parallelism. If FL2 hiccups under weird loads? Cache starvation hits hard.
Memory jumps to 768 GB from 384. DDR5-6400 across 12 channels. Storage? Triple E1.S NVMe drives—Samsung PM9D3a or Micron 7600 Pro, 7.68 TB each. 1.5x capacity. Network? Dual 100 GbE OCP 3.0—Intel E830 or Mellanox ConnectX-6 Dx. Quad bandwidth over Gen 12’s 25 GbE twins.
Power supply bulks to 1300W Titanium. Handles accelerators better too. PCIe encryption hardware joins memory crypto. Thermals tuned for hot drops-ins.
Is Gen 13’s Efficiency Real or PR Spin?
50% performance/watt gain. Rack throughput up 60% at same power. Data center expansion? Delayed. Costs drop.
But wait. 500W TDP CPU vs 400W. System draws more—1300W PSU vs 800W. Efficiency per what? Rack? Sure. But absolute power creeps up. Cloudflare’s spinning TCO magic. Fine, if true.
Here’s my unique twist: this mirrors the 2010s storage shift. Spinning rust to SSDs—capacity exploded, but endurance and write amps bit back. Cores over cache? Software-first hardware. Rust’s thread safety enables it. Prediction: by 2026, every hyperscaler follows. Intel’s Xeon 6? AMD’s next Turin? Core counts skyrocket as AI edge workloads (less cache-hungry) dominate. Cloudflare’s ahead—again.
Skeptical? Test it. Their blog tables scream Genoa-X to Turin leap. But L3 per core tanks from 12 MB to 2 MB. Workloads evolved, they say. FL2 proves it.
And management? Same ASPEED BMC. Boring, reliable.
Short version: Gen 13 fits FL2 like a glove. Throughput doubles, latency SLAs hold. Racks denser. But it’s a software bet. Hardware’s now a sidekick.
Look, competitors like AWS Graviton or Azure’s Cobalt drool over custom silicon. Cloudflare sticks AMD. Why? Ecosystem. PCIe 5. Open standards. No lock-in drama.
One punchy caveat. 192 cores scream parallelism—but Rust’s no silver bullet. Concurrency bugs? They’ll surface. Gen 13 amplifies them.
Why Does Gen 13 Matter for Devs?
Devs on Cloudflare? Faster requests. Lower latency tails. Workers scale better. But it’s invisible. You pay for edge compute, not server guts.
Ops folks? Predict denser fleets. Cheaper scaling. FL2 + Gen 13 = Internet on steroids.
History buffs: remember Itanium? Cache wars killed it. No—software mattered. Same here. FL2 flips the script, just like Linux tamed x86.
Cloudflare’s not hyping blindly. They evaluated. Chose. Deployed. Respect.
But dry humor aside—is 192 cores overkill? For DDoS scrubbing, sure. For your blog? Nah.
🧬 Related Insights
Frequently Asked Questions
What are Cloudflare Gen 13 server specs?
192-core AMD EPYC 9965, 768 GB DDR5-6400, 24 TB NVMe, dual 100 GbE. 2U single socket.
Gen 13 vs Gen 12 performance?
2x throughput, 50% better perf/watt, 60% rack density gain. Same latency.
Why did Cloudflare pick AMD Turin 9965?
FL2 scales with cores, not cache. Best TCO in production tests.
