The new "Gen 12" servers are equipped with AMD's EPYC 96-Core 9684X Genoa-X processor, which boasts over one gigabyte of L3 cache. These powerful systems feature an impressive 384GB of DDR5 4800MHz memory operating across 12 channels, dual E1.S NVMe Samsung PM9A3 7.68TB or Micron 7450 Pro 7.68 TB SSDs, dual 25GbE Intel or Nvidia Mellanox networking, and a robust 800W titanium grade PSU.
Before selecting the 9684X, Cloudflare conducted a comprehensive evaluation of the available CPU landscape to identify the most suitable model for its needs. The company meticulously analyzed various candidates in its labs, ultimately narrowing down the field to three AMD CPUs – the EPYC 9654, EPYC 9754, and the EPYC 9684X. Notably, all Intel Xeon CPUs were eliminated from consideration during this process.
The EPYC 9654 represents the standard (non-X3D) version of the 9684X, equipped with 96 cores, 192 threads, 384MB of L3 cache, and a maximum turbo clock of 3.7GHz. The EPYC 9754, on the other hand, is a Bergamo Zen 4c powered CPU, featuring 128 cores, 256 threads, 256MB of L3 cache, and a maximum boost clock of 3.1GHz. The standout 9684X shares the same core specifications as the 9654 but boasts a staggering 1,152GB of total L3 cache.
To benchmark these chips, Cloudflare compared their performance against its previous generation 11th-gen servers, powered by the 64-core AMD EPYC 7713. The 9654, 9754, and 9684X were configured to their maximum configurable TDP of 400W, whereas the EPYC 7713's maximum TDP is limited to 240W. All the chips were meticulously evaluated under realistic workloads, ensuring each server was configured to run the same processes and services as its production counterparts.
The results of Cloudflare's AMD EPYC benchmarking process were nothing short of impressive. All three contenders demonstrated at least a 2x performance improvement over the previous EPYC 7713 CPUs. The Genoa 9654 achieved exactly 2x the speed, the Bergamo 9754 delivered a 2.15x speedup, and the Genoa-X 9684X emerged as the clear champion with a remarkable 2.45x performance increase.
In terms of efficiency, Cloudflare discovered that the Genoa 9654 was 33% more power-efficient than the EPYC 7713, while the Bergamo 9754 exhibited a 38% improvement in efficiency. The 9684X, however, proved to be the most efficient of the bunch, boasting a substantial 63% improvement in power efficiency.
Cloudflare provided detailed insights into the performance enhancements offered by AMD's 3D V-Cache technology, highlighting a significant 22.5% performance delta between the 9654 and 9684X in its tests. The company explained that its workload benefits from more accessible low-level caches, effectively avoiding trips to the DDR5 memory, which introduces substantial system latency.
It's worth noting that the 9684X delivered this remarkable 22.5% performance improvement while operating within the same power envelope as the 9654. While the 9684X's 3D-stacked L3 cache does consume additional power, the difference only affected maximum all-core turbo clock speeds by a negligible 3%.
These compelling results clearly explain why Cloudflare opted for the 96-core EPYC 9684X for its 12th-gen servers. Its specific applications leverage the substantial cache advantage offered by AMD's 3D V-Cache equipped Genoa-X CPUs, resulting in a significant performance boost that surpasses even the EPYC 9754 with its 128 cores.
This upgrade signifies a major leap forward for Cloudflare's server infrastructure, enabling them to deliver even more reliable and performant services to their global customer base. The integration of AMD's latest generation EPYC processors underscores Cloudflare's commitment to staying at the forefront of technological innovation, providing a testament to the power and efficiency of AMD's 3D V-Cache technology.
0 comments:
Post a Comment