Microsoft has made waves in the tech industry by unveiling its latest custom-designed CPU, the 4th generation 9V64H, during the Ignite conference. This powerful processor, developed in collaboration with AMD and Nvidia, boasts an impressive 96 cores and utilizes cutting-edge InfiniBand technology, although it will only be available on Azure cloud services.
Key Takeaways
- 96 Cores: The 9V64H features 96 cores, with 8 cores allocated for overhead tasks.
- InfiniBand Technology: Incorporates Nvidia’s Quantum-2 InfiniBand for high-speed data transfer.
- Memory Bandwidth: Capable of delivering nearly 7.0TBps of memory bandwidth.
- Target Applications: Designed for memory-intensive HPC applications, including simulations and energy research.
- Availability: The CPU will be available exclusively on Azure, with a preview access request option.
A New Era of Processing Power
At the Ignite conference, Microsoft CEO Satya Nadella introduced the 9V64H as a custom-built AMD processor tailored for Azure’s cloud computing infrastructure. This CPU is not based on the latest 5th generation EPYC architecture but is a 4th generation model that significantly outperforms existing processors in the market.
The 9V64H is clocked at speeds of up to 4GHz, making it a formidable competitor to other high-performance CPUs. The closest existing model is the AMD 9634, which has 84 cores and a maximum speed of 3.7GHz.
Unmatched Memory Capabilities
One of the standout features of the 9V64H is its memory capabilities. When deployed in clusters of four within Azure HBv5 virtual machines, it can access up to 450GB of HBM3 RAM. This configuration allows for a staggering combined memory bandwidth of nearly 7.0TBps, surpassing the performance of AMD’s Instinct MI300A accelerator.
Unique Design Features
The 9V64H is notable for being AMD’s first quad-socket project, a design choice that caters to hyperscale clients with extensive processing needs. Microsoft has confirmed that the chip is SMT-disabled, similar to other recent AMD architectures, allowing for a maximum of 3.17TB of memory access, equating to approximately 9GB per core.
InfiniBand Integration
In a strategic move, Microsoft enlisted Nvidia to provide its industry-leading Quantum-2 InfiniBand networking technology. This integration allows the 9V64H to maintain high data throughput, with speeds of 800 Gb/s distributed evenly across the four CPUs. This capability is crucial for customers looking to scale their workloads efficiently across hundreds of thousands of cores.
Advanced Storage Solutions
Additionally, the 9V64H will feature a local NVMe SSD with a capacity of 14TB, offering exceptional read and write speeds of up to 50GB/s and 30GB/s, respectively. This performance is significantly higher than what is typically achievable with standard PCIe Gen5 technology, showcasing the advanced capabilities of this new CPU.
Conclusion
The introduction of Microsoft’s 4th generation 9V64H CPU marks a significant advancement in cloud computing technology. With its impressive core count, memory bandwidth, and integration of InfiniBand technology, this CPU is set to redefine the capabilities of Azure’s cloud services, although it remains exclusive to Microsoft’s platform. As the demand for high-performance computing continues to grow, the 9V64H positions Microsoft at the forefront of this evolving landscape.
Via Microsoft
