NVIDIA recently released the GH200 Grace Hopper super chip, achieving a comprehensive upgrade: larger memory, faster bandwidth!

Nvidia (Nvidia) recently released a new upgraded version of the next-generation super chip platform Grace Hopper GH200, designed to meet the needs of artificial intelligence and high-performance computing. The new generation of Grace Hopper GH200 super chip platform utilizes advanced HBM3e memory technology to significantly increase memory capacity and transfer rate

According to our understanding, NVIDIA first released the Grace Hopper super chip in March last year. Integrating CPU and GPU on one motherboard provides powerful computing capabilities for artificial intelligence and high-performance computing

HBM3e memory technology is a new high-bandwidth memory technology that can be provided in a smaller space Higher data transfer rates. The GH200 Grace Hopper super chip platform is an upgraded version, based on the 72-core Grace CPU and GH100 Hopper computing GPU, and introduces 480 GB ECC LPDDR5X memory and 141 GB HBM3e memory. HBM3e memory consists of six 24 GB stacks and uses a 6144-bit memory interface. It is worth noting that although 144 GB of memory is actually installed, the available memory is 141 GB

According to Nvidia, the new GH200 Grace Hopper super chip platform is equipped with 96 GB of HBM3 memory with bandwidth below 4 TB/s. In comparison, the memory capacity of the upgraded version has increased by about 50%, and the bandwidth has increased by more than 25%, reaching 5 TB/s. Such major improvements enable the new platform to better run larger artificial intelligence models than the original version, and significantly improve the performance of various tasks, especially training tasks

According to the editor’s understanding, it is equipped with HBM3 memory GH200 Grace The Hopper super chip platform has entered the production stage and is expected to begin commercial sales next month. The upgraded version of GH200 Grace equipped with HBM3e memory The Hopper super chip platform is currently undergoing sample testing and is expected to be officially launched in the second quarter of 2024.

Nvidia also emphasized that the new GH200 Grace Hopper chip platform uses the same Grace CPU and GH100 GPU chips as the original version, so the company does not need to launch any new versions or steps. This means that both the original and upgraded GH200 will exist on the market together, with the latter being sold at a higher price as it has more advanced memory technology and thus offers a higher level of performance

NVIDIA FINAL Said that the next-generation Grace Hopper super chip platform will fully comply with NVIDIA's MGX server specifications and can be directly compatible with existing server designs, providing users with more convenient upgrade and deployment options

The above is the detailed content of NVIDIA recently released the GH200 Grace Hopper super chip, achieving a comprehensive upgrade: larger memory, faster bandwidth!. For more information, please follow other related articles on the PHP Chinese website!