NVIDIA H100 AI accelerator card profit margin exceeds 90%! Cost $3,000, selling price $35,000

The popularity of NVIDIA AI accelerator cards is undeniable and has become the most popular product at the moment. Some analysts pointed out that the global demand for H100 is as high as 432,000 units, but the delivery cycle takes as long as 3-6 months

The price has been rising all the way, H100 has been sold for about 35,000 US dollars, and many times you can’t buy it even if you have money.

Weibo netizen "Boss Fantongdai" analyzed the material and hardware costs of H100 and put forward some interesting opinions based on relevant data.

The bill of materials (BOM) of H100 includes three main parts: core logic chip, HBM memory chip and CoWoS package. In addition, it also includes PCB circuit boards and other components, etc.

The H100 core logic chip has an area of ​​814 square millimeters and is manufactured using TSMC's 4N process (5nm). The price of a 300mm wafer at this node is US$13,400, with an area of ​​approximately 70,695 square millimeters. It can theoretically cut more than 80 wafers. H100, combined with the yield and loss, even if 65 pieces are good, the price per piece is about $##200$.

HBM3 memory chips are from South Korea's SK Hynix. There are six in total, each with a capacity of 16GB, and the price per GB is about 15 US dollars, totaling about

1500 US dollars - Yes, it is much more expensive than the core chip .

CoWoS packaging comes from TSMC technology, and the cost is unknown. However, TSMC's financial report stated that the CoWoS process accounts for 7% of revenue, and its customers are only NVIDIA and AMD. Based on this, analyst Robert Castellano estimates that manufacturing an H100 will cost $

$723. about.

The total of the three is about 2,500 US dollars, of which TSMC takes about 1,000 US dollars, and the other materials total about 3,000 US dollars

The gross profit margin of H100 exceeds 90%, which means it is very profitable!

Driven by H100, A100, A800 and other accelerator card products, NVIDIA's gross profit margin in the second quarter of this year has reached an astonishing 70%

Of course,

This is just pure hardware cost, and what is more precious than hardware is software and ecology. This is where NVIDIA is truly invincible, and this is where neither Intel nor AMD can match.

CUDA’s power and ease of use are well known, and are the result of NVIDIA’s decades of investment in tens of billions of R&D funds. Currently, NVIDIA has more than 20,000 software and hardware engineers worldwide

Excluding various costs, NVIDIA's net profit margin still remains at around 30-40%. This is their strength!

The above is the detailed content of NVIDIA H100 AI accelerator card profit margin exceeds 90%! Cost $3,000, selling price $35,000. For more information, please follow other related articles on the PHP Chinese website!