Chinese masters take action, AMD graphics card AI "alchemy" ability has caught up: RTX 4090 80% performance

Quick Technology News on August 13th, in addition to playing games, NVIDIA’s graphics cards are also far ahead in AI acceleration. Not only technology giants are competing for A100/H100 and other graphics cards, GeForce game cards are also the choice for ordinary people to engage in AI alchemy. AMD graphics cards lag far behind in this regard.

The good news is that AMD can now catch up. The Chinese master in the field of deep learning and OctoML CTO Chen Tianqi led the team to make a large model inference solution on AMD graphics cards. This means that the industry has another There are options other than NVIDI, so you don’t have to worry about competing for N cards and increasing prices.

According to his optimization algorithm, in the 7B and 13B large models of Llama2, the RX 7900 XTX graphics card can also achieve satisfactory performance. The performance has reached 82% of the RTX 4090 graphics card or RTX 3090 Ti 94% level of graphics card.

Not only has the performance caught up, but the price/performance ratio of AMD graphics cards is also much higher. The RX 7900 XTX and the other two graphics cards both have 24GB of video memory, but they only cost 999 US dollars, while the RTX 4090 and RTX 3090 Ti are 1,599 and 1,999 yuan respectively. , the price is 60-100% higher.

Of course, the current price of RX 7900 XTX has long been loosened, and the actual selling price is much cheaper than US$999, while the price of N cards has remained strong.

The fundamental reason is that the improvement of A card in AI alchemy ability, especially the qualitative change of game cards like RX 7900 The support is very poor. In April, it not only supported Windows systems, but also added support for RX 7900 and workstation graphics cards.

At the same time, AMD also released the ROCm HIP SDK, which allows developers to easily migrate the code developed for the CUDA platform to the AMD platform. This is the basis for Chen Tianqi and other experts to promote the improvement of AI capabilities on AMD graphics cards.

The above is the detailed content of Chinese masters take action, AMD graphics card AI "alchemy" ability has caught up: RTX 4090 80% performance. For more information, please follow other related articles on the PHP Chinese website!