search
HomeTechnology peripheralsAITencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

The new generation HCC high-performance computing cluster uses the latest generation of Xinghai self-developed servers and is equipped with NVIDIA H800 Tensor Core GPU.

Tencent officials said that the cluster is based on self-developed network and storage architecture, bringing 3.2T ultra-high interconnect bandwidth, TB-level throughput capacity and tens of millions of IOPS. Actual measurement results show that the computing power performance of the new generation cluster is improved by 3 times compared with the previous generation.

Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

In October last year, Tencent completed the training of the first large-scale AI model with one trillion parameters - the Hunyuan NLP large model. With the same data set, the training time is shortened from 50 days to 11 days. If based on a new generation cluster, the training time will be further reduced to 4 days.

At the computing level, server stand-alone performance is the basis of cluster computing power. The single GPU card of Tencent Cloud's new generation cluster supports output of up to 1979 TFlops of computing power under different precisions.

For large model scenarios, Xingxinghai’s self-developed server adopts a 6U ultra-high-density design, which is 30% higher than the industry’s supported shelf density; using the parallel computing concept, through the integrated design of CPU and GPU nodes, Improve single-point computing power performance to a higher level.

Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

#At the network level, there are massive data interaction requirements between computing nodes. As the cluster scale expands, communication performance will directly affect training efficiency, requiring maximum collaboration between the network and computing nodes.

Tencent’s self-developed Xingmai high-performance computing network claims to have the industry’s highest 3.2T RDMA communication bandwidth. Actual measurement results show that equipped with the same number of GPUs, the 3.2T Xingmai network has a 20% increase in the overall computing power of the cluster compared to the 1.6T network.

At the same time, Tencent’s self-developed high-performance collective communication library TCCL is integrated into custom-designed solutions. Compared with the industry's open source collective communication library, it optimizes 40% load performance for large model training and eliminates training interruption problems caused by multiple network reasons.

Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

At the storage level, during large model training, a large number of computing nodes will read a batch of data sets at the same time. It is necessary to shorten the data loading time as much as possible to avoid waiting for computing nodes.

Tencent Cloud’s self-developed storage architecture has terabyte-level throughput capabilities and tens of millions of IOPS, supporting storage needs in different scenarios. COS GooseFS object storage solution and CFS Turbo high-performance file storage solution fully meet the high performance, large throughput and massive storage requirements in large model scenarios.

Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

In addition, the new generation cluster integrates Tencent Cloud’s self-developed TACO training acceleration engine, which performs a large number of system-level optimizations on network protocols, communication strategies, AI frameworks, and model compilation. Significantly save training tuning and computing power costs.

AngelPTM, the training framework behind Tencent’s Hunyuan large model, has also provided services through Tencent Cloud TACO to help enterprises accelerate the implementation of large models.

Through the large model capabilities and toolbox of Tencent Cloud TI platform, enterprises can conduct fine-tuned training based on industrial scenario data, improve production efficiency, and quickly create and deploy AI applications.

Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times

Relying on the distributed cloud-native governance capabilities, Tencent Cloud Intelligent Computing Platform provides 16 EFLOPS of floating-point computing power.

The above is the detailed content of Tencent releases a new generation of super computing cluster: for large model training, performance increased by 3 times. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
Are You At Risk Of AI Agency Decay? Take The Test To Find OutAre You At Risk Of AI Agency Decay? Take The Test To Find OutApr 21, 2025 am 11:31 AM

This article explores the growing concern of "AI agency decay"—the gradual decline in our ability to think and decide independently. This is especially crucial for business leaders navigating the increasingly automated world while retainin

How to Build an AI Agent from Scratch? - Analytics VidhyaHow to Build an AI Agent from Scratch? - Analytics VidhyaApr 21, 2025 am 11:30 AM

Ever wondered how AI agents like Siri and Alexa work? These intelligent systems are becoming more important in our daily lives. This article introduces the ReAct pattern, a method that enhances AI agents by combining reasoning an

Revisiting The Humanities In The Age Of AIRevisiting The Humanities In The Age Of AIApr 21, 2025 am 11:28 AM

"I think AI tools are changing the learning opportunities for college students. We believe in developing students in core courses, but more and more people also want to get a perspective of computational and statistical thinking," said University of Chicago President Paul Alivisatos in an interview with Deloitte Nitin Mittal at the Davos Forum in January. He believes that people will have to become creators and co-creators of AI, which means that learning and other aspects need to adapt to some major changes. Digital intelligence and critical thinking Professor Alexa Joubin of George Washington University described artificial intelligence as a “heuristic tool” in the humanities and explores how it changes

Understanding LangChain Agent FrameworkUnderstanding LangChain Agent FrameworkApr 21, 2025 am 11:25 AM

LangChain is a powerful toolkit for building sophisticated AI applications. Its agent architecture is particularly noteworthy, allowing developers to create intelligent systems capable of independent reasoning, decision-making, and action. This expl

What are the Radial Basis Functions Neural Networks?What are the Radial Basis Functions Neural Networks?Apr 21, 2025 am 11:13 AM

Radial Basis Function Neural Networks (RBFNNs): A Comprehensive Guide Radial Basis Function Neural Networks (RBFNNs) are a powerful type of neural network architecture that leverages radial basis functions for activation. Their unique structure make

The Meshing Of Minds And Machines Has ArrivedThe Meshing Of Minds And Machines Has ArrivedApr 21, 2025 am 11:11 AM

Brain-computer interfaces (BCIs) directly link the brain to external devices, translating brain impulses into actions without physical movement. This technology utilizes implanted sensors to capture brain signals, converting them into digital comman

Insights on spaCy, Prodigy and Generative AI from Ines MontaniInsights on spaCy, Prodigy and Generative AI from Ines MontaniApr 21, 2025 am 11:01 AM

This "Leading with Data" episode features Ines Montani, co-founder and CEO of Explosion AI, and co-developer of spaCy and Prodigy. Ines offers expert insights into the evolution of these tools, Explosion's unique business model, and the tr

A Guide to Building Agentic RAG Systems with LangGraphA Guide to Building Agentic RAG Systems with LangGraphApr 21, 2025 am 11:00 AM

This article explores Retrieval Augmented Generation (RAG) systems and how AI agents can enhance their capabilities. Traditional RAG systems, while useful for leveraging custom enterprise data, suffer from limitations such as a lack of real-time dat

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.