search
HomeTechnology peripheralsAIFeature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the 'chain master'

SenseTime launched the operation of the Artificial Intelligence Computing Center AIDC in the Lingang New Area of ​​the Shanghai Free Trade Zone on January 24, 2022. At that time, the artificial intelligence company may not be able to accurately predict that 2022 will become the first year of the so-called AIGC (AI Generated Content).

“Today, our Lingang AIDC has nearly 30,000 GPUs (graphics processing units), and our current computing power has reached 5,000 PetaFLOPS (1 PetaFLOPS is equal to 1 quadrillion floating point operations per second). On top of this, we believe that we can have better developer efficiency in the future and be able to support more large-scale model computing power training with a scale of hundreds of billions." On June 2, "AI leads the era, computing power drives the future" - — Xu Li, chairman and CEO of SenseTime Technology, said at the Lingang New Area Intelligent Computing Conference.

SenseTime told reporters from The Paper (www.thepaper.cn) that there are still many demands waiting to be processed. According to Yang Fan, co-founder of SenseTime and president of the large device business group, artificial intelligence’s pursuit of larger data, larger scale, and greater computing power did not “start today.” “The entire artificial intelligence technology iteration, The history of progress can be seen as a pursuit of 'aesthetics of violence' and a technological iteration process in which the three elements of algorithm, computing power and data change from quantitative to qualitative."

The Lingang New Area, which focuses on cutting-edge industries, responded quickly to this new craze. On June 2, Wu Xiaohua, deputy secretary of the Party Working Committee of Lingang New Area, released the "Action Plan for Accelerating the Construction of Computing Industry Ecosystem in Lingang New Area" at the above-mentioned conference. Under the blueprint of the "Plan", by 2025, Lingang will become a computing power industry cluster with national influence, and the overall scale of the computing power industry, including related hardware, software, applications, services, etc., will exceed 10 billion yuan.

Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the chain master

Wu Xiaohua, deputy secretary of the Party Working Committee of Lingang New Area, released the "Action Plan for Accelerating the Construction of Computing Industry Ecosystem in Lingang New Area".

"We see that the era of AI explosion has arrived. AI has entered all areas of our production and life. With the explosion of AI applications, it has actually driven an explosion in the demand for computing power." For After the introduction of the above-mentioned "Plan", Lu Yu, director of the High-tech Division of the Lingang New Area Management Committee, told media including The Paper (www.thepaper.cn) that Lingang already had good advantages in the early stage, "That's us. The computing power resources are very abundant.”

More importantly, when artificial intelligence companies choose whether to land in Lingang, computing power resources have become a particularly important decision-making factor.

Computing power is the energy of the new era, and success lies not only in “aesthetics of violence”

What is computing power? Xu Li believes that computing power is actually an expression of the entire model’s capabilities. “Computing power is equal to the parameters of the algorithm or large model, multiplied by the amount of data it processes. In the era of large models, the larger the parameters, the greater the amount of data multiplied. , the greater the computing power required." Computing power has become the energy source of the new era. "To a certain extent, computing power determines the competitiveness of the market."

Yang Fan also mentioned that from last year to this year, a very popular concept in the field of artificial intelligence is called content generation. At the same time, everyone is familiar with the term large model. To put it simply, this is a "violent aesthetic". For example, the GPT-3 model uses more than 175 billion parameters and requires a high-performance processor to support training. The V100 training consumes 10,000 cards for 14.8 days. , the overall computing power requirement is about 625 PetaFLOPS.

Yang Fan believes that this “aesthetics of violence” can also be understood as quantitative changes leading to qualitative changes. “In fact, from the first day of its birth to today, artificial intelligence has been pursuing greater intelligence through scale. " He mentioned that in fact, in the field of artificial intelligence, in the past 5-6 years, the consumption of computing power by the industry's top artificial intelligence models "has doubled every 4-6 months. , which means that it has increased nearly 300,000 times in the past few years.”

Of course, "violence" and "intelligence" are not completely proportional. "Having larger resources and a larger scale is only a necessary but not sufficient condition." Yang Fan emphasized that the real "aesthetics of violence" "What supports major technological innovations and achievements lies in the continuous optimization and improvement of every link.

Take data as an example, "The data used by GPT-4 is actually only 1% of all the data collected by OpenAI, because he found that when more data is fed into the robot, it may become less smart. More effective and higher-value data should be provided to this algorithm, and then a smarter brain can be created."

It believes that, at least today, the validity of data is far more important than the total amount of data. As for how to define effective data, "This actually requires a lot of efforts from data scientists. OpenAI actually lets their best scientists do the data, not the algorithms as everyone thinks."

This kind of optimization of every link also includes computing power. When Nvidia is out of stock, why is no one using domestic chips for commercial large-scale training? Why did Nvidia make all the money immediately after the latest wave arrived? The explanation behind these questions is, "It is not that we can generate the final value by stacking the computing power to a certain value. Putting 1,000 cards and 100 servers together to run the same task requires a lot of supporting software and communications. Network, it is a series of joint optimization processes of software and hardware. We have not done this kind of work in the past, and we need to make up for it today."

Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the chain master

Following the trend, Lingang accelerates the formation of a diversified computing power supply system

According to Wu Xiaohua, the computing power industry in Lingang New Area has made corresponding arrangements in upstream software and hardware, midstream data centers, dispatching platforms, and downstream applications. Currently, the total computing power of Lingang exceeds 3EFLOPS (FP32, 1EFLOPS is equal to one second) 10 billion floating-point operations), of which intelligent computing power accounts for nearly 80%, and the total computing power accounts for nearly 20% of Shanghai.

The aforementioned "Plan" proposes that by 2025, the new area will form a multiple computing power supply system that focuses on intelligent computing power and coordinates basic computing power and super computing power, with a total computing power exceeding 5EFLOPS (FP32). The proportion of AI computing power has reached 80%, and the overall scale of the computing power industry (including related hardware, software, applications, services, etc.) has exceeded 10 billion yuan. A public computing power service platform has been established, the computing power trading mechanism has been standardized, and regional computing power scheduling has been realized. Create a computing power industry cluster with national influence and build a number of benchmark scenarios for computing power demonstration applications.

“Intelligent computing power is what the most popular AI companies need at the moment. We have also found that when AI companies come to Lingang, they no longer just focus on how much policy support and subsidies they can give them. Pay attention to whether the implementation here can solve his computing power needs, because computing power is now in very short supply in the market." Lu Yu mentioned this significant change.

SenseTime said that as of May this year, SenseTime large devices have provided services to more than 40 core customers. "Especially under the wave of large models, we now support more than 10 institutions to train their large models in the intelligent computing center in Lingang." Yang Fan also mentioned.

Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the chain master

Shenzhen Technology, founded in 2018, is one of the demanders for computing power. The company's core team is led by E Weinan, an academician of the Chinese Academy of Sciences, and others. It is a pioneer in the "AI Science" scientific research paradigm. Its first "multi-scale modeling machine learning high-performance computing" paradigm has achieved a breakthrough in multi-scale molecular modeling. Unifying accuracy and efficiency in simulation.

According to previous reports by reporters from The Paper (www.thepaper.cn), Shenzhen Technology has launched the Lebesgue scientific computing platform, the Hermite drug design platform, and the Bohrium microscopic computing and design platform. For example, in the field of medicine, Shenzhen Technology has joined hands with many customers to integrate the computing paradigm of physical modeling AI with preclinical drug research and development more broadly. Through Hermite Uni-FEP, Uni-Fold, RiD and other modules, free energy microscopy Combining interference theory, molecular dynamics, enhanced sampling algorithms and high-performance computing to accurately predict protein structure and conformational changes, and efficiently evaluate the binding free energy of proteins and ligands with chemical precision, providing efficient and accurate theoretical guidance for drug developers , improve the efficiency of drug design and optimization.

On December 29 last year, Beijing-based Shenzhen Technology registered and established Shenzhen Energy Biotechnology (Shanghai) Co., Ltd. in Lingang. In an interview with a reporter from The Paper (www.thepaper.cn), Liu Huishi, Vice President of Government and Enterprise Affairs of Shenzhen Technology, said that the company’s deployment of a new generation molecular simulation algorithm research and development center and an AI-assisted drug design business center in Lingang was mainly due to the Da Lingang is vigorously developing computing power. "We have a demand for computing power during the training of the model. In addition, Lingang is especially vigorously developing localized computing power. We also want to contribute to this aspect."

We mainly conduct drug research and development business layout in Lingang, including the research and development of our own drug pipeline. " Liu Huishi mentioned that Shenzhen Technology's business has a positive and direct cooperative relationship with leading industries such as artificial intelligence and biomedicine in Lingang and even Shanghai. "We are willing to incorporate our R&D and products into the large-scale Lingang Come into the ecosystem. ”

The above-mentioned "Plan" also mentioned that the Lingang New Area has also formulated a series of safeguard measures, including strengthening talent protection, improving support policies, and promoting open cooperation. According to Lu Yu, if AI companies come to Lingang, they will give priority to Lingang’s intelligent computing power, and at the same time, through the issuance of computing power coupons and other forms, companies will be able to use computing power at a preferential price. “Even for key AI companies, the government will The computing power cost can be directly subsidized by no more than 30%, and we will come up with these policies.”

At this conference, China Telecom’s Lingang public intelligent computing service platform and domestic GPU joint innovation base were also officially launched, which is worth noting. China Telecom established Lingang Computing Power (Shanghai) Technology Co., Ltd., which will carry out the construction of Lingang Computing Power Park and launch 40,000 high-power racks suitable for intelligent computing and supercomputing in batches.

Tang Wenkan, deputy director of the Shanghai Municipal Economic and Information Commission, said on the same day that currently, the new generation of information infrastructure with "network as the basis, data as the core, computing power as the key, and security as the bottom line" has become an important step in building modern industries. Basic support. Shanghai has proposed to build a "2 (3 6) (4 5)" modern industrial structure, which places higher demands on the construction of new information infrastructure represented by computing power.

On May 16, the Shanghai Municipal Commission of Economy and Information Technology announced the list of data center projects that have passed the compliance assessment of the "Shanghai Data Center Construction Guidelines", supporting a total of 16 projects, including one located in Lingang There are 2 projects. "So far, our committee has supported 8 projects in the new area, including SenseTime AIDC, Youfu Networks, and Information Feiyu, with a total of 28,000 6kW standard cabinets, accounting for nearly 1/5 of the city's approved cabinets."

Tang Wenkan suggested making full use of Lingang’s computing resources and establishing public computing services. "At present, Lingang's SenseTime AIDC has been connected to the public computing service platform. I also hope that all units participating in the meeting today, especially telecom operators, will actively build extremely fast computing in Lingang based on the network characteristics of Lingang. The power carrying network helps realize the ubiquitous network, ubiquitous computing power, and omnipresent intelligence, and promotes computing power to become a public service like water and electricity."

Established the Intelligent Computing Industry Alliance, with SenseTime becoming the leader of the industry chain

Lingang’s goal is to create a computing power industry alliance that integrates upstream, midstream and downstream, which can meet current and future needs in a collaborative and systematic manner and utilize existing advantages to achieve development.

Lu Yu regards Lingang’s computing power supply as the “middle section” of the entire industry chain. One end provides computing power guarantees for AI companies that have settled in Lingang, and the other end involves computing power that is extremely critical. "Chips, software, systems", "We hope that there will be a demand side and such a platform side, then we will gather computing chip companies, software companies, and system companies here to let them deeply participate in such a system. During the construction process."

Yang Fan also emphasized, “The development of all the achievements of large models seen today is not only the miracle of violence, the improvement of technical value brought about by the continuous increase in the scale of the three elements of artificial intelligence, but also the basic research and development capabilities and The in-depth integration of the system's engineering capabilities, algorithm optimization, data sorting and selection, and optimization of platform computing power. These three are often interconnected, and it is difficult to turn them into separate links and do it alone. ”

He said that the important value of the intelligent computing power industry chain is that “Only when there are more companies in the chain, and everyone promotes mutual exchanges and thinking, and carries out more in-depth cooperation, can we be able to compete in such a new critical situation. To achieve better technological progress and support in the major technological wave."

Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the chain master

At the conference site, the New Area Intelligent Computing Industry Alliance was formally established, and China Unicom was appointed as the alliance’s first rotating chairman unit. It is reported that China Unicom will establish the Yangtze River Delta Innovation Research Institute in the new area in the future to further assist the development of the intelligent computing industry in the new area.

Members of the Intelligent Computing Industry Alliance in the New Area are represented by companies providing computing power such as intelligent computing power, basic computing power and supercomputing power centers, GPU, FPGA, ASIC and other computing power chip companies, as well as large model, AI for science It consists of a total of 25 companies that require computing power, as well as three universities and research institutes, including the East China Branch of the China Academy of Information and Communications Technology, Xi'an University of Electronic Science and Technology of China, and University of Electronic Science and Technology of China. Resource sharing, technical exchanges, and project cooperation will be carried out in the future. SenseTime was awarded the title of “Intelligent Computing Industry Chain Leader in the New Area”.

GPU chip manufacturer Mu Xi said on the same day that three types of GPU products that meet AI inference computing, AI training/general computing, and high-performance rendering functions can be used in AI inference, AI training, data centers, metaverse, and cloud games. and other fields, will empower the transformation and development of various fields.

Tang Wenkan also has high hopes for the establishment of the Intelligent Computing Industry Alliance in the Lingang New Area. “Relying on chain owners such as SenseTime, combined with its own advantages, we will explore the collaboration of all elements of the upstream and downstream of the industrial chain to form a new digital economy. Breaking point."

Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the chain master

12 companies jointly signed a collaborative procurement agreement for upstream and downstream enterprises in the intelligent computing industry in the new area at the conference that day. Lu Yu mentioned that the new area will also issue a positive list of collaborative procurement. “If companies purchase upstream products such as domestic GPUs during the process of building a localized computing platform, we will provide subsidies. This will also encourage upstream and downstream companies to upgrade. Good cooperation."

The above is the detailed content of Feature article|The demand for computing power explodes under the boom of AI large models: Lingang wants to build a tens of billions industry, and SenseTime will be the 'chain master'. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:搜狐. If there is any infringement, please contact admin@php.cn delete
AI大模型非常昂贵 只有大企业和超级富豪才能玩得转AI大模型非常昂贵 只有大企业和超级富豪才能玩得转Apr 15, 2023 pm 07:34 PM

ChatGPT大火带动AI又一波热潮,不过业界普遍认为,当AI步入大模型时代,只有大企业和超级富有的企业才玩得起AI,因为AI大模型的打造非常昂贵。首先是计算昂贵。多伦多大学市场营销教授AviGoldfarb说:“如果你想创办一家企业,自己开发大语言模型,自己计算,成本太高了。OpenAI是很贵的,要数以十亿计的美元。”租赁计算当然会便宜不少,但企业仍然要向AWS等企业支付昂贵费用。其次是数据昂贵。训练模型需要海量数据,有时数据是现成的,有时不是。CommonCrawl和LAION等数据可以免费

AI大模型浪潮下算力需求爆增,商汤“大模型+大算力”赋能多产业发展AI大模型浪潮下算力需求爆增,商汤“大模型+大算力”赋能多产业发展Jun 09, 2023 pm 07:35 PM

近日,以“AI引领时代,算力驱动未来”为主题的“临港新片区智算大会”举行。会上,新片区智算产业联盟正式成立,商汤科技作为算力提供企业成为联盟一员,同时商汤科技被授予“新片区智算产业链链主”企业。作为临港算力生态的积极参与者,商汤目前已建设了亚洲目前最大的智能计算平台之一——商汤AIDC,可以输出5000Petaflops的总算力,可支持20个千亿参数量的超大模型同时训练。以AIDC为底座、前瞻打造的商汤大装置SenseCore,致力于打造高效率、低成本、规模化的下一代AI基础设施与服务,赋能人工

面向AI的数据治理体系如何构建?面向AI的数据治理体系如何构建?Apr 12, 2024 pm 02:31 PM

近年来,随着新技术模式的出现,各行业应用场景价值打磨与海量数据积累下的产品效果提升,人工智能应用已从消费、互联网等领域,向制造、能源、电力等传统行业辐射。各行业企业在设计、采购、生产、管理、销售等经济生产活动主要环节的人工智能技术和应用成熟度在不断提升,加速人工智能在各环节的落地覆盖,逐渐将其与主营业务相结合,以实现产业地位提高或经营效益优化,进一步扩大自身优势。人工智能技术创新应用的大规模落地,推动了大数据智能市场的蓬勃发展,同样也为底层的数据治理服务注入了市场活力。伴随着大数据、云计算以及算

科普:什么是AI大模型科普:什么是AI大模型Jun 29, 2023 am 08:37 AM

AI大模型是指使用大规模数据和强大的计算能力训练出来的人工智能模型。这些模型通常具有高度的准确性和泛化能力,可以应用于各种领域,如自然语言处理、图像识别、语音识别等。AI大模型的训练需要大量的数据和计算资源,通常需要使用分布式计算框架来加速训练过程。这些模型的训练过程非常复杂,需要对数据的分布、特征的选择、模型的结构等方面进行深入的研究和优化。AI大模型的应用范围非常广泛,可以用于各种场景,如智能客服、智能家居、自动驾驶等。在这些应用中,AI大模型可以帮助人们更快速、更准确地完成各种任务,提高工

AI大模型时代,数据存储新基座助推教科研数智化跃迁AI大模型时代,数据存储新基座助推教科研数智化跃迁Jul 21, 2023 pm 09:53 PM

生成式AI(AIGC)开启了人工智能通用化的新纪元,围绕大模型的百舸争流蔚为壮观,算力基础设施是首要的竞逐焦点,而存力觉醒也日益成为业界共识。在新的时代,大模型从单模态走向多模态,参数和训练数据集的规模呈几何级数增长,海量的非结构化数据需要高性能混合负载能力的支撑;与此同时,数据密集型范式大行其道,超算、高性能计算(HPC)等应用场景迈向纵深,既有的数据存储基座已难以满足不断升级的需求。如果说算力、算法、数据是驱动人工智能发展的“三驾马车”,那么在外部环境发生巨大变化的背景下,三者亟需重新达成动

vivo推出自主研发的通用AI大模型——蓝心大模型vivo推出自主研发的通用AI大模型——蓝心大模型Nov 01, 2023 pm 02:37 PM

vivo于11月1日在2023年的开发者大会上发布了自主研发的通用人工智能大模型矩阵——蓝心大模型vivo宣布,蓝心大模型将推出5款不同参数量级的模型,分别包含十亿、百亿、千亿三个级别的参数,覆盖核心场景,模型能力在行业中处于领先地位。vivo认为,一个好的自研大模型需要满足以下5点要求:规模大,功能全面,算法强劲,安全可靠,自主进化,并且要广泛开源重写后的内容如下:其中,首先是蓝心大模型7B,这是一个70亿级别的模型,旨在为手机端和云端提供双重服务。vivo表示,该模型在语言理解、文本创作等场

参照人类大脑,学会忘记会让AI大模型变得更好?参照人类大脑,学会忘记会让AI大模型变得更好?Mar 12, 2024 pm 02:43 PM

最近,一支计算机科学家团队研发了一种更灵活、更具弹性的机器学习模型,它们具有周期性遗忘已知信息的能力,这是现有大型语言模型所不具备的特点。实测表明,在很多情况下,“忘却法”的训练效率很高,忘却型模型表现也会更好。韩国基础科学研究院(InstituteforBasicScience)的AI工程师JeaKwon说,新研究意味着AI领域取得明显进步。“忘却法”训练效率很高目前主流的AI语言引擎大多采用人工神经网络技术。这种网络结构中的每个“神经元”实际上是一个数学函数,它们之间相互连接,接收和传递信息

荣耀CEO赵明:AI大模型等创新技术为智能终端发展带来新机遇荣耀CEO赵明:AI大模型等创新技术为智能终端发展带来新机遇Nov 10, 2023 pm 02:29 PM

(全球TMT2023年11月10日讯)11月9日,荣耀终端有限公司CEO赵明受邀参加2023年世界互联网大会乌镇峰会,出席“全球发展倡议数字合作论坛”并进行主题发言。“影响消费电子行业最大因子不是经济周期,而是创新周期。”尽管智能手机市场持续承压、用户换机周期延长为产业链带来巨大挑战,但赵明认为,“AI大模型、5G+等创新技术正在催生智能终端的新特性、新形态、新品类和新服务生态,为智能终端发展带来新的机遇。”在今年三季度,荣耀先后发布了引领折叠屏进入毫米时代的荣耀MagicV2;极致纤薄与时尚的

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

Hot Tools

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

ZendStudio 13.5.1 Mac

ZendStudio 13.5.1 Mac

Powerful PHP integrated development environment

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function