search
HomeTechnology peripheralsAIUse flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.

On November 30, the WAVE SUMMIT 2022 Deep Learning Developer Summit, hosted by the National Engineering Research Center for Deep Learning Technology and Applications and hosted by Baidu Flying Paddle, was held as scheduled. At the summit, Baidu AI Technology Ecosystem General Manager Ma Yanjun released the latest technology and ecological progress of the Paddle Deep Learning Platform. The newly released Paddle Open Source Framework version 2.4 brought the industry's first end-to-end large model development kit PaddleFleetX, uniting 12 companies. Hardware ecological partners released the Flying Paddle ecological release version, and the AI ​​Studio learning and training community upgraded to launch enterprise training and ecological heterogeneous computing centers, etc. This series of measures marks that Feipiao continues to consolidate its AI technology base and continues to deepen industrial integration and innovation.

Use flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.

Picture: Baidu AI Technology Ecosystem General Manager Ma Yanjun shares the latest release of the Flying Paddle platform

The Flying Paddle open source framework version 2.4 is released, continuing to optimize with underlying technology innovation Performance

The 2.4 version of the Flying Paddle upgrade makes framework development more flexible and convenient, continues to lead the way in large-scale model distributed training, and enables high-performance inference deployment in all scenarios.

Use flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.

In terms of development, version 2.4 of the Flying Paddle open source framework has added more than 160 APIs for important scenarios such as sparse computing and graph learning, and the API development threshold and cost have been significantly reduced, making One-third of the new APIs this time come from contributions from ecological developers. In response to the needs of AI for Science scenarios, version 2.4 implements a general high-order automatic differentiation function to better support scientific computing-related applications. At the same time, Flying Paddle has comprehensively improved the scalability and deployment flexibility of the core dynamic-to-static technology. The new model's dynamic-to-static success rate reaches 92%, giving full play to the respective advantages of dynamic and static images.

In terms of training, version 2.4 has been newly upgraded and launched the GPU-based ultra-large-scale graph model training engine PGLBox, which is the first in the industry to implement an integrated graph learning solution that can simultaneously support complex algorithms, ultra-large graphs, and ultra-large discrete models. . In addition, Fei Paddle's collective communication distributed training performance has also been optimized to the extreme, providing a comprehensive and rich distributed training performance optimization system for large model training. Based on this, Fei Paddle has won the internationally authoritative AI training benchmark test twice in a row this year. No. 1 on the MLPerf Training list.

As the "last mile" of AI implementation in the industry, the reasoning and deployment process of the model is very critical. First of all, for the reasoning of large models, version 2.4 of the Flying Paddle open source framework supports functions such as adaptive model segmentation and distributed reasoning. Relying on the dynamic and static capabilities of the Flying Paddle framework, it can achieve automatic deep fusion and high-performance optimization, fully supporting large model applications. Landed. At the same time, in order to fundamentally solve the three major problems faced by AI application implementation: scene fragmentation, high development costs, and slow inference speed, Feipiao has launched a new full-scenario high-performance AI deployment tool FastDeploy, which is a one-stop solution. To meet the deployment requirements of multiple scenarios, multiple frameworks, and multiple hardware on devices, edges, and clouds, the API design is not only unified and easy to use, but also supports deep linkage between automated compression and high-performance inference engines, giving full play to the advantages of integrated software and hardware, and has the industry's leading edge Leading reasoning performance provides optimal solutions for AI industry applications.

Continue to lower the application threshold and accelerate the implementation of AI applications

The application of large models can lower the threshold for AI applications, but the development, training, inference and deployment processes of large models still pose great challenges. In order to better support the implementation of large model applications, PaddleFleetX has released a new end-to-end large model development kit PaddleFleetX. PaddleFleet Training and debugging of hardware platforms in multi-cloud environments. At the same time, Paddle Fleet Quantitative deployment.

Use flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.

At this summit, the number of open source algorithms in the Flying Paddle industry-level open source model library has been added to more than 600, covering mainstream task scenarios such as vision, natural language, and timing modeling; The number of PP series featured models with balanced precision and performance that have been polished by industrial practice has increased to 42; the number of practical examples of flying paddle industry has increased to 68, covering ten key industry scenarios such as finance, industry, transportation, Internet, security, and education; the number of flying paddle industry models has been released The one-stop entrance to the paddle industry-level model library aggregates model knowledge and toolsets, and connects the entire process of model selection, rapid experience, model development and use, and model deployment. Fei Paddle has accumulated strength from the aspects of open source industrial models and reference examples to provide convenient support for enterprises to apply AI technology and jointly solve the pain points and difficulties of the industry.

Join hands with ecological partners in various fields to create and share, and jointly build a prosperous Flying Paddle AI ecosystem

Promoting the application of artificial intelligence in the industry cannot be separated from the cooperation with hardware ecological partners. In May of this year, Flying Paddle jointly launched the "Hardware Ecosystem Co-Creation Plan" with its hardware ecosystem partners to fully cooperate in multiple dimensions such as joint research and development, resource sharing, joint licensing, and training empowerment. As of November, the number of members of Fei Paddle’s “Hardware Ecosystem Co-Creation Plan” has increased from 13 to 28. At the same time, Flying Paddle has joined hands with 12 manufacturers including Nvidia, Arm, Cambrian, Kunlun Core, Tianshu Intelligent Core, Graphcore, and Suiyuan to jointly release the Flying Paddle ecological release to provide developers with a better integrated software and hardware experience. At the same time, we will work together to build a prosperous hardware ecosystem.

Use flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.

In order to further accelerate the intelligent upgrading of the AI ​​industry, Fei Paddle has gone deep into the industrial scene and joined forces with China Energy Group, Industrial and Commercial Bank of China, China Unicom, PetroChina, and China Academy of Railway Sciences. , China Mobile, China FAW and other leading companies in the industry have released a collection plan for industrial practice examples to link companies and developers to solve key problems in actual industrial scenarios in various industries and help the AI ​​industry to implement.

Feipiao Construction’s AI Studio learning and training community is committed to making AI learning and application easier, and has now become the largest AI developer community in China. At this summit, AI Studio upgraded and added two new sections: corporate training and ecological heterogeneous computing power center.

Enterprise training provides a practical training platform for enterprises to apply deep learning. Up to now, Feipiao has jointly held events with more than 20 well-known companies to jointly explore AI application solutions and cultivate AI talents. For a long time, AI Studio has provided developers with rich computing resources including CPU and GPU, and has been connected to Sugon DCU computing power to provide developers with an online experience center and a convenient experience environment for hardware infrastructure and ecology. The heterogeneous computing power center welcomes more hardware manufacturers to settle in.

The Baidu Flying Paddle deep learning open source open platform derived from industrial practice is an AI large-scale production platform for Baidu to practice integrated innovation and lower the threshold. In the future, as the core technology of deep learning continues to be developed, Fei Paddle will better support the application of AI and large models, continue to build a more prosperous AI ecosystem, promote the industry to accelerate intelligent upgrading, and let AI benefit thousands of industries.

The above is the detailed content of Use flying paddles to handle large model production in one stop. The PaddleFleetX large model development kit is the first in the industry.. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
YOLOv6又快又准的目标检测框架已经开源了YOLOv6又快又准的目标检测框架已经开源了May 09, 2023 pm 02:52 PM

作者:楚怡、凯衡等近日,美团视觉智能部研发了一款致力于工业应用的目标检测框架YOLOv6,能够同时专注于检测的精度和推理效率。在研发过程中,视觉智能部不断进行了探索和优化,同时吸取借鉴了学术界和工业界的一些前沿进展和科研成果。在目标检测权威数据集COCO上的实验结果显示,YOLOv6在检测精度和速度方面均超越其他同体量的算法,同时支持多种不同平台的部署,极大简化工程部署时的适配工作。特此开源,希望能帮助到更多的同学。1.概述YOLOv6是美团视觉智能部研发的一款目标检测框架,致力于工业应用。

MLC LLM:开源AI聊天机器人,支持离线运行,适用于集成显卡电脑和iPhone。MLC LLM:开源AI聊天机器人,支持离线运行,适用于集成显卡电脑和iPhone。May 06, 2023 pm 03:46 PM

5月2日消息,目前大多数AI聊天机器人都需要连接到云端进行处理,即使可以本地运行的也配置要求极高。那么是否有轻量化的、无需联网的聊天机器人呢?一个名为MLCLLM的全新开源项目已在GitHub上线,完全本地运行无需联网,甚至集显老电脑、苹果iPhone手机都能运行。MLCLLM项目介绍称:“MLCLLM是一种通用解决方案,它允许将任何语言模型本地部署在一组不同的硬件后端和本地应用程序上,此外还有一个高效的框架,供每个人进一步优化自己用例的模型性能。一切都在本地运行,无需服务器支持,并通过手机和笔

基于开源的 ChatGPT Web UI 项目,快速构建属于自己的 ChatGPT 站点基于开源的 ChatGPT Web UI 项目,快速构建属于自己的 ChatGPT 站点Apr 15, 2023 pm 07:43 PM

作为一个技术博主,了不起比较喜欢各种折腾,之前给大家介绍过ChatGPT​接入微信,钉钉和知识星球(如果没看过的可以翻翻前面的文章),最近再看开源项目的时候,发现了一个ChatGPTWebUI项目。想着刚好之前没有将ChatGPT​接入过WebUI,有了这个开源项目可以拿来使用,真是不错,下面是实操的安装步骤,分享给大家。安装官方在Github​的项目文档上提供了很多中的安装方式,包括手动安装,docker​部署,以及远程部署等方法,了不起在选择部署方式的时候,一开始为了简单想着

仅需1% Embedding参数,硬件成本降低十倍,开源方案单GPU训练超大推荐模型仅需1% Embedding参数,硬件成本降低十倍,开源方案单GPU训练超大推荐模型Apr 12, 2023 pm 03:46 PM

深度推荐模型(DLRMs)已经成为深度学习在互联网公司应用的最重要技术场景,如视频推荐、购物搜索、广告推送等流量变现业务,极大改善了用户体验和业务商业价值。但海量的用户和业务数据,频繁地迭代更新需求,以及高昂的训练成本,都对 DLRM 训练提出了严峻挑战。在 DLRM 中,需要先在嵌入表(EmbeddingBags)中进行查表(lookup),再完成下游计算。嵌入表常常贡献 DLRM 中 99% 以上的内存需求,却只贡献 1% 的计算量。借助于 GPU 片上高速内存(High Bandwidth

用图像对齐所有模态,Meta开源多感官AI基础模型,实现大一统用图像对齐所有模态,Meta开源多感官AI基础模型,实现大一统May 11, 2023 pm 07:25 PM

在人类的感官中,一张图片可以将很多体验融合到一起,比如一张海滩图片可以让我们想起海浪的声音、沙子的质地、拂面而来的微风,甚至可以激发创作一首诗的灵感。图像的这种「绑定」(binding)属性通过与自身相关的任何感官体验对齐,为学习视觉特征提供了大量监督来源。理想情况下,对于单个联合嵌入空间,视觉特征应该通过对齐所有感官来学习。然而这需要通过同一组图像来获取所有感官类型和组合的配对数据,显然不可行。最近,很多方法学习与文本、音频等对齐的图像特征。这些方法使用单对模态或者最多几种视觉模态。最终嵌入仅

首个大众可用PyTorch版AlphaFold2复现,哥大开源,star量破千首个大众可用PyTorch版AlphaFold2复现,哥大开源,star量破千Apr 13, 2023 am 09:58 AM

刚刚,哥伦比亚大学系统生物学助理教授 Mohammed AlQuraishi 在推特上宣布,他们从头训练了一个名为 OpenFold 的模型,该模型是 AlphaFold2 的可训练 PyTorch 复现版本。Mohammed AlQuraishi 还表示,这是第一个大众可用的 AlphaFold2 复现。AlphaFold2 可以周期性地以原子精度预测蛋白质结构,在技术上利用多序列对齐和深度学习算法设计,并结合关于蛋白质结构的物理和生物学知识提升了预测效果。它实现了 2/3 蛋白质结构预测的卓

Stable Diffusion-XL开启公测,让你摆脱繁琐的长prompt!Stable Diffusion-XL开启公测,让你摆脱繁琐的长prompt!Apr 23, 2023 am 10:16 AM

自从Midjourney发布v5之后,在生成图像的人物真实程度、手指细节等方面都有了显著改善,并且在prompt理解的准确性、审美多样性和语言理解方面也都取得了进步。相比之下,StableDiffusion虽然免费、开源,但每次都要写一大长串的prompt,想生成高质量的图像全靠多次抽卡。最近StabilityAI的官宣,正在研发的StableDiffusionXL开始面向公众测试,目前可以在Clipdrop平台免费试用。试用链接:​https://clipdrop.co/stable-diff

基于PyTorch、易上手,细粒度图像识别深度学习工具库Hawkeye开源基于PyTorch、易上手,细粒度图像识别深度学习工具库Hawkeye开源Apr 12, 2023 pm 08:43 PM

细粒度图像识别 [1] 是视觉感知学习的重要研究课题,在智能新经济和工业互联网等方面具有巨大应用价值,且在诸多现实场景已有广泛应用…… 鉴于当前领域内尚缺乏该方面的深度学习开源工具库,南京理工大学魏秀参教授团队用时近一年时间,开发、打磨、完成了 Hawkeye——细粒度图像识别深度学习开源工具库,供相关领域研究人员和工程师参考使用。本文是对 Hawkeye 的详细介绍。1.什么是 Hawkeye 库Hawkeye 是一个基于 PyTorch 的细粒度图像识别深度学习工具库,专为相关领域研究人员和

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
1 months agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

WebStorm Mac version

WebStorm Mac version

Useful JavaScript development tools

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),