Accelerating enterprise GenAI innovation end-to-end, NVIDIA NIM microservices have become a highlight for software companies!-AI-php.cn

Accelerating enterprise GenAI innovation end-to-end, NVIDIA NIM microservices have become a highlight for software companies!

WBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWBOYWB

Mar 22, 2024 am 08:00 AM

microservicesNvidiagenai

Accelerating enterprise GenAI innovation end-to-end, NVIDIA NIM microservices have become a highlight for software companies!

Software development company Cloudera recently announced a strategic partnership with NVIDIA to accelerate the deployment of generative AI applications. The collaboration will involve integrating NVIDIA's AI microservices into the Cloudera Data Platform (CDP) and is designed to help enterprises more quickly build and scale custom large language models (LLMs) based on their data. This initiative will provide enterprises with more powerful tools and technologies to better utilize their data resources and accelerate the development and deployment process of AI applications. This collaboration will bring more opportunities to enterprises, helping them make more efficient data-driven decisions and drive business development. The cooperation between Cloudera and NVIDIA will provide enterprises with more choices and flexibility, and is expected to promote the widespread application of AI technology in various industries.

As part of this collaboration, Cloudera plans to leverage NVIDIA AI Enterprise technology, including NVIDIA Inference Manager (NIM) microservices, to uncover the power of more than 25 exabytes of data in CDPs insights. This valuable enterprise information will be imported into Cloudera's machine learning platform, an end-to-end AI workflow service provided by the company, designed to drive a new round of generative AI innovation.

Priyank Patel, vice president of AI/ML products at Cloudera, pointed out that a full-stack platform that combines enterprise data and is optimized for large-scale language models is essential for taking organizations’ generative AI applications from pilot to production. It's important. Cloudera is currently integrating NVIDIA NIM and CUDA-X microservices to drive its machine learning platform and help customers transform the potential of AI into business reality.

This collaboration highlights the strength of Cloudera and NVIDIA in technological innovation and also demonstrates the rapidly growing market demand for generative AI applications. By integrating the resources and technical advantages of both parties, we will jointly promote the practical application of AI in enterprises and provide enterprises with more efficient and intelligent solutions.

In addition, by leveraging the massive data in CDP and combining it with the powerful capabilities of the Cloudera machine learning platform, enterprises can dig deeper into the value of data and achieve more accurate decisions and more efficient operations. Business operations. This cooperation will bring a more intelligent and automated future to enterprises and promote the development and progress of the entire industry.

1. Connecting models and data

In connecting models and data, enterprise AI faces a key challenge, that is, how to connect the basic Models are connected with relevant business data to produce accurate, contextual output. NVIDIA’s NIM and NeMo Retriever microservices aim to bridge this gap by enabling developers to connect LLMs (Large Language Models) with structured and unstructured enterprise data ranging from text documents to images and visualizations.

Specifically, Cloudera Machine Learning will provide integrated NIM model serving capabilities to enhance inference performance and enable fault tolerance, low latency and automatic scaling in hybrid and multi-cloud environments. The addition of NeMo Retriever will simplify the development of Retrieval Augmented Generation (RAG) applications, which improve the accuracy of generative AI by retrieving relevant data in real time.

Among them, NVIDIA NeMo Retriever is a new service in the NVIDIA NeMo framework and tool series. NeMo is a family of frameworks and tools for building, customizing, and deploying generative AI models. As a semantic retrieval microservice, NeMo Retriever uses NVIDIA-optimized algorithms to help generative AI applications make more accurate answers. Developers using this microservice can connect their AI applications to business data located in various clouds and data centers. This connection not only enhances the accuracy of AI applications, but also enables developers to process and utilize enterprise data more flexibly.

In summary, microservices such as NVIDIA's NIM and NeMo Retriever provide enterprises with an effective way to closely integrate AI models with business data to generate more Accurate and useful output. This provides enterprises with powerful tools to further promote the application and development of AI in various fields.

2. Data to generative AI deployment, greatly shortening the time

The cooperation between NVIDIA and Cloudera is opening a new door for enterprises , leading them to more efficiently utilize massive data to build customized collaborative assistants and productivity tools. Justin Boitano, vice president of enterprise products at NVIDIA, said: "The integration of NVIDIA NIM microservices with the Cloudera data platform provides developers with a more flexible and easier way to deploy large-scale language models, thereby promoting enterprise business transformation."

By simplifying the path from data to generative AI deployment, Cloudera and NVIDIA aim to accelerate enterprise adoption of transformative applications such as coding assistants, chatbots, document summarization tools and semantic search tools. . This collaboration builds on the two companies' previous efforts to leverage GPU acceleration by integrating NVIDIA RAPIDS into CDP.

Patel highlighted the business benefits of the expanded collaboration, stating: “In addition to providing customers with powerful generative AI capabilities and performance, the results of this integration will enable enterprises to The ability to make more accurate, timely decisions while reducing inaccuracies, hallucinations and errors in forecasts – all critical factors in navigating today’s data environment.”

Cloudera will demonstrate its new generative AI capabilities at NVIDIA GTC March 18-21 in San Jose, CA. As leading enterprises explore the potential of foundational models to transform their operations, Cloudera and NVIDIA believe their collaboration will position customers at the forefront of the emerging era of enterprise AI.

The above is the detailed content of Accelerating enterprise GenAI innovation end-to-end, NVIDIA NIM microservices have become a highlight for software companies!. For more information, please follow other related articles on the PHP Chinese website!

Statement

This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete

The Hidden Dangers Of AI Internal Deployment: Governance Gaps And Catastrophic RisksApr 28, 2025 am 11:12 AM

The unchecked internal deployment of advanced AI systems poses significant risks, according to a new report from Apollo Research. This lack of oversight, prevalent among major AI firms, allows for potential catastrophic outcomes, ranging from uncont

Building The AI PolygraphApr 28, 2025 am 11:11 AM

Traditional lie detectors are outdated. Relying on the pointer connected by the wristband, a lie detector that prints out the subject's vital signs and physical reactions is not accurate in identifying lies. This is why lie detection results are not usually adopted by the court, although it has led to many innocent people being jailed. In contrast, artificial intelligence is a powerful data engine, and its working principle is to observe all aspects. This means that scientists can apply artificial intelligence to applications seeking truth through a variety of ways. One approach is to analyze the vital sign responses of the person being interrogated like a lie detector, but with a more detailed and precise comparative analysis. Another approach is to use linguistic markup to analyze what people actually say and use logic and reasoning. As the saying goes, one lie breeds another lie, and eventually

Is AI Cleared For Takeoff In The Aerospace Industry?Apr 28, 2025 am 11:10 AM

The aerospace industry, a pioneer of innovation, is leveraging AI to tackle its most intricate challenges. Modern aviation's increasing complexity necessitates AI's automation and real-time intelligence capabilities for enhanced safety, reduced oper

Watching Beijing's Spring Robot RaceApr 28, 2025 am 11:09 AM

The rapid development of robotics has brought us a fascinating case study. The N2 robot from Noetix weighs over 40 pounds and is 3 feet tall and is said to be able to backflip. Unitree's G1 robot weighs about twice the size of the N2 and is about 4 feet tall. There are also many smaller humanoid robots participating in the competition, and there is even a robot that is driven forward by a fan. Data interpretation The half marathon attracted more than 12,000 spectators, but only 21 humanoid robots participated. Although the government pointed out that the participating robots conducted "intensive training" before the competition, not all robots completed the entire competition. Champion - Tiangong Ult developed by Beijing Humanoid Robot Innovation Center

The Mirror Trap: AI Ethics And The Collapse Of Human ImaginationApr 28, 2025 am 11:08 AM

Artificial intelligence, in its current form, isn't truly intelligent; it's adept at mimicking and refining existing data. We're not creating artificial intelligence, but rather artificial inference—machines that process information, while humans su

New Google Leak Reveals Handy Google Photos Feature UpdateApr 28, 2025 am 11:07 AM

A report found that an updated interface was hidden in the code for Google Photos Android version 7.26, and each time you view a photo, a row of newly detected face thumbnails are displayed at the bottom of the screen. The new facial thumbnails are missing name tags, so I suspect you need to click on them individually to see more information about each detected person. For now, this feature provides no information other than those people that Google Photos has found in your images. This feature is not available yet, so we don't know how Google will use it accurately. Google can use thumbnails to speed up finding more photos of selected people, or may be used for other purposes, such as selecting the individual to edit. Let's wait and see. As for now

Guide to Reinforcement Finetuning - Analytics VidhyaApr 28, 2025 am 09:30 AM

Reinforcement finetuning has shaken up AI development by teaching models to adjust based on human feedback. It blends supervised learning foundations with reward-based updates to make them safer, more accurate, and genuinely help

Let's Dance: Structured Movement To Fine-Tune Our Human Neural NetsApr 27, 2025 am 11:09 AM

Scientists have extensively studied human and simpler neural networks (like those in C. elegans) to understand their functionality. However, a crucial question arises: how do we adapt our own neural networks to work effectively alongside novel AI s

See all articles