search
HomeTechnology peripheralsAIMLOps: Are businesses repeating the same DIY mistakes?

MLOps: Are businesses repeating the same DIY mistakes?

Apr 08, 2023 pm 02:11 PM
AIcloud computingmachine learning

Translator | Cui Hao

Reviewer | Sun Shujuan

Opening

MLOps: Are businesses repeating the same DIY mistakes?

## Generally speaking, companies will not take the initiative There are reasons for building your own cloud computing infrastructure. Over the past decade, IT infrastructure teams have attempted to build their own private clouds because they believed they would support their businesses more cost-effectively than public clouds. But contrary to expectations, the time and cost spent on the private cloud exceeded expectations. After the private cloud was built, more resources were needed to maintain it, and it was slightly inferior to the public cloud in terms of security and expansion. As a result, companies that build their own private clouds end up not having more resources to invest in core business, but instead invest a lot of time and personnel in infrastructure that cannot expand business needs.

Now, many enterprises generate solutions through various open source tools (such as Apache Spark), but most actions for MLOps require repeated manual operations.

This results in model deployments taking weeks or even months, inefficient run times (measured by computation and inference taking time to run), and a lack of observations for model testing and monitoring. Also, the approach used was too customized to provide scalable, reusable business processes for multiple use cases in different parts of the enterprise.

A case of misdiagnosed problem

In addition, through conversations with business line leaders and chief data analytics officers, we came to the conclusion that although the organization hired many data scientists, they did not look at to any return. As the research deepens, they will continue to ask various questions and use these questions to identify the difficulties and obstacles faced by artificial intelligence. They quickly realized that the key issue was in the “last mile” – deploying the models and applying them to real-time data, executing them efficiently so that the benefits outweighed the costs, and thus their performance could be better measured.

To solve business problems and make business decisions, data scientists transform data into models. This process requires two sets of skills: first, the expertise and skills needed to build great models; second, the skills to use code to drive the model in the real world, while monitoring and updating the model. However, these two types of skills are completely different.

It is precisely because of this difference that ML engineers come into play. ML Engineers integrate tools and frameworks to ensure data, pipelines, and infrastructure work together to produce ML models at scale.

So, what to do now? Hire more machine learning engineers?

Even with the best ML engineers, enterprises still face two major problems when scaling AI:

    Inability to hire ML engineers quickly: The demand for ML engineers has become very strong , job openings for ML engineers are growing 30 times faster than IT services. Sometimes having to wait months or even years for positions to be filled, MLOps teams need to find an efficient way to support more ML models and use cases without increasing the headcount of ML engineers to meet the demand for ML applications. But this step introduces a second bottleneck...
  • There is a lack of repeatable, scalable best practices for deploying models no matter where and how they are built: the modern enterprise data ecosystem The reality is that different business units use different data platforms based on their data and technology requirements (for example, product teams may need to support streaming data, while finance needs to provide a simple query interface for non-technical users). In addition, data science also requires decentralizing applications across business units rather than centralizing applications. In other words, different data science teams have a unique set of model training frameworks for the use cases (domains) they focus on, which means that a one-size-fits-all training framework cannot be established for the entire enterprise (including multiple departments/domains) of.
How to get the most value from artificial intelligence

In order to improve automation capabilities; in order to provide large-scale user personalized experiences; in order to deliver more accurate, more granular and predictable users Promised, companies are already investing billions of dollars into artificial intelligence. But so far, there’s been a huge gap between AI’s promise and results, with only about 10% of AI investments generating significant ROI.

Finally, in order to solve the MLOps problem, chief data analytics officers need to build their own capabilities around data science at the core of the business, while also investing in other technologies related to MLOps automation. This is a common "build vs. buy" dilemma. It is not only considered from an operational perspective (cost-benefit), but also needs to consider the speed and efficiency of AI investment permeating throughout the enterprise, and whether new methods can be generated in a better way. revenue products and customer base, or cut costs by increasing automation and reducing waste.

Translator Introduction

Cui Hao, 51CTO community editor and senior architect, has 18 years of software development and architecture experience and 10 years of distributed architecture experience. Formerly a technical expert at HP. He is willing to share and has written many popular technical articles with more than 600,000 reads. Author of "Principles and Practice of Distributed Architecture".

Original title:​​MLOps | Is the Enterprise Repeating the Same DIY Mis​​takes?​

The above is the detailed content of MLOps: Are businesses repeating the same DIY mistakes?. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
AI Game Development Enters Its Agentic Era With Upheaval's Dreamer PortalAI Game Development Enters Its Agentic Era With Upheaval's Dreamer PortalMay 02, 2025 am 11:17 AM

Upheaval Games: Revolutionizing Game Development with AI Agents Upheaval, a game development studio comprised of veterans from industry giants like Blizzard and Obsidian, is poised to revolutionize game creation with its innovative AI-powered platfor

Uber Wants To Be Your Robotaxi Shop, Will Providers Let Them?Uber Wants To Be Your Robotaxi Shop, Will Providers Let Them?May 02, 2025 am 11:16 AM

Uber's RoboTaxi Strategy: A Ride-Hail Ecosystem for Autonomous Vehicles At the recent Curbivore conference, Uber's Richard Willder unveiled their strategy to become the ride-hail platform for robotaxi providers. Leveraging their dominant position in

AI Agents Playing Video Games Will Transform Future RobotsAI Agents Playing Video Games Will Transform Future RobotsMay 02, 2025 am 11:15 AM

Video games are proving to be invaluable testing grounds for cutting-edge AI research, particularly in the development of autonomous agents and real-world robots, even potentially contributing to the quest for Artificial General Intelligence (AGI). A

The Startup Industrial Complex, VC 3.0, And James Currier's ManifestoThe Startup Industrial Complex, VC 3.0, And James Currier's ManifestoMay 02, 2025 am 11:14 AM

The impact of the evolving venture capital landscape is evident in the media, financial reports, and everyday conversations. However, the specific consequences for investors, startups, and funds are often overlooked. Venture Capital 3.0: A Paradigm

Adobe Updates Creative Cloud And Firefly At Adobe MAX London 2025Adobe Updates Creative Cloud And Firefly At Adobe MAX London 2025May 02, 2025 am 11:13 AM

Adobe MAX London 2025 delivered significant updates to Creative Cloud and Firefly, reflecting a strategic shift towards accessibility and generative AI. This analysis incorporates insights from pre-event briefings with Adobe leadership. (Note: Adob

Everything Meta Announced At LlamaConEverything Meta Announced At LlamaConMay 02, 2025 am 11:12 AM

Meta's LlamaCon announcements showcase a comprehensive AI strategy designed to compete directly with closed AI systems like OpenAI's, while simultaneously creating new revenue streams for its open-source models. This multifaceted approach targets bo

The Brewing Controversy Over The Proposition That AI Is Nothing More Than Just Normal TechnologyThe Brewing Controversy Over The Proposition That AI Is Nothing More Than Just Normal TechnologyMay 02, 2025 am 11:10 AM

There are serious differences in the field of artificial intelligence on this conclusion. Some insist that it is time to expose the "emperor's new clothes", while others strongly oppose the idea that artificial intelligence is just ordinary technology. Let's discuss it. An analysis of this innovative AI breakthrough is part of my ongoing Forbes column that covers the latest advancements in the field of AI, including identifying and explaining a variety of influential AI complexities (click here to view the link). Artificial intelligence as a common technology First, some basic knowledge is needed to lay the foundation for this important discussion. There is currently a large amount of research dedicated to further developing artificial intelligence. The overall goal is to achieve artificial general intelligence (AGI) and even possible artificial super intelligence (AS)

Model Citizens, Why AI Value Is The Next Business YardstickModel Citizens, Why AI Value Is The Next Business YardstickMay 02, 2025 am 11:09 AM

The effectiveness of a company's AI model is now a key performance indicator. Since the AI boom, generative AI has been used for everything from composing birthday invitations to writing software code. This has led to a proliferation of language mod

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)