Everyone using DALL-E to create images or letting ChatGPT write a term paper is consuming a lot of cloud resources. Who will pay for all this?
Translator|Bugatti
Reviewer|Sun Shujuan
Artificial intelligence (AI) is a resource-intensive technology for any platform (including public cloud) . Most AI technologies require a large amount of inference calculations, thereby increasing the demand for processor, network and storage resources, ultimately increasing electricity bills, infrastructure costs and carbon emissions.
The rise of generative AI systems such as ChatGPT has once again brought this issue to the forefront. Given the popularity of this technology and the likely widespread use of it by companies, governments, and the public, we can expect a worrying arc in the power consumption growth curve.
AI has been feasible since the 1970s, but initially did not have much commercial impact, given that mature AI systems require significant resources to work properly. I remember an AI-based system I designed in my 20s that required over $40 million in hardware, software, and data center space to get it running. Incidentally, this project, like many other AI projects, never saw a release date, and the commercial solution was simply not viable.
Cloud computing changes everything. With the public cloud, tasks that were once out of reach can now be handled with significant enough cost effectiveness. In fact, as you might have guessed, the rise of cloud computing coincides with the rise of AI over the past 10 to 15 years, and I would say the two are now closely related.
Sustainability and Cost of Cloud Resources
It doesn’t take much research to predict what will happen in this field. Market demand for AI services will soar, such as generative AI systems and other AI and machine learning systems that are now very popular. Leading the charge will be companies seeking advantage through innovation (such as smart supply chains), or even the thousands of college students looking to generative AI systems to write their term papers.
Increased demand for AI means increased demand for the resources used by these AI systems, such as public clouds and the services they provide. This demand is likely to be met by more data centers housing power-hungry servers and network equipment.
Public cloud providers, like any other utility resource provider, will increase prices as demand increases, just like we see seasonal increases in residential electricity bills (again based on demand). Therefore, we usually control electricity consumption and turn up the air conditioner temperature higher in summer.
However, higher cloud computing costs may not have the same impact on businesses. Enterprises may find that these AI systems are not dispensable, but necessary to drive certain key business processes. In many cases, they may try to save money internally, perhaps by reducing headcount to offset the cost of AI systems. It’s no secret that generative AI systems will soon replace many information workers.
What can we do?
If the demand for resources to run AI systems results in higher computing costs and carbon emissions, what can we do about it? The answer may lie in finding more efficient ways for AI to make full use of resources such as processors, networks, and storage.
For example, sampling the pipeline can speed up deep learning by reducing the amount of data processed. Research from the Massachusetts Institute of Technology (MIT) and IBM shows that using this approach can reduce the resources required to run neural networks on large data sets. However this also limits accuracy, which is acceptable for some business use cases but not for all.
Another approach that has been used in other technology areas is in-memory computing. This architecture can speed up AI processing by avoiding data moving in and out of memory. Instead, AI calculations run directly in the memory module, which speeds things up significantly.
Other approaches are being developed, such as changing the physical processor (using co-processors to handle AI calculations to increase speed) or adopting next-generation computing models such as quantum computing. You can expect large public cloud providers to announce technologies that address many of these issues in the near future.
What should you do?
This article is not about avoiding AI to reduce cloud computing costs or save the planet. AI is a fundamental computing method that most businesses can use to create tremendous value.
It is recommended that when undertaking an AI-based development project or a new AI system development project, you should clearly understand the impact on cost and sustainability, as the two are closely related. You have to make a cost/benefit choice, which really goes back to the old topic of what value you can bring to the company for the cost and risk you have to take. Nothing new here.
I believe that this problem is basically expected to be solved through innovation, whether the innovation is in-memory computing, quantum computing or other technologies that have not yet emerged. AI technology providers and cloud computing providers are keen to make AI more cost-effective, energy-efficient and environmentally friendly, which is good news.
Original title: The cost and sustainability of generative AI, author: David S. Linthicum
The above is the detailed content of The cost and sustainability of generative AI. For more information, please follow other related articles on the PHP Chinese website!

Scientists have extensively studied human and simpler neural networks (like those in C. elegans) to understand their functionality. However, a crucial question arises: how do we adapt our own neural networks to work effectively alongside novel AI s

Google's Gemini Advanced: New Subscription Tiers on the Horizon Currently, accessing Gemini Advanced requires a $19.99/month Google One AI Premium plan. However, an Android Authority report hints at upcoming changes. Code within the latest Google P

Despite the hype surrounding advanced AI capabilities, a significant challenge lurks within enterprise AI deployments: data processing bottlenecks. While CEOs celebrate AI advancements, engineers grapple with slow query times, overloaded pipelines, a

Handling documents is no longer just about opening files in your AI projects, it’s about transforming chaos into clarity. Docs such as PDFs, PowerPoints, and Word flood our workflows in every shape and size. Retrieving structured

Harness the power of Google's Agent Development Kit (ADK) to create intelligent agents with real-world capabilities! This tutorial guides you through building conversational agents using ADK, supporting various language models like Gemini and GPT. W

summary: Small Language Model (SLM) is designed for efficiency. They are better than the Large Language Model (LLM) in resource-deficient, real-time and privacy-sensitive environments. Best for focus-based tasks, especially where domain specificity, controllability, and interpretability are more important than general knowledge or creativity. SLMs are not a replacement for LLMs, but they are ideal when precision, speed and cost-effectiveness are critical. Technology helps us achieve more with fewer resources. It has always been a promoter, not a driver. From the steam engine era to the Internet bubble era, the power of technology lies in the extent to which it helps us solve problems. Artificial intelligence (AI) and more recently generative AI are no exception

Harness the Power of Google Gemini for Computer Vision: A Comprehensive Guide Google Gemini, a leading AI chatbot, extends its capabilities beyond conversation to encompass powerful computer vision functionalities. This guide details how to utilize

The AI landscape of 2025 is electrifying with the arrival of Google's Gemini 2.0 Flash and OpenAI's o4-mini. These cutting-edge models, launched weeks apart, boast comparable advanced features and impressive benchmark scores. This in-depth compariso


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

mPDF
mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

ZendStudio 13.5.1 Mac
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

MantisBT
Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

SecLists
SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.
