According to Appen’s “State of Artificial Intelligence and Machine Learning” report released this week, agencies are still struggling to obtain good, clean data to sustain their artificial intelligence and machine learning programs.
According to Appen’s survey of 504 business leaders and technology experts, among the four stages of artificial intelligence, data sources; data preparation; models Training and deployment; the human-led model evaluation phase—the data source consumes the most resources, takes the longest, and is the most challenging.
According to Appen’s survey, data sources consume an average of 34% of an organization’s AI budget, with data preparation, model testing and deployment each accounting for 24%, and model evaluation accounting for 15%. The survey was conducted by Harris Poll and included IT decision-makers, business leaders and managers, and technology practitioners from the United States, United Kingdom, Ireland and Germany.
In terms of time, data sources consume approximately 26% of the time, data preparation time is 24%, model testing, deployment and model evaluation time are each 23% . Finally, 42% of technicians believe that data sourcing is the most challenging stage in the AI life cycle. The other stages are: model evaluation (41%), model testing and deployment (38%), and data preparation (34%) .
Despite the challenges, organizations are working hard to make it work. According to Appen, four-fifths (81%) of respondents said they have enough data to support their AI initiatives. The key to success may be this: The vast majority (88%) of companies augment their data by using external AI training data providers such as Appen.
However, the accuracy of the data is still open to question. Appen found that only 20% of respondents reported data accuracy of more than 80%. Only 6% (roughly one in 20 people) said their data was 90% accurate or better.
With this in mind, nearly half (46%) of respondents believe data accuracy is important, according to Appen’s survey. Only 2% believe data accuracy is not a big need, while 51% believe it is a critical need.
Appen’s Chief Technology Officer Wilson Pang has a different view on the importance of data quality, with 48% of his customers not believing data quality is important.
“Data accuracy is critical to the success of AI and ML models, as quality-rich data yields better model output and consistent processing and decision-making,” the report said. “In order to obtain For good results, data sets must be accurate, comprehensive, and scalable.”
The rise of deep learning and data-centric artificial intelligence has shifted the motivation for AI success from good data science and machine learning Model shift to good data collection, management and labeling. This is especially true in today's transfer learning techniques. Practitioners of artificial intelligence will abandon a large pre-trained language or computer vision model and retrain a small part of it on their own data.
Better data can also help prevent unnecessary bias from seeping into AI models and preventing bad outcomes that AI can lead to. This is especially true for large language models.
The report says: “With the rise of large language models (LLMs) trained on multilingual web scraping data, enterprises are facing another challenge. As training corpora are filled with toxic languages, and Racial, gender, and religious biases, these models often exhibit undesirable behavior."
Bias in network data raises thorny issues, although there are some workarounds (changing training regimens, filtering training data, and model output, and learn from human feedback and testing), but more research is needed to create a “human-centered LLM” benchmark and good standard for model evaluation methods.
Appen said data management remains the biggest obstacle facing artificial intelligence. The survey found that 41% of people believe that data management is the biggest bottleneck in the artificial intelligence cycle. In fourth place is a lack of data, with 30% of respondents citing this as the biggest obstacle to AI success.
But there’s some good news: The time enterprises spend managing and preparing data is falling. This year's rate was just over 47%, compared with 53% in last year's report, Appen said.
“Since the majority of respondents use external data providers, it can be inferred that by outsourcing data sourcing and preparation, data scientists are saving time required to properly manage, clean, and label their data.” Data Labeling the company said.
However, judging by the relatively high error rates in the data, perhaps organizations should not scale back their data sources and preparation processes (whether internal or external). There are many competing needs when it comes to building and maintaining AI processes—the need to hire qualified data professionals was another top need identified by Appen. However, until significant progress is made in data management, organizations should continue to pressure their teams to continue driving the importance of data quality.
The survey also found that 93% of organizations strongly or to some extent agree that AI ethics should be the "foundation" of AI projects. Appen CEO Mark Brayan said it was a good start but there was still much work to be done. "The problem is that many people are facing the challenge of trying to build great AI with poor data sets, which creates huge obstacles to achieving their goals," Brayan said in a press release.
According to Appen’s report, custom-collected data within enterprises remains the primary data set used for AI, accounting for 38% to 42% of data. Synthetic data showed surprisingly strong performance, accounting for 24% to 38% of an organization's data, while pre-labeled data (usually from data service providers) accounted for 23% to 31% of the data.
In particular, synthetic data has the potential to reduce the incidence of bias in sensitive AI projects, with 97% of Appen’s survey participants saying they used synthetic data in “developing inclusive training datasets.”
Other interesting findings from the report include:
- 77% of organizations retrain their models monthly or quarterly;( Interpretation of the forefront of the AI era: Artificial intelligence is not a one-time solution. It is constantly improving according to application needs and needs to be constantly updated.)
- 55% of American companies claim that they are ahead of their competitors, while in Europe this proportion is 44%; (Interpretation from the forefront of the AI era: Europeans are slightly more low-key than Americans.)
- 42% of organizations reported that artificial intelligence was “widely” rolled out, and in the “2021 State of Artificial Intelligence Report”, this proportion is 51%; (Interpretation from the forefront of the AI era: Artificial intelligence applications are becoming more and more widespread.)
- 7% of organizations reported that their artificial intelligence budget exceeded US$5 million, compared with 9% last year. (Interpretation from the forefront of the AI era: On the one hand, it may be due to the gradual maturity of artificial intelligence that reduces costs, but also shows that artificial intelligence is no longer a "luxury product" and is gradually becoming a "must-have" for enterprises.)
The above is the detailed content of Data sources are still the main bottleneck of artificial intelligence. For more information, please follow other related articles on the PHP Chinese website!

机器学习是一个不断发展的学科,一直在创造新的想法和技术。本文罗列了2023年机器学习的十大概念和技术。 本文罗列了2023年机器学习的十大概念和技术。2023年机器学习的十大概念和技术是一个教计算机从数据中学习的过程,无需明确的编程。机器学习是一个不断发展的学科,一直在创造新的想法和技术。为了保持领先,数据科学家应该关注其中一些网站,以跟上最新的发展。这将有助于了解机器学习中的技术如何在实践中使用,并为自己的业务或工作领域中的可能应用提供想法。2023年机器学习的十大概念和技术:1. 深度神经网

本文将详细介绍用来提高机器学习效果的最常见的超参数优化方法。 译者 | 朱先忠审校 | 孙淑娟简介通常,在尝试改进机器学习模型时,人们首先想到的解决方案是添加更多的训练数据。额外的数据通常是有帮助(在某些情况下除外)的,但生成高质量的数据可能非常昂贵。通过使用现有数据获得最佳模型性能,超参数优化可以节省我们的时间和资源。顾名思义,超参数优化是为机器学习模型确定最佳超参数组合以满足优化函数(即,给定研究中的数据集,最大化模型的性能)的过程。换句话说,每个模型都会提供多个有关选项的调整“按钮

实现自我完善的过程是“机器学习”。机器学习是人工智能核心,是使计算机具有智能的根本途径;它使计算机能模拟人的学习行为,自动地通过学习来获取知识和技能,不断改善性能,实现自我完善。机器学习主要研究三方面问题:1、学习机理,人类获取知识、技能和抽象概念的天赋能力;2、学习方法,对生物学习机理进行简化的基础上,用计算的方法进行再现;3、学习系统,能够在一定程度上实现机器学习的系统。

截至3月20日的数据显示,自微软2月7日推出其人工智能版本以来,必应搜索引擎的页面访问量增加了15.8%,而Alphabet旗下的谷歌搜索引擎则下降了近1%。 3月23日消息,外媒报道称,分析公司Similarweb的数据显示,在整合了OpenAI的技术后,微软旗下的必应在页面访问量方面实现了更多的增长。截至3月20日的数据显示,自微软2月7日推出其人工智能版本以来,必应搜索引擎的页面访问量增加了15.8%,而Alphabet旗下的谷歌搜索引擎则下降了近1%。这些数据是微软在与谷歌争夺生

荣耀的人工智能助手叫“YOYO”,也即悠悠;YOYO除了能够实现语音操控等基本功能之外,还拥有智慧视觉、智慧识屏、情景智能、智慧搜索等功能,可以在系统设置页面中的智慧助手里进行相关的设置。

人工智能在教育领域的应用主要有个性化学习、虚拟导师、教育机器人和场景式教育。人工智能在教育领域的应用目前还处于早期探索阶段,但是潜力却是巨大的。

阅读论文可以说是我们的日常工作之一,论文的数量太多,我们如何快速阅读归纳呢?自从ChatGPT出现以后,有很多阅读论文的服务可以使用。其实使用ChatGPT API非常简单,我们只用30行python代码就可以在本地搭建一个自己的应用。 阅读论文可以说是我们的日常工作之一,论文的数量太多,我们如何快速阅读归纳呢?自从ChatGPT出现以后,有很多阅读论文的服务可以使用。其实使用ChatGPT API非常简单,我们只用30行python代码就可以在本地搭建一个自己的应用。使用 Python 和 C

人工智能在生活中的应用有:1、虚拟个人助理,使用者可通过声控、文字输入的方式,来完成一些日常生活的小事;2、语音评测,利用云计算技术,将自动口语评测服务放在云端,并开放API接口供客户远程使用;3、无人汽车,主要依靠车内的以计算机系统为主的智能驾驶仪来实现无人驾驶的目标;4、天气预测,通过手机GPRS系统,定位到用户所处的位置,在利用算法,对覆盖全国的雷达图进行数据分析并预测。


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

SAP NetWeaver Server Adapter for Eclipse
Integrate Eclipse with SAP NetWeaver application server.

PhpStorm Mac version
The latest (2018.2.1) professional PHP integrated development tool

DVWA
Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

SublimeText3 English version
Recommended: Win version, supports code prompts!

ZendStudio 13.5.1 Mac
Powerful PHP integrated development environment
