AI surpasses humans for the first time! Tencent and Alibaba's NLP models understand Chinese better than you do

In the AI ​​technology circle, "Chinese language understanding" has always been a difficult problem to overcome. Because among all the languages ​​in the world, Chinese has the highest degree of difficulty.

For example, the following simple 20-word sentence will definitely make many foreigners feel overwhelmed.

On a rainy day, I almost fell down while riding my bike, but luckily I caught myself. ​

However, in the latest authoritative list CLUE in the field of Chinese language understanding, the AI ​​models of Tencent and Alibaba have successively surpassed human performance! It really makes people wonder: Is there anything AI can’t do these days?

The latest ranking of CLUE

The full name of CLUE is Chinese Language Understanding Evaluation, which is the "Chinese Language Understanding Evaluation Benchmark".

Just like English GLUE and SuperGLUE, CLUE is a set of tasks that evaluate the ability of machines to understand and respond to Chinese text like humans. It was launched 3 years ago and is also the first large-scale Chinese language evaluation benchmark. Aimed at promoting the continuous progress and breakthroughs of NLP technology.

On CLUE’s official website, there are corpora, rankings, pre-trained models, representative data sets and other information to choose from. The 17 assessment tasks, including text similarity, classification, contextual reasoning, and reading comprehension, are introduced in detail on the official website.

On November 22 this year, Alibaba’s AI model “AliceMind” scored a high score of 86.685. While firmly ranking first in the overall rankings, it also broke the previous record in one fell swoop. The record held by HUMAN in this series of tests.

It is worth mentioning that this is also the first time that artificial intelligence has surpassed humans in this series of tests.

Coincidentally, just 4 days later, Tencent’s “Hunyuan AI Large Model” set a new record again in the test with a high score of 86.918 – which was even 0.233 points higher than AliceMind’s score.

China's two major Internet giants, you sing and I come on stage, which shows that artificial intelligence has the ability to surpass humans in different fields and aspects.

Last Friday, Alibaba Cloud Computing Department also stated in an article, "This marks that China's understanding of AI models has reached a new level."

China’s big tech companies are working hard to improve their natural language processing (NLP) systems, which are used to power things like Alibaba’s voice-activated virtual assistants, Tencent’s Xiaowei and AliGenie, as well as machine translation and Spam detection and other features.

Earlier this year, the essay written by "Du Xiaoxiao", an AI model developed by Baidu, scored higher than most in the college entrance examination despite incorrectly using a lot of Internet slang and uncommon words. student.

In addition, in the latest rankings, the artificial intelligence models of Chinese smartphone manufacturer OPPO and food delivery giant Meituan also ranked fourth and fifth respectively.

Still, some researchers say that while machines can do better than humans at some language tasks, most AI models still have a long way to go before they truly understand the complexity of language. Way to go.

Last year, a joint study by the research arm of Auburn University in Alabama and Adobe found that many AIs that perform better than humans on some understanding tasks are still unable to distinguish words that are randomly scrambled. sentence.

References:

https://www.cluebenchmarks.com/rank.html

https://www.scmp.com/tech/big-tech/ article/3201294/tencent-and-alibabas-ai-models-understand-chinese-better-humans-new-rankings-show

https://www.techtimes.com/articles/284084/20221128/tencent -alibaba-ai-tech-tops-chinese-language-comprehension-humans-ranks.htm

https://english.newstracklive.com/news/ai-models-from-tencent-and-alibaba- are-superior-to-humans-at-understanding-chinese-sc71-nu355-ta355-1259160-1.html

The above is the detailed content of AI surpasses humans for the first time! Tencent and Alibaba's NLP models understand Chinese better than you do. For more information, please follow other related articles on the PHP Chinese website!