search
HomeTechnology peripheralsAIThe ChatGPT application with 'eyes' is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

The ChatGPT application with 'eyes' is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

In many people’s minds, ChatGPT is an omnipotent “monster”.

It can write poetry, code, and even directly generate long papers... In addition, ChatGPT is also extremely emotional and expressive. It only takes a few rounds of conversations to conquer everyone.

But is ChatGPT really omnipotent?

As a chat robot, ChatGPT has excellent language understanding and text processing capabilities. However, due to the training model, ChatGPT does not support picture dialogue. Just imagine, when chatting with friends on weekdays, if you cannot send pictures, you will naturally lose part of the fun.

In China, there is such an AI R&D team. The "元成祥Chatlmg" application they launched can accurately identify pictures and chat with users, just like adding to ChatGPT A pair of "eyes", can not only understand text, but also perfectly identify pictures.

A few days ago, Magike.com learned from the Yuanchengxiang R&D team that "Yuanchengxiang Chatlmg" has just been launched recently. Follow the WeChat public account "Yuanchengxiang" You can try the application now. (Note: Limited by computing power, the initial access method is invitation-based)

So, what is the experience of using "Yuancheng Xiang Chatlmg" and whether its image recognition function is real What about magic? On the eve of the product launch, Magike.com conducted a comprehensive evaluation and summary.

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

Picture | Yuan Cheng Xiang Chatlmg Logo

Look at the picture and speak? This ChatGPT application is amazing

Enter "Yuancheng Xiang Chatlmg", you can see that the interface of the application is verysimple and clear-the text dialog box at the bottom and the symmetrical avatar layout , various elements are combined into our common chat software interface.

In the lower left corner of the application, you can see a conspicuous "Upload Picture" button.

Currently, the application supports three methods for uploading pictures, namely photo gallery, taking pictures and file import, one at a time.

Coinciding with Women’s Day, Meike.com also selected two items and handed them over to "Yuanchengxiang Chatlmg" to help determine whether they are suitable. One of them was from​​Search Engine​## The lipstick picture downloaded from #​, the other one is the notepad picture taken through the mobile phone:

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

It can be seen that "Yuancheng Xiang Chatlmg" accurately identified the products in the two pictures, and also extended some other descriptions, such as the bear on the notepad is cute and the lipstick is placed on a white background Wait a minute.

At the same time, he also gave his own judgment on whether these two items are suitable as gifts for girls, and also put forward rational suggestions whether the gifts are suitable based on the preferences of the recipient.

After "Yuan Cheng Xiang Chatlmg" gave the reply,

we asked another question:

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

Well, the suggestions are very pertinent, and the logic of contextual understanding is also coherent.

In addition, Meike.com also uploaded some other pictures for "Yuan Cheng Xiang Chatlmg" to identify.

For example, this one:

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

And for example, this one:

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

And these:

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

The ChatGPT application with eyes is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.

It can be seen that the recognition ability of "Yuancheng Xiang Chatlmg" is still quite accurate, and it candescribe what it sees in text form The picture content is .

Compared with ChatGPT based on pure text interaction, in addition to basic interactions such as writing poems and articles, "Yuancheng Xiang Chatlmg" with an extra pair of "eyes" has obviously discovered several new functions, such as item recognition. is one of its important functions.

After that,with the continuous expansion of data volume and continuous optimization of products, Meike.com also hopes that "Yuancheng Xiang Chatlmg" can bring us more outstanding performance.

Blessed by a large model with tens of billions of parameters, it will continue to be upgraded in the future

Essentially, ChatGPT is a chat robot product that provides the ability to generate text with the help of the GPT-3 large model . The power of ChatGPT is precisely due to GPT-3.

As a natural language processing model developed by OpenAI, it has too many talking points. Long before the launch of ChatGPT, GPT-3 had already successfully emerged in the AI ​​field. It is reported that the model reaches 175 billion parameters, and a single training requires tens of thousands of GPUs, costing nearly US$4.6 million. Such crazy “gold swallowing ability” can naturally support crazy applications like ChatGPT.

So are there any shortcomings in ChatGPT? The answer is yes!

According to the Yuanchengxiang R&D team, "Yuanchengxiang Chatlmg" is equipped with a self-developed

tens of billions of parameters multi-modal large model

, which is equivalent to adding "eyes" to ChatGPT , making it possible to talk more like a human being. The so-called multi-modality in the field of AI often refers to the collaboration of sensory information, such as

images, text, voice

, etc., to help artificial intelligence understand the external world more accurately. It is also with the support of multi-modal large models that "Yuancheng Xiang Chatlmg" has the ability to understand images.

According to the Yuanchengxiang R&D team, the current

Yuanchengxiang AI large model

parameter scale is about 15 billion; the data is currently mainly image-text data and VQA datawait. During the training process, the model releases as few learnable parameters as possible to ensure efficient training on limited computing power.

When asked about the model's future development path, Yuanchengxiang's R&D team revealed to Meike.com that in addition to the current interactive graphics and text, the large model will also use pictures in the future The ability to generate is combined, so that you can reply to your own generated images when answering, making the conversation more vivid.

In addition, this mode will also include more modes, such as video, audio, etc., and even be combined with digital human and other technologies to develop a more vivid three-dimensional image of.

It is conceivable that with the support of Yuanchengxiang’s multi-modal model with tens of billions of parameters, our conversations with chatbots will become more like real people, and the surprises that AI technology will bring us in the future will also more and more.

Chinese AI manufacturers are running wild, how far is the domestic ChatGPT?

At the "Ministerial Channel" of the First Session of the 14th National People's Congress held this month, ​Minister of Science and Technology Wang Zhigang was talking about ChatGPT , praising the progress it has brought to AI and related industries.

At the same time, various discussions triggered by ChatGPT were also brought into the two sessions by representatives and committee members.

In fact, as early as 2017, before my country elevated the development of artificial intelligence to a national strategy, AI was already a "frequent guest" at the National Two Sessions. Now that ChatGPT is popular all over the world, people can't help but ask again: How can China's AI industry seize the trend of ChatGPT?

Taking advantage of the opportunity of new product release, Meike.com also had a discussion on this issue with Dr. Gao Yizhao

, head of Yuanchengxiang’s R&D team.

In his view, the construction of large AI models in China requires a long-term layout and continuity of work in order to develop truly innovative technologies

.

When we look back at the "history" of ChatGPT, we can find that it is not easy to build a large AI model. Behind it is long-term capital investment and iteration of computing power technology. In addition, we must also consider the training data Optimization, reduction of computing energy consumption and other aspects.

In other words,

If you want to make a ChatGPT-like application, you can not complete it through a simple "100-meter sprint", but you need to be patient and complete a "10,000-meter long-distance race". Only then can you enter the "finals" where the heroes compete.

.

However, judging from the current development status, the large AI models of domestic manufacturers are still in the research and development stage, and teams that can reach the application level like "Yuancheng Xiang Chatlmg" are still very rare - first of all, domestic The research and development of large AI models generally started late, and there is a serious talent gap. Secondly, the training of large models in the Chinese context is more difficult and takes far more time than English.

These problems should have required "patience" to solve, but as the last wave of AI investment boom cooled down, many companies were forced to reduce their budgets, which ultimately led to the development of related AI businesses reaching a bottleneck.

In contrast, the Yuanchengxiang R&D team has gone relatively smoothly. On the one hand, the team has long-term exploration in the field of AI applications, and on the other hand, it also benefits from their multi-modal pre-training. The correct judgment and foresight in the model, and finally with the persistence of the entire team, finally ushered in the " Blooming and Fruiting

" in the ChatGPT era.

When talking about the future exploration of AI companies, Dr. Gao also gave some of his own opinions: "

In terms of ecological construction, China can promote open source​ After all, there is strength in numbers.

ConclusionSince its release last year, ChatGPT has evolved from a “phenomenal product” to a "

Technology Symbol

", major domestic technology manufacturers are rushing to launch ChatGPT-like products, hoping to win the so-called "victory" in this competition.

At the same time, with the popularity of ChatGPT, the domestic AI industry once again set off a new round of new product boom. It was during this period that "Yuancheng Xiang Chatlmg" stood out. Judging from the evaluation of the "Yuancheng Xiang Chatlmg" application, its experience is already very friendly, and it even has "image recognition" functions that ChatGPT does not have. Of course, as an early version of "Yuanchengxiang Chatlmg", there are still some deficiencies in some details, but I believe that with the efforts and persistence of the Yuanchengxiang R&D team, the domestic ChatGPT application can also surprise the industry in the future.

The above is the detailed content of The ChatGPT application with 'eyes' is here! Supported by a large multi-modal model with 15 billion parameters, it is versatile in reading pictures and chatting.. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
Word文本框没有旋转按钮怎么办Word文本框没有旋转按钮怎么办Dec 08, 2022 am 09:50 AM

Word文本框没有旋转按钮的解决办法:打开兼容模式文档后按F12键另存为高版本,再打开就可以了。

令人惊艳的4个ChatGPT项目,开源了!令人惊艳的4个ChatGPT项目,开源了!Mar 30, 2023 pm 02:11 PM

自从 ChatGPT、Stable Diffusion 发布以来,各种相关开源项目百花齐放,着实让人应接不暇。今天,着重挑选几个优质的开源项目分享给大家,对我们的日常工作、学习生活,都会有很大的帮助。

Word文档拆分后的子文档字体格式变了怎么办Word文档拆分后的子文档字体格式变了怎么办Feb 07, 2023 am 11:40 AM

Word文档拆分后的子文档字体格式变了的解决办法:1、在大纲模式拆分文档前,先选中正文内容创建一个新的样式,给样式取一个与众不同的名字;2、选中第二段正文内容,通过选择相似文本的功能将剩余正文内容全部设置为新建样式格式;3、进入大纲模式进行文档拆分,操作完成后打开子文档,正文字体格式就是拆分前新建的样式内容。

vscode配置中文插件,带你无需注册体验ChatGPT!vscode配置中文插件,带你无需注册体验ChatGPT!Dec 16, 2022 pm 07:51 PM

​面对一夜爆火的 ChatGPT ,我最终也没抵得住诱惑,决定体验一下,不过这玩意要注册需要外国手机号以及科学上网,将许多人拦在门外,本篇博客将体验当下爆火的 ChatGPT 以及无需注册和科学上网,拿来即用的 ChatGPT 使用攻略,快来试试吧!

学术专用版ChatGPT火了,一键完成论文润色、代码解释、报告生成学术专用版ChatGPT火了,一键完成论文润色、代码解释、报告生成Apr 04, 2023 pm 01:05 PM

用 ChatGPT 辅助写论文这件事,越来越靠谱了。 ChatGPT 发布以来,各个领域的从业者都在探索 ChatGPT 的应用前景,挖掘它的潜力。其中,学术文本的理解与编辑是一种极具挑战性的应用场景,因为学术文本需要较高的专业性、严谨性等,有时还需要处理公式、代码、图谱等特殊的内容格式。现在,一个名为「ChatGPT 学术优化(chatgpt_academic)」的新项目在 GitHub 上爆火,上线几天就在 GitHub 上狂揽上万 Star。项目地址:https://github.com/

30行Python代码就可以调用ChatGPT API总结论文的主要内容30行Python代码就可以调用ChatGPT API总结论文的主要内容Apr 04, 2023 pm 12:05 PM

阅读论文可以说是我们的日常工作之一,论文的数量太多,我们如何快速阅读归纳呢?自从ChatGPT出现以后,有很多阅读论文的服务可以使用。其实使用ChatGPT API非常简单,我们只用30行python代码就可以在本地搭建一个自己的应用。 阅读论文可以说是我们的日常工作之一,论文的数量太多,我们如何快速阅读归纳呢?自从ChatGPT出现以后,有很多阅读论文的服务可以使用。其实使用ChatGPT API非常简单,我们只用30行python代码就可以在本地搭建一个自己的应用。使用 Python 和 C

用ChatGPT秒建大模型!OpenAI全新插件杀疯了,接入代码解释器一键get用ChatGPT秒建大模型!OpenAI全新插件杀疯了,接入代码解释器一键getApr 04, 2023 am 11:30 AM

ChatGPT可以联网后,OpenAI还火速介绍了一款代码生成器,在这个插件的加持下,ChatGPT甚至可以自己生成机器学习模型了。 ​上周五,OpenAI刚刚宣布了惊爆的消息,ChatGPT可以联网,接入第三方插件了!而除了第三方插件,OpenAI也介绍了一款自家的插件「代码解释器」,并给出了几个特别的用例:解决定量和定性的数学问题;进行数据分析和可视化;快速转换文件格式。此外,Greg Brockman演示了ChatGPT还可以对上传视频文件进行处理。而一位叫Andrew Mayne的畅销作

ChatGPT教我学习PHP中AOP的实现(附代码)ChatGPT教我学习PHP中AOP的实现(附代码)Mar 30, 2023 am 10:45 AM

本篇文章给大家带来了关于php的相关知识,其中主要介绍了我是怎么用ChatGPT学习PHP中AOP的实现,感兴趣的朋友下面一起来看一下吧,希望对大家有帮助。

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
1 months agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

Safe Exam Browser

Safe Exam Browser

Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

MantisBT

MantisBT

Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment