ChatGPT has a big explosion in the universe! Turn on the Internet to remove the seal, and the invincible plug-in completely subverts the experience.

When I woke up this morning, the whole Internet was in a state of panic.

Before, everyone recognized that ChatGPT could go up to the sky and into the earth, and was omnipotent. The only drawback was that it could not connect to the Internet. Because its training data set ends in September 21, its understanding of the world after this is still blank.

Now, this only seal has been lifted by OpenAI.

Early this morning, seismic news came from the Internet: OpenAI has added a plug-in for ChatGPT, and now ChatGPT can connect to the Internet!

OpenAI said that after adding the plug-in, ChatGPT will not only read web pages by itself, but also interact with websites. In the words of OpenAI, other services have now become the "eyes and ears" of ChatGPT.

So, humanity is about to usher in the first truly omniscient and omnipotent AI in history?

Omniscient and omnipotent, ChatGPT is coming to the entire universe!

As you can imagine, ChatGPT has now become an all-encompassing ecosystem. Although many applications are still in their early stages and need to be explored, the territories that ChatGPT can expand can be said to be unlimited.

Jim Fan, a disciple of Li Feifei and NVIDIA AI scientist, said excitedly that if the emergence of ChatGPT in the past can be regarded as "the emergence of iPhone", today's integration of third-party plug-ins is " iOS App Store" level events.

Let’s take a look at how amazing ChatGPT’s current capabilities are.

First we need to install a wave of plug-ins.

After that, you can ask questions.

For example, "I am in San Francisco and want to eat vegetarian food this weekend. Can you suggest me which restaurant to visit on Saturday and what recipe to cook on Sunday? Please use WolframAlpha to calculate Find out the calories of the recipe, and finally order the ingredients on Instacart."

All the information you need is perfectly presented immediately.

After the recipe comes out, it will immediately help you place an order on the shopping website Instacart. ChatGPT has already selected the ingredients you need. All you need to do is pay the bill.

Have access to the Internet, know code, and are good at analysis, OpenAI is full of sincerity

The plug-ins officially provided by ChatGPT can be divided into three categories:

• Web Browser: Add Bing search in the loop
• Code Interpreter: Add a live Python interpreter in a sandboxed and firewalled execution environment
• Retrieval: Semantic search of personal and organizational files

Web Browser

OpenAI’s first plug-in web browser, it can be said that Full of sincerity.

This plug-in will use the new Bing API to search for information related to the question on the Internet, and then give specific answers.

For example, you can ask ChatGPT: "Compared with the box office of this year's Oscar-winning movies and the recently released movies, who is higher and who is lower?"

It will immediately search online and give the answer. Apparently, this is something it hasn't been able to do before.

In addition, ChatGPT will also determine whether a Bing interface needs to be provided based on the query content.

Then, we can jump to the specific link through the index in the answer.

Although Bing can also do this function, the ChatGPT plug-in can not only retrieve real-time information, but can also bind APIs and perform operations directly.

For example, Bing can tell you flights and hotels, but ChatGPT can directly help you book flights and hotels!

This browsing function uses Bing’s search API. Microsoft has made great efforts in two aspects:

(1) Ensure the source of information Reliability and authenticity;

(2) Turn on "safety mode" to prevent retrieval of inappropriate content. The plugin runs in an isolated service, so ChatGPT's browsing activity is separate from the rest of it.

So, with this plug-in, will you still use Bing?

Currently, from a security perspective, OpenAI allows this plug-in to only support GET requests and not POST. This means that it can only get data, but not send it.

In addition, OpenAI has also made some crawler restrictions, which are configured as robots.txt files to avoid prohibited content.

If "click failure" occurs during use, it is normal.

Code Interpreter

Yesterday, GitHub released a code generation tool based on GPT-4 GitHub X has caused many programmers to be hit by dimensionality reduction.

But this time, OpenAI launched the "Code Interpreter" programming plug-in, which makes programming by mouth even more powerful.

Currently, this plug-in uses the ChatGPT model that is in the experimental stage.

The model is placed in a firewall-protected sandbox and a small amount of temporary disk space is allocated.

In addition, when the user communicates, the code will be saved in the session and can be called at any time.

This interpreter has several special use cases:

#1. Solve quantitative and qualitative problems Mathematical problems;

2. Perform data analysis and visualization;

3. Quickly convert file formats.

# As the number of people using this plug-in increases, OpenAI encourages users to try more and discover more functions of the code interpreter.

With the help of this code interpreter, we can use ChatGPT to achieve various invincible functions!

For example, let ChatGPT edit a video - as long as you give a command, ChatGPT will process the uploaded video file, and after a while, you can download it directly.

Yes, it exploded like that.

Retrieval

In addition, OpenAI open sourced the code of the knowledge base retrieval plug-in, allowing users to host their own data and make it available on ChatGPT Internally accessible.

Retrieve the address of the plug-in library: https://github.com/openai/chatgpt-retrieval-plugin

This plug-in can be obtained from Get the most relevant snippets from your data, such as files, notes, emails, or public documents.

Here, developers can deploy their own plug-in version and register it with ChatGPT. Embedding OpenAI allows developers to choose a vector database (Milvus, Pinecone, Qdrant, Redis, Weaviate or Zilliz) to index and search documents.

At the same time, these information sources can be synchronized with the database using webhooks.

"Chat Store" is here

In addition to its own plug-ins, OpenAI also released 11 third-party plug-ins this time:

Among them, the first batch of plug-ins were created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram and Zapier.

These plug-ins cover functions such as real-time information retrieval, air ticket booking, online food ordering, transportation navigation, corporate office, and process optimization.

Yes, in the entire ChatGPT universe, a family must be neat and tidy.

In addition, OpenAI also encourages developers to make plug-ins together. However, this authority is not available to everyone and requires an "admission ticket".

You first need to join the waitlist to apply. It is best to fill in your personal GitHub address when applying. This is also one of the criteria used by OpenAI to judge development capabilities.

Creating a plugin requires three steps:

-Build the API

-Use OpenAPI Record API documentation in yaml or JSON format

- Create a JSON manifest file and define the relevant metadata of the plug-in

Science and engineering artifact Wolfram|Alpha

Moreover, the injection of the Wolfram|Alpha plug-in gives the "mathematical novice" ChatGPT a chance to turn around.

Previously, people found that ChatGPT always made mistakes when doing the "chicken and rabbit in the same cage" question. This attracted the attention of Stephen Wolfram, the father of the Wolfram Language.

At that time, Wolfram proposed to solve the mathematical shortcomings of ChatGPT by integrating it into its own Wolfram|Alpha knowledge engine.

As an online automatic question and answer system, Wolfram|Alpha not only has powerful structured computing capabilities, but also can understand natural language.

No, after 2 and a half months, ChatGPT has obtained "Wolfram's super power".

Let’s take a look at ChatGPT’s computing superpowers.

In January, Wolfram used the simple example "How far is it from Chicago to Tokyo" demonstrated by ChatGPT to generate incorrect results.

After adding the plug-in, the capabilities of ChatGPT were immediately enhanced, not only generating correct results, but also giving visual pictures.

How is this achieved? ChatGPT builds a query system for W|A, then sends it to Wolfram|Alpha for calculation, and then "decides what to say" based on the results it reads.

You can view this before and after process by clicking on the "Use Wolfram" box (by viewing this information, you can confirm that ChatGPT is not "making anything up").

Similarly, Wolfram previously noticed that ChatGPT just "fabricated" data that seemed reasonable but was wrong.

The input prompt is as follows. After calling the Wolfram plug-in, ChatGPT outputs a correct and authoritative answer.

We can even use ChatGPT to make charts.

Wolfram also gave a panorama. There are so many things you can do with ChatGPT Wolfram|Alpha.

#The big guys are all blown up! Calling ChatGPT the center of the universe

A few hours ago, the father of ChatGPT directly quoted what he said in April 2022: "We need to name this new computer interface and tell it in natural language Tell the computer what you want, and then directly let them perform the operation. Do you have any ideas?"

Perhaps at that time, the idea of ​​ChatGPT Plugins was already brewing in his mind.

Andrej Karpathy, chief scientist of OpenAI, said:

The GPT class model is a type of model that runs on text The new computer architecture on the Internet can not only talk to us humans, but also "talk" to existing software infrastructure. API is the first step, and plug-ins are the second step.

The era we live in is too explosive...

"If you compare OpenAI to Apple, then GPT-4 is iPhone, ChatGPT is iOS, and the Plugins released this time are App Store."

And domestic netizens I immediately envisioned a series of application scenarios - now you can use ChatGPT to book hotel flights, order takeaways, and shop online, and what these plug-ins are best at is Marketplace. Now, ChatGPT has really become the center of the universe...

Source: Become Musk

Some netizens said that this is the "ChatGPT universe" the beginning of.

#Source: Ni Shuang

And the big V on Weibo "Mu Yao" exclaimed: Using natural language to generate plug-ins is the craziest system I have ever seen in my life.

Finally he prophesied: Python is dead.

Source: Mu Yao

Recently, Microsoft Vice President Yusuf Mehdi expressed such emotion.

Indeed, none of us thought that March would be so crazy.

The above is the detailed content of ChatGPT has a big explosion in the universe! Turn on the Internet to remove the seal, and the invincible plug-in completely subverts the experience.. For more information, please follow other related articles on the PHP Chinese website!