By connecting GPT-4 to “Minecraft”, scientists are discovering new potential of AI

What other tasks can AI accomplish that are beyond human expectations? Recently, Nvidia's artificial intelligence researchers introduced the language model GPT-4 into the sandbox game "Minecraft" in an attempt to explore more complex capabilities of AI.

On May 25, the NVIDIA team and researchers from many universities, including the California Institute of Technology, released Voyager. According to their definition in the paper, Voyager is an open representational agent with a large language model. , is connected to the video game "Minecraft" with a high degree of freedom.

Various operations implemented by AI in the game

The task given to Voyager is to complete various goals in the game, including survival, combat and construction, and to gradually improve his skills with the accumulation of game time and experience.

When the system generates this goal, GPT-4 will automatically generate the code needed to achieve the goal, so that the character can complete the corresponding actions.

The most innovative part of this project is that it uses GPT-4 to generate the code that drives the game characters to act. The AI ​​implementation logic is the same as humans. It will inevitably fail the first time you try a task, but it will collect errors. information and gameplay feedback to adapt the code to the situation and ultimately complete the mission.

As the game time becomes longer, Voyager has established a code base of its own to more quickly build a wide variety of props in the game. This behavior can also be understood as the AI ​​is accumulating its own game experience. Researchers compared Voyager's game progress with other artificial intelligence agents and found that Voyager obtained three times the number of items as other AI agents, and the distance it explored and the speed of building items were also far superior to those of other control groups.

At the same time, Voyager was the first to make a diamond sword

The reason why "Minecraft" was chosen as the testing ground for testing GPT-4 is because this game has a high degree of freedom and does not have too clear goals. If the AI ​​wants to "play well", it needs to evolve. To find out some abilities similar to those of human players, the researchers summarized several key skills.

For example, "Propose appropriate tasks based on its current skill level and world state" - when in the desert, the AI ​​will consider collecting cacti instead of iron ore first. Another example is "improve skills based on environmental feedback and save mastered skills in memory" - as enemies, zombies are similar to spiders, so the combat experience gained from fighting zombies can be used on spiders.

Of course, the ultimate goal of teaching AI to play games is outside of games. Researchers say that by training language models in this way, many daily office tasks may be automated in the future, or based on the needs of users. Automatically achieve certain effects.

However, despite the bright prospects, this experiment is still in its early stages. If you want to really hand over the troublesome work to AI, you may have to wait for a while.

Reference:https://voyager.minedojo.org/

The above is the detailed content of By connecting GPT-4 to “Minecraft”, scientists are discovering new potential of AI. For more information, please follow other related articles on the PHP Chinese website!