


Former Tesla director and OpenAI expert Karpathy: I was distracted by autonomous driving, AI agents are the future!
Recently, Andrej Karpathy, co-founder of OpenAI, former director of TeslaAI, and now returning to OpenAI, shared his views on AI agents at a developer event.
Seven years ago, the time to study AI agents was not yet mature
He first talked about his early work at OpenAI (in 2016 ), the industry trend at that time was to study how to use reinforcement learning methods to improve AI agents.
Many projects are making AI players based on games like Atari.
Picture
What he wanted to do at that time was a product with a wider range of applications.
However, due to the technical limitations at the time, the results were not good, so he and OpenAI changed direction and began to develop larger language models.
Of course, I was distracted by the automatic driving during this period.
But now, five years later, AI agents have become a very promising direction again.
Because there are now new technical means to study AI agents, the situation is completely different from 2016.
The simplest example is that no one is using reinforcement learning methods to study AI agents anymore like they did in 2016.
The current research methods and directions were unimaginable back then.
AI agents represent a crazy future, although it may be a bit far away
Because in the future, if AGI can appear, it will Give full play to the capabilities of AI agents.
The AI agent in the future may not be a single individual, but there will be many AI agent organizations or even AI agent civilizations.
Picture
This could be a very exciting, even crazy, future.
But at the same time, everyone must stay awake and calm.
Because some technology trends may be easy to conceive and envision, but it is difficult to implement products.
Many technologies fall into this category, such as autonomous driving.
Technological visions are easy to envision, and demonstrations of cars driving around the block are easy to create, but it can take 10 years to create a product.
Similarly, VR is also the same situation.
Picture
AI agents may also belong to this category of technology. The application scenarios are easy to imagine and the prospects are exciting. But it requires long-term technological development and accumulation.
AI agents need to draw inspiration from neuroscience
Just like the early development of deep learning, the development of AI agents may Get inspired by neuroscience.
It is interesting to think about the relationship between AI agents and neuroscience.
Especially now that many people regard large language models as part of their AI agent solutions.
But how to build a complete digital entity that possesses all human cognitive abilities?
Obviously, we all agree that there needs to be some underlying system for planning, thinking and reflecting on what we are doing.
This may be where neuroscience can help.
For example, the hippocampus is a very important part of the brain.
But what in the AI agent plays the role of the hippocampus to store memories, implement tagging and retrieval, etc.?
We have a general understanding of how to build the visual and auditory cortex, but there is still a lot we don’t know about what exactly it means in an AI agent.
For example, what does the thalamus, the seat of the subconscious, correspond to in AI Agents?
These are very interesting questions.
I specially brought a book on neuroscience, "Brain and Behavior" by David Eagleman. I found this book very interesting and enlightening.
Just as early AI research did when designing neurons, drawing interesting inspiration from neuroscience may be a direction we should try again.
Everyone here is at the forefront of the industry
You may not necessarily know it, but the AI agents built by everyone present today are already at the forefront of the industry. The cutting edge of AI agent capabilities.
I don’t think any of the institutions currently working on large-scale language models, such as OpenAI, are at the forefront of this field.
The forefront is all of you here.
For example, OpenAI is very good at training Transformer language models.
If a paper proposes a different training method, then everyone in our OpenAI internal Slack group will discuss:
"I tried this method two and a half years ago, but it didn't work."
We are very clear about the ins and outs of the method of training the model.
But when the paper on AI agents comes out, all of us will be very interested and think it is amazing.
Because our team has spent the last five years elsewhere.
Picture
We don’t know more than you in this field, and we stand on the same level of competition as everyone else .
This is why I think everyone here is at the forefront of AI agents. This is very important for the development of AI agents.
The above is the detailed content of Former Tesla director and OpenAI expert Karpathy: I was distracted by autonomous driving, AI agents are the future!. For more information, please follow other related articles on the PHP Chinese website!

This article explores the growing concern of "AI agency decay"—the gradual decline in our ability to think and decide independently. This is especially crucial for business leaders navigating the increasingly automated world while retainin

Ever wondered how AI agents like Siri and Alexa work? These intelligent systems are becoming more important in our daily lives. This article introduces the ReAct pattern, a method that enhances AI agents by combining reasoning an

"I think AI tools are changing the learning opportunities for college students. We believe in developing students in core courses, but more and more people also want to get a perspective of computational and statistical thinking," said University of Chicago President Paul Alivisatos in an interview with Deloitte Nitin Mittal at the Davos Forum in January. He believes that people will have to become creators and co-creators of AI, which means that learning and other aspects need to adapt to some major changes. Digital intelligence and critical thinking Professor Alexa Joubin of George Washington University described artificial intelligence as a “heuristic tool” in the humanities and explores how it changes

LangChain is a powerful toolkit for building sophisticated AI applications. Its agent architecture is particularly noteworthy, allowing developers to create intelligent systems capable of independent reasoning, decision-making, and action. This expl

Radial Basis Function Neural Networks (RBFNNs): A Comprehensive Guide Radial Basis Function Neural Networks (RBFNNs) are a powerful type of neural network architecture that leverages radial basis functions for activation. Their unique structure make

Brain-computer interfaces (BCIs) directly link the brain to external devices, translating brain impulses into actions without physical movement. This technology utilizes implanted sensors to capture brain signals, converting them into digital comman

This "Leading with Data" episode features Ines Montani, co-founder and CEO of Explosion AI, and co-developer of spaCy and Prodigy. Ines offers expert insights into the evolution of these tools, Explosion's unique business model, and the tr

This article explores Retrieval Augmented Generation (RAG) systems and how AI agents can enhance their capabilities. Traditional RAG systems, while useful for leveraging custom enterprise data, suffer from limitations such as a lack of real-time dat


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

SublimeText3 Chinese version
Chinese version, very easy to use

mPDF
mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

Safe Exam Browser
Safe Exam Browser is a secure browser environment for taking online exams securely. This software turns any computer into a secure workstation. It controls access to any utility and prevents students from using unauthorized resources.

PhpStorm Mac version
The latest (2018.2.1) professional PHP integrated development tool

Notepad++7.3.1
Easy-to-use and free code editor