search
HomeTechnology peripheralsAIOpenAI announces new team to control 'super-intelligent' artificial intelligence

OpenAI宣布组建新团队 以控制“超级智能”人工智能

News on July 6, on Wednesday, local time in the United States, artificial intelligence startup OpenAI announced that it is forming a new team to develop guidance and control of "superintelligent" ) approach to artificial intelligence systems. The team is led by Ilya Sutskever, chief scientist and co-founder of OpenAI.

In a blog post, Suskwell and Jan Leike, head of the OpenAI coordination team, predicted that artificial intelligence with greater intelligence than humans will emerge within a decade. They warn that such artificial intelligence will not necessarily be benevolent towards humans, so it will be necessary to research ways to control and limit it.

Suskwell and Lake wrote: "Currently, we do not have any solutions that can be used to manipulate or control a potentially superintelligent AI and prevent it from getting out of hand. Our current techniques for tuning AI, such as Reinforcement learning from human feedback relies on the ability of humans to supervise artificial intelligence. But humans will not be able to reliably supervise artificial intelligence systems that are much smarter than us." ), OpenAI is creating a new super-aligned team, co-led by Susqueville and Lake, which will have access to up to 20% of OpenAI’s computing resources. This team will work over the next four years to solve the core technical challenges of controlling superintelligent artificial intelligence, along with scientists and engineers from OpenAI's former Alignment Division, as well as researchers from other parts of the company.

So, how do we ensure that artificial intelligence systems that are much smarter than humans follow human intentions? This will require the help of what Suskville and Lake describe as "human-level automated alignment researchers." The high-level goals are to use human feedback to train AI systems, train AI to assist in the evaluation of other AI systems, and ultimately build AI that can conduct alignment studies. “Alignment research” here refers to ensuring that the artificial intelligence system achieves the expected results or does not deviate from the research track.

OpenAI’s hypothesis is that artificial intelligence can perform alignment research faster and better than humans.

"As we make progress in this area, our artificial intelligence systems can take over more and more of the alignment work and ultimately conceive, implement, research and develop better alignment technologies than we have today," Lake and colleagues John Schulman and Jeffrey Wu hypothesized in a previous blog post. "They will work with humans to ensure that their own successors are always aligned with humans. Human researchers will increasingly focus on reviewing alignment studies done by AI systems, rather than conducting such studies themselves Research."

Of course, no method is foolproof, and Lake, Schulman, and Jeffrey Wu acknowledge in their article that OpenAI's approach has many limitations. They say using AI for assessment has the potential to amplify inconsistencies, biases or vulnerabilities in AI. It may turn out that the most difficult part of the alignment problem may have nothing to do with engineering at all.

But Suskville and Lake decided it was worth a try. They write: "Superintelligent alignment is fundamentally a machine learning problem, and we believe that good machine learning experts (even if they haven't started working on alignment) will be critical to solving this problem. We plan to share this widely The results of our efforts and regard promoting the consistency and security of non-OpenAI models as an important part of our work."

The above is the detailed content of OpenAI announces new team to control 'super-intelligent' artificial intelligence. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
What is Few-Shot Prompting? - Analytics VidhyaWhat is Few-Shot Prompting? - Analytics VidhyaApr 22, 2025 am 09:13 AM

Few-Shot Prompting: A Powerful Technique in Machine Learning In the realm of machine learning, achieving accurate responses with minimal data is paramount. Few-shot prompting offers a highly effective solution, enabling AI models to perform specific

What is Temperature in prompt engineering? - Analytics VidhyaWhat is Temperature in prompt engineering? - Analytics VidhyaApr 22, 2025 am 09:11 AM

Prompt Engineering: Mastering the "Temperature" Parameter for AI Text Generation Prompt engineering is crucial when working with large language models (LLMs) like GPT-4. A key parameter in prompt engineering is "temperature," whi

Are You At Risk Of AI Agency Decay? Take The Test To Find OutAre You At Risk Of AI Agency Decay? Take The Test To Find OutApr 21, 2025 am 11:31 AM

This article explores the growing concern of "AI agency decay"—the gradual decline in our ability to think and decide independently. This is especially crucial for business leaders navigating the increasingly automated world while retainin

How to Build an AI Agent from Scratch? - Analytics VidhyaHow to Build an AI Agent from Scratch? - Analytics VidhyaApr 21, 2025 am 11:30 AM

Ever wondered how AI agents like Siri and Alexa work? These intelligent systems are becoming more important in our daily lives. This article introduces the ReAct pattern, a method that enhances AI agents by combining reasoning an

Revisiting The Humanities In The Age Of AIRevisiting The Humanities In The Age Of AIApr 21, 2025 am 11:28 AM

"I think AI tools are changing the learning opportunities for college students. We believe in developing students in core courses, but more and more people also want to get a perspective of computational and statistical thinking," said University of Chicago President Paul Alivisatos in an interview with Deloitte Nitin Mittal at the Davos Forum in January. He believes that people will have to become creators and co-creators of AI, which means that learning and other aspects need to adapt to some major changes. Digital intelligence and critical thinking Professor Alexa Joubin of George Washington University described artificial intelligence as a “heuristic tool” in the humanities and explores how it changes

Understanding LangChain Agent FrameworkUnderstanding LangChain Agent FrameworkApr 21, 2025 am 11:25 AM

LangChain is a powerful toolkit for building sophisticated AI applications. Its agent architecture is particularly noteworthy, allowing developers to create intelligent systems capable of independent reasoning, decision-making, and action. This expl

What are the Radial Basis Functions Neural Networks?What are the Radial Basis Functions Neural Networks?Apr 21, 2025 am 11:13 AM

Radial Basis Function Neural Networks (RBFNNs): A Comprehensive Guide Radial Basis Function Neural Networks (RBFNNs) are a powerful type of neural network architecture that leverages radial basis functions for activation. Their unique structure make

The Meshing Of Minds And Machines Has ArrivedThe Meshing Of Minds And Machines Has ArrivedApr 21, 2025 am 11:11 AM

Brain-computer interfaces (BCIs) directly link the brain to external devices, translating brain impulses into actions without physical movement. This technology utilizes implanted sensors to capture brain signals, converting them into digital comman

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

MantisBT

MantisBT

Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool

WebStorm Mac version

WebStorm Mac version

Useful JavaScript development tools