Tesla humanoid robot further evolves: realizing yoga capabilities through visual autonomous classification

The Tesla humanoid robot Optimus Prime (Optimus), which has been dormant for several months, finally has new developments. I remember the last time I saw it was at the Tesla Shareholders Meeting. At that time, Optimus demonstrated skills such as walking freely and flexibly grabbing and putting down objects.

Tesla Optimus got another upgrade today. Now, it has the ability to classify objects autonomously. The most striking of these are neural networks that are fully trained end-to-end: input video, output control. This is similar to the neural network training in the development of Tesla’s self-driving FSD V12, which can process all input signals and output driving decisions

Can’t help but ask , how to do it?

Optimus has the ability to self-calibrate its arms and legs. Using only vision and joint position encoders, it can accurately position its limbs in space

Optimus has precise calibration capabilities, allowing it to learn a variety of tasks more efficiently. It fully implements on-board operation on its neural network using only visual input

In this way, Optimus can classify objects by color completely autonomously.

Even if there is interference, Optimus is still able to accurately classify objects by color

# Optimus has also demonstrated the ability to perform autonomous corrections (straightening an object that is crooked).

After training, it can also perform new tasks, such as shuffling classified objects.

After a long day of "work", it's time to stretch and put your hands together.

Team senior software engineer Julian Ibarz said, "I am very happy to share the team's Progress has been made over the past few months. Now Optimus can complete long-term tasks, such as automatically classifying objects in a completely task-agnostic manner. New complex tasks can be trained without any code changes, simply by collecting more data.”

Musk also confirmed this "progress"

Netizens were shocked and also raised some questions, such as whether it is possible to enter prompt to let Optimus perform tasks? The answer is yes, the same network is used in videos to perform classification or unclassification tasks, just tell Optimus what you want to do.

Optimus's "Past and Present Life"

Optimus was not a physical robot from the beginning. From a universal robot plan like "Tesla Bot", it is slowly hatched.

Musk showed the general shape of Tesla Bot at the "Tesla AI Day" in 2021.

Even during the demonstration of Tesla Bot’s movements, the staff wore special tight-fitting costumes and performed a dance pretending to be a robot. But it is such an idea that gradually takes root and moves towards reality, surprising people with breakthroughs time and time again.

One year later, at the "Tesla AI Day", Tesla Bot, once played by a human, became the robot Optimus.

Optimus greets people at Tesla AI Day 2022

When Optimus first appeared, he was already able to carry boxes, water flowers, and work in a factory. However, that's not Optimus' ultimate goal. Optimus' goal is to become a humanoid robot with a "brain"

Optimus works in the Tesla Gigafactory

Musk said that it only took half a year to design the robot, and there is a lot to look forward to in its future shape.

At the 2023 Tesla Shareholders Meeting, Optimus performed even better, with a smoother pace and more skillful movements

Optimizers can flexibly grab and put down objects

And now, Optimus has continued to move towards its goal, and the journey to possessing a "brain" has also become faster and faster. The path becomes clearer. We'll have to wait and see how it evolves next time.

The above is the detailed content of Tesla humanoid robot further evolves: realizing yoga capabilities through visual autonomous classification. For more information, please follow other related articles on the PHP Chinese website!