Digital people participate in "Under the Stranger", Alibaba Entertainment CTO Zheng Yong: Using AI to create a new sample of virtual production

On September 26, Zheng Yong, chief technology officer of Alibaba Entertainment, mentioned in an interview with the media the participation of hyper-realistic digital people in "Under the Stranger". He said that compared with traditional virtual production, digital human characters created through self-developed AI technology are not only closer to real-person shooting in presentation, but can also improve the efficiency and quality of the crew. He said: "This is a starting point, which is a milestone for Alibaba Entertainment and even the entire industry. In the future, we will also launch the male digital character 'Xun Yan'."

Alibaba Entertainment CTO Zheng Yong

Although he is a digital person, Lili’s real-person qualities in the play impressed the audience deeply. In the scene with real actors, you can clearly see the subtle changes in Lili's facial expressions, and her body movements are also very natural. In the panoramic lens, the reflection effect of Lili's body light and shadow and ambient light is no different from that of a real person.

By training the AI ​​model, we made Lili more natural and coordinated in terms of expression, mouth shape and skin texture. We have also added intelligent light field technology to make the light and shadow effects of digital people at different viewing angles more high-quality. In order to achieve a more realistic effect, Lili no longer uses facial beauty, but uses real skin models

Through intelligent light fields, the light and shadow effects of digital people under different viewing angles can be presented with higher quality.

Rewritten as: Lili’s virtual production technology allows “Under the Stranger” to present more realistic effects and greatly optimize costs and efficiency. It is understood that compared with traditional digital human production, Lili uses AI technology to reduce the investment cost and time in modeling and original painting. At the same time, it no longer relies on motion capture technology, reducing production costs by 80% and improving efficiency. Improved by 40%

Zheng Yong said that for the film and television industry, the ultimate purpose of technology is to provide services for content. "Under the Stranger" is adapted from the IP of the Chinese comic. The character "Er Zhuang" in the original work can only communicate with the outside world through brain waves due to his special characteristics. Through the presentation of digital humans, it not only perfectly fits the original characters, but also calms the dissatisfaction of many original fans

In order to achieve a more realistic effect for the character, Lili removed the beautification and turned on the real skin model.

During the audition process of "Under the Stranger", director Xu Hongyu also trained Lili to make various extreme expressions in order to master the critical value of the digital model and make the character's expression and action design more comfortable. Zheng Yong said that after being trained by the director, Lili also showed stronger expressiveness in the Tmall commercials he shot later.

Before participating in "Under the Stranger", Lili had already cooperated with many IPs, including Netflix, Makoto Shinkai's "Suzuya's Journey", "30,000 Miles from Chang'an", "One Piece", etc. . In addition, he has also cooperated with many brands such as Intel, MLB, Huawei, and Tmall. Zheng Yong revealed: "In the future, we will carry out a series of creations around Lili in the fields of film and television content, commercial endorsements, offline performances, etc." The second digital idol IP to be launched by Alibaba Entertainment is the Chinese style male digital man "Xun Yan" ”

The above is the detailed content of Digital people participate in "Under the Stranger", Alibaba Entertainment CTO Zheng Yong: Using AI to create a new sample of virtual production. For more information, please follow other related articles on the PHP Chinese website!