The AI-drawn version of the MV for 'Mohe Dance Hall' is a hit. Netizens: It feels like AI understands the lyrics

AI painting is really powerful! It simply makes a handicapped person who can't draw take off from the ground and transform into "Makoto Shinkai"!

During the National Day holiday, an Up owner named "The Dog Who Saved the World" on Station B used the AI-generated drawing tool Midjourney to dub the entire song "Mohe Dance Hall" MV. Because these paintings drawn by AI are highly consistent with the text content of the lyrics, many netizens have said that the AI ​​painted the scene in their minds when listening to this song, saying that the aurora at night in Mohe in the painting is so beautiful!

AI painting is one of the research directions of AIGC (AI-Generated Content) Vision-Language, that is, visual-text, input text description and then generate images, Midjourney is this field One of the artifacts.

Currently, this MV for "Mohe Ballroom" drawn by AI has attracted nearly 400,000 views and 1.70,000 likes. Some netizens commented under this video, "It feels like AI It’s like I understand the lyrics.”

1 AI painted a magnificent world for me

In December 2019, when folk singer Liu Shuang was collecting music in Mohe, he met an old man dancing alone in a local dance hall. After a brief conversation, Liu Shuang learned that the old man’s wife had died in the “May 6” incident in Daxinganling in 1987. He was killed in a huge forest fire accident. Since then, the old man has never remarried and has no children. He also likes to dance to commemorate his dancing wife. Liu Shuang used this story as inspiration to create "Mohe Ballroom".

Up Master "The Dog Who Saved the World" was also moved by the story narrated in the song "Mohe Ballroom", and worked hard to describe it to the AI ​​based on the creative background and lyrics of the song A magnificent world.

When the lyrics sing, "If you have time, will you come and take a look at me? See how Daxue ages."

AI drew a picture of an old man standing alone on a snowy country road with a brilliant aurora shining above his head, and a picture of a Russian architectural style street scene covered with thick ice and snow.

The male voice then sings, "How would my eyes melt? If you saw me?"

In the first sentence of the lyrics, AI drew a portrait of a tearful old man with silver hair. In the second sentence of the lyrics, the picture showed a white-haired old woman leaning slightly towards an old man who was hanging his head in thought, as if Calling "If my time had not been fixed thirty years ago, I should be as old and twilight as you are. Can you see what I look like now?"

At this time, the lyrics read, "Let the dust fall into the sea..."

Death took away the young life, and the memory and body were sealed into the sea together. In the painting, there is a man wearing The woman in the dress seems to be standing under the River of Forgetfulness, looking back at the past.

In the interlude of the song, the AI ​​painted the beautiful aurora in Mohe at night, the dance hall full of people, and the dancing figures in the direction of the moonlight. Woman, short-haired girl wearing a beret and night with auroras streaking the sky.

The lyrics sing again, "I have never seen a village where the aurora appears, nor have I seen anyone setting off fireworks late at night."

What came into view was the face of a boy with glowing eyes, a childish face, and a sea of ​​stars, and a girl in red standing in the field under the sky full of fireworks.

Then we get to the song’s favorite lyrics, “Evening stars are like your eyes that kill and set fire, you have nothing Said, the wild wind disturbed me."

AI painted an eye that reflected the starry sky, "The stars are like your eyes, they watched the night full of fire, no matter what Let the flames devour your body." Two people far apart in the grass, watching each other, stood quietly under the green aurora, fearing to disturb each other, and the only thing that was moving was the green breeze that had just passed. The trees and the wind in my ears.

Then, the singer sang about the old man’s longing, “Three thousand miles away, I met you by chance, and in the garden, there was a skirt dancing. ."

The painting shows two people gradually approaching under the cyan aurora, as well as the back of a woman wearing a white dress in the garden.

Then the lyrics sang back, "Under the lights, the morning light was shaken off, in the Mohe Dance Hall in 1980."

AI drew just now The rising sun, the human silhouettes on the floor-to-ceiling windows of the Mohe Ballroom, and the bustling and colorful Mohe Ballroom in the 1980s, "there is you and there is me".

I have to say that the Up owner "The Dog Who Saved the World" and AI jointly created amazing works. Not only do the characters have the same style , the different scenes have bright colors and exquisite compositions, especially the red sun, daylight and ballroom human silhouettes. It is really incredible that AI can put these elements so reasonably on one picture.

2 Humans who understand lyrics and AI that does not understand Asians

Although many authors claim on the title that "every lyric is written by "AI painting", but if you want AI to produce paintings that fit the meaning of the lyrics and touch people's hearts, the human author's interpretation of the background of the song and the meaning of the lyrics, as well as the imagination of the atmosphere and scene created by the lyrics, are indispensable.

If you only input lyrics when the AI ​​paints, such text description is far from enough for the AI. The human author must accurately describe the imagined picture before the AI ​​can Understand what kind of painting to draw, and AI painting is not accomplished overnight. Human creators need to select the one that best fits the lyrics and imagery among n images with the same or similar descriptions, and finally make a good MV. .

Just as the creator of the AI-drawn MV of "Mohe Ballroom" "The Dog Who Saved the World" responded, (it's not that AI understood the lyrics) "It's that I understood the lyrics, Described to the AI ​​in broken English."

Some netizens also left messages, "They are very beautiful, but the characters in this painting look and wear The clothing style doesn’t seem to happen in China.”

“Maybe this AI didn’t learn how Asians draw when it was learning.”

"This material library is not mainly from Asia, and there are even very few libraries from Southeast Asia and South Asia, so the characters look very Russian."

These comments all highlight the current situation of AI painting pain points. The databases used by many AI-generated drawing tools in the deep learning stage are mostly from European and American picture websites, making AIs less good at drawing Asian faces and Oriental imagery.

Although AI painting still has a long way to go, not all paintings are completely beautiful. Human painters are always required to adjust certain details. There are still many flaws in portrait generation. Screenshot from the MV above You can find some flaws in AI painting, such as: "eyelashes should not be mixed with hair", "the character's limbs look uncoordinated" and "the head is incomplete", etc., but we must admit that AI painting is really progressing very quickly , from the past I could only draw simple avocado-shaped furniture, to now I can create large and magnificent paintings. The overall progress in color and composition has been great, which is amazing.

Maybe in the future AI will not paint frame by frame, but create continuous animations. We look forward to that day.

The above is the detailed content of The AI-drawn version of the MV for 'Mohe Dance Hall' is a hit. Netizens: It feels like AI understands the lyrics. For more information, please follow other related articles on the PHP Chinese website!