The difficulty of distinguishing is comparable to that of 'real and fake Monkey King', and the hard-to-prevent 'AI face-changing + AI onomatopoeia'

The difficulty of distinguishing is comparable to the "real and fake Monkey King" and the unpredictable "AI face-changing AI onomatopoeia"

AI face-changing creative pictures according to CFP

Screenshots of many songs performed by "AI Stefanie Sun" on the Internet

Change your appearance in one second - Under the wave of AI, "face changing" has also begun to realize technological iterations. Nowadays, in live broadcast rooms and short videos, the anchors sometimes look like Dilraba, sometimes like Yi Yang Qianxi. The names of celebrities you can name, regardless of men, women, old or young, the anchors who act as stars to bring goods can all be covered by their hands. Face behind is implemented behind the screen.

Video AI face-changing refers to using artificial intelligence big data technology to replace the face of a character in the video with the face of another person through technical means based on user needs. Currently, AI face-changing technology has been widely used in short videos, advertisements, movies and other fields, bringing many creative effects.

However, this technology has also been used by some criminals for illegal and criminal activities, namely AI face-changing fraud. Faced with "AI face-changing AI voice-over", it is as difficult as asking you to identify the "real and fake Monkey King" in front of the screen. You cannot easily tell whether Sun Dasheng is real or fake.

"AI fraud" has become a hot search topic on Weibo

According to the "Safe Baotou" WeChat public account, recently, the Telecommunications Cybercrime Investigation Bureau of Baotou City Public Security Bureau announced a case of using intelligent AI technology to commit telecommunications fraud. Mr. Guo, the legal representative of a technology company in Fuzhou City, was arrested within 10 minutes. He was defrauded of 4.3 million yuan, and then the topic #AIfraudisbreakingout became a hot search on Weibo.

How does AI, which has already posed a threat to public interests, commit fraud?

Specifically, criminals will use AI face-changing technology to create fake videos or pictures to carry out fraudulent activities. For example, by replacing the face of a certain character or celebrity in a pornographic video to create a false event, or by replacing the victim's face in some indecent or illegal videos for extortion. These fraudulent activities not only violate the personal privacy and legal rights of the victims, but may also cause huge mental harm and property losses to the victims.

In fact, AI fraud has occurred many times in our country before. According to previous investigative reports by West China Metropolis Daily and cover news reporters, the Wenzhou Public Security Bureau in Zhejiang Province announced that in 2021, the Gongchenqiao Police Station received a call. The victim, Xiao Chen, said that he was blackmailed by the female netizen after video chatting with him. According to the police investigation, the other party used artificial intelligence face-changing technology to synthesize Xiao Chen's face into an indecent video, and then used this video to blackmail him.

In 2020, an executive of a Shanghai company was defrauded out of 1.5 million yuan because the other party used AI face-changing and artificially generated voice technology to make the face of the company leader and asked the executive to transfer money.

“When users use AI face-changing technology to disguise themselves, causing the portrait rights and other rights of the disguised person to be infringed, or causing a lot of damage to other people’s feelings and property, the platform fails to fulfill its reasonable review obligations and fails to effectively regulate the situation. When such behavior occurs, you need to bear certain legal liability for assisting infringement or even direct infringement." Liu Qing, a lawyer at Tahota Law Firm, told reporters that unless the platform intentionally does it or assists the fraudster in committing fraud, it is difficult to determine whether the platform constitutes fraud.

“When using software or Internet products involving AI technology, on the one hand, users should be careful not to maliciously use AI technology to commit illegal acts. On the other hand, they should also pay attention to identifying and verifying the true identity of the communicating party, and do not trust appearances. Think carefully when you need to transfer money or make purchases." Liu Qing pointed out that if people encounter fraud, they should call the police and seek help from the police as soon as possible, and pay attention to retaining relevant materials so that the police can grasp the case as soon as possible and severely punish the criminals. "In addition, once you find that your likeness has been stolen or 'face-changed', you should retain evidence as soon as possible for subsequent rights protection; you can also file a complaint with the network platform operator and request that the infringing pictures or videos be forced to be removed; finally, You can also file a personality rights lawsuit and use legal weapons to protect your legitimate rights and interests."

Recently, the Internet Society of China issued a statement calling on the general public to be more vigilant and strengthen preventive measures against new scams that use artificial intelligence technology. In the AI ​​era, text, sound, images and videos may all be deeply synthesized. In typical scenarios such as transfers, remittances and capital exchanges, additional communication methods such as calling back the other party’s mobile phone number should be used to verify and confirm, rather than relying solely on a single communication channel. Transfer money directly without verification, no matter who the other party is.

Celebs can’t escape the “magic” of AI

Recently, after AI Stefanie Sun became popular on the Internet, singer Stefanie Sun published an article "My AI" on the website, responding to her views on AI technology for the first time. Stefanie Sun described herself as an audience sitting in the best seat of a movie theater, enjoying popcorn, facing the powerful AI technology. "In this boundless sea of ​​existence, everything is possible and everything does not matter. I think it is enough to think pure and be yourself."

But in fact, if "AI" technology uses the voice information of celebrities, it may violate their privacy rights. According to Article 1034 of my country's Civil Code, personal information of natural persons is protected by law. Personal information is a variety of information recorded electronically or otherwise that can identify a specific natural person alone or in combination with other information. If "AI face-changing" or "AI voice-changing" technology is used in a celebrity's live broadcast room without his consent, his privacy rights may be violated.

Someone has posted some "face-changing live broadcast" tutorials on the Internet, claiming that using the corresponding software can better replace your own face with the face of a celebrity in the live broadcast. In this regard, Liu Qing said that according to Article 1024 of my country's Civil Code, no organization or individual may infringe on the reputation rights of others by insulting, slandering, etc. This kind of behavior may infringe on the artist's right of portrait and reputation, and if used for commercial purposes, it may also be suspected of false publicity.

When the reporter inquired about the Civil Code, he found that AI face-changing technology involves a variety of rights, including portrait rights, reputation rights and privacy rights. According to Article 1019 of my country's Civil Code, no organization or individual may create, use, or display the portrait of another person in a manner that defames, defaces, or uses information technology to infringe on the portrait rights of others. Using artificial intelligence face-changing technology to create false portraits will infringe on the portrait rights of others and may lead to infringement disputes.

Who opened the Pandora’s box of AI face-changing?

The development history of AI face-changing live broadcast can be traced back to 2018, when the release of tools such as DeepFaceLab started the development of AI face-changing technology. Major live broadcast platforms have begun to apply AI face-changing live broadcast technology, and this technology is constantly being optimized and upgraded.

In 2020, the American company Genelec (Zoom) launched an AI face replacement function, allowing users to replace their own faces with the faces of others in Zoom video conferences. The development and application of AI face-changing technology have received widespread attention and discussion, and this function also contributes to this.

In 2021, as AI face-changing technology continues to mature and improve, the application scope of AI face-changing live broadcasts will also continue to expand. More and more platforms and companies have launched their own AI real-time face-changing services, such as Douyin’s “Faceu” and “Perfect”. These applications can not only realize face replacement, but also realize the replacement and synthesis of sounds, movements, expressions and other dimensions, making AI face-changing live broadcasts more real and vivid.

However, with the popularity and application of AI face-changing live broadcasts, many controversies and problems have also arisen. Some people believe that AI face-changing live broadcasts may infringe personal privacy and portrait rights, while others worry that AI face-changing live broadcasts may be used for illegal purposes such as false propaganda and pornographic content. Therefore, many countries and regions have begun to formulate relevant policies and regulations to regulate the application and development of artificial intelligence face-changing live broadcasts.

In 2021, a well-known e-commerce platform in my country began to use AI face-changing technology in live broadcasts. Users can use this function to replace their own faces with those of celebrities or Internet celebrities, thereby achieving a more vivid and realistic display effect. . In addition, the e-commerce platform has also launched its own AI face-changing live broadcast service, through which brands can use more realistic and vivid display effects in live broadcasts.

The future of AI face-changing technology will be affected by many parties

Currently, AI face-changing live broadcast has become a trend in my country’s live broadcast industry. More and more platforms and companies have begun to apply AI face-changing technology in live broadcasts. At the same time, with the continuous development and application of technology, the application prospects of AI face-changing live broadcast in my country will become more extensive and diversified, but it is still affected by many factors.

Zhang Lei (pseudonym), a staff member of a leading live broadcast platform, revealed to reporters that according to her experience in the industry, the development of AI technology will promote the progress of AI face-changing live broadcasts. With the continuous optimization and upgrading of AI algorithms, AI face-changing live broadcasts will be more accurate and realistic, thereby better meeting the needs of brands. "Market demand and consumer behavior will also affect the development of AI face-changing live broadcasts. If market demand continues to rise, the development of AI face-changing live broadcasts will be more strongly promoted. The development direction of AI face-changing live broadcasts will be affected by consumer behavior and The influence of preferences, such as which type of live content consumers prefer to watch.”

When Zhang Lei answered reporters about the impact of policies and regulations on AI face-changing, she admitted that policies and regulations have a great impact on the future development of AI face-changing live broadcasts. "If policies and regulations take a positive attitude towards the development of AI face-changing live broadcasts, then the development of AI face-changing live broadcasts may be more rapid and widespread, but everything is still unknown."

West China Metropolis Daily-Cover News Reporter Bian Xue

The above is the detailed content of The difficulty of distinguishing is comparable to that of 'real and fake Monkey King', and the hard-to-prevent 'AI face-changing + AI onomatopoeia'. For more information, please follow other related articles on the PHP Chinese website!