New title: Douyin launches automatic translation function of local dialects to easily generate Mandarin subtitles

According to news from this website on September 25, Douyin announced the launch of automatic translation function for local dialects. Creators can use this function to convert Cantonese, Fujian, Wu, Southwest Mandarin, Central Plains Mandarin and other dialect videos into Mandarin subtitles with "one click" to facilitate public viewing.

According to reports, creators can click "Shoot and upload submission" on the main interface of Douyin submission.

After uploading the video, use the "automatic subtitles" function and select "Convert to Mandarin subtitles", The new function can automatically recognize dialect speech in video content and convert the dialect content in the video into Mandarin subtitles.

Currently, the first phase of the new function has been launched, supporting Cantonese, Fujian, Wu dialect (Shanghai), Southwest Mandarin (Sichuan), Central Plains Mandarin (Shaanxi, Henan), etc., and will support more dialect conversions in the future , friends on this website can experience it by themselves.

Douyin officials stated that since local dialects are often spread in spoken form, there is less dialect data available for model training, which poses great challenges to dialect recognition and translation. In this regard, the technical team from Volcano Engine adopted a self-developed self-supervised pre-training model and a multi-language translation model,

achieved the ability to identify dialects with a very small amount of annotated data, and doubled the training efficiency , effectively improving the performance of multi-language translation and significantly reducing the resource consumption of model training. "Based on the technical accumulation of daily service to Douyin Group's business, Douyin dialect subtitles can achieve ultra-low latency and high accuracy," said its team leader.

The person in charge of the governance of Douyin platform said that they will continue to use technology to record real and beautiful life. In the future, they will further upgrade the dialect automatic translation function to better serve the cultural communication in various places using dialects as the carrier. Advertising statement: This article contains external jump links (including but not limited to hyperlinks, QR code, password, etc.), designed to provide more information and save screening time, but are for reference only. Please note that all articles on this site contain this statement

The above is the detailed content of New title: Douyin launches automatic translation function of local dialects to easily generate Mandarin subtitles. For more information, please follow other related articles on the PHP Chinese website!