Alibaba Cloud launches "Tongyi Listening", a large model-based work and learning AI assistant: intelligent recording summary, real-time translation

News on June 1st, the 2023 Alibaba Cloud Summit Guangdong-Hong Kong-Macao Greater Bay Area was held in Guangzhou today. Alibaba Cloud Intelligence Chief Technology Officer Zhou Jingren announced the launch of the latest product of the Tongyi family - the work and study AI assistant "Tongyi Tingwu" , which relies on large models and can be used in scenarios such as conference discussions, teaching and training, research interviews, and video viewing.

According to the official introduction, Tongyi Tingwu is connected to the understanding and summarization capabilities of the Tongyi Qianwen large model, and can become a powerful AI assistant for users in work and study, helping Efficiently complete the transcription, retrieval, summary and organization of audio and video content anytime and anywhere, such as using large models to automatically take notes, organize interviews, extract PPT, etc. During the public beta period, users can receive more than 100 hours of free transcription time.

Zhou Jingren introduced that Tongyi Listening can provide a brand-new audio and video experience. In terms of real-time dialogue, it can record, multi-language translation, speech summary, and question review in real time; in terms of video experience, Tongyi Listening supports cloud disk import and local upload, chapter quick overview, full text summary, etc.

According to the on-site demonstration, Tingwu integrates more than ten AI functions, which can comprehensively improve the efficiency of transforming knowledge from audio and video to graphic and text forms. In addition to "good hearing", it can generate meeting records with high accuracy and distinguish different speakers. This AI assistant is also "extremely perceptive". The large model can divide audio and video into chapters in one second and form summary, summary and full text of each speaker. Points of view, organization of focus and to-do items. In the near future, large-scale models will be launched with multiple functions such as one-click extraction of PPT, asking AI questions about various audio and video contents, and summarizing specific paragraphs.

According to reports, Tongyi Tingwu will begin its official public beta test on June 1, and users can visit the official website tingwu.aliyun.com

IT House learned from the official website of Tongyi Tingwu that Tongyi Tingwu supports real-time transcription and audio and video conversion in scenarios such as meetings, courses, interviews, training, etc., intelligently generates summaries, and real-time translation to break cross-language communication. obstacle. Tongyi Listening not only supports quick marking of key information, but also can easily export recognition results and notes to local or Alibaba Cloud disks, thereby improving the efficiency of knowledge management.

Official introduction to the core competencies of Tongyi Listening and Comprehension:

Real-time voice transcription, generating intelligent records, search and positioning to help efficient review

• Enable real-time recording, complete Precipitate communication content, generate records accurately and quickly, and play corresponding sounds and words
• Support independent search for keywords, accurately locate core information, and easily review the key points of the conversation

File transcription, uploading massive files at the same time, helping you save time and effort

• Quickly upload audio and video files such as meetings, studies, interviews, etc., 50 files can be uploaded at the same time A local file, or you can upload a file in Alibaba Cloud Disk
• Supports automatic differentiation of speakers, and the transcription results are automatically saved in "My Records" for easy viewing and review at any time

Real-time translation, supports Chinese-English translation, smooth cross-language collaboration

• After the real-time transcription and completion, Supports one-click translation between Chinese and English, breaking language barriers and easily achieving barrier-free communication

Quickly mark, highlight key points, questions, and to-do items, and key information is clear at a glance

• Supports highlighting of key points, questions, and to-do items, supports filtering and batch excerpts, and makes review and organization clearer

Easy export, rich content for you to choose, various formats for you to choose

• Support Download the original text, notes, audio and video and translation, and export the required content with one click
• Multiple download document formats: support word, pdf and srt subtitle file export

The above is the detailed content of Alibaba Cloud launches "Tongyi Listening", a large model-based work and learning AI assistant: intelligent recording summary, real-time translation. For more information, please follow other related articles on the PHP Chinese website!