The 'Android moment' of domestic large AI models has arrived! Alibaba Cloud Tongyi Qianwen is free, open source, and available for commercial use

After its overseas Meta, Alibaba has become another technology giant that promotes the trend of artificial intelligence (AI) large model "Android moment"

According to reports from Beijing Business Daily, Alibaba Cloud will release the open source general question and answer model Qwen-7B and conversation model Qwen-7B-Chat on Thursday, August 3. Both models have 7 billion parameters. They have launched the first "Model as a Service" open platform in China, the Magic Community, and it can be used for free, and commercial use is also allowed

Users can quantify Qwen-7B and Qwen-7B-Chat through open source code, and deploy and run models on consumer-grade graphics cards. They can directly download the model from the Moda community, or access and call Qwen-7B and Qwen-7B-Chat through the Alibaba Cloud Lingji platform. Alibaba Cloud provides users with services including model training, inference, deployment and fine-tuning

On the Magic Tower community, there is a post dedicated to the installation method of the Tongyi Qianwen model, the best practices for creating space experience, model reasoning and model training, and also attaches screenshots of the model link and download situation

According to public information, Qwen-7B is a base model that is pre-trained using deduplicated and filtered data of more than 2.2 trillion tokens. It supports multiple languages ​​such as Chinese and English, and has a context window length of 8k. The model contains high-quality Chinese, English, multi-language, code, mathematics and other data, covering the entire network text, encyclopedia, books, code, mathematics and vertical fields in various fields

According to the MMLU evaluation results, Qwen-7B performed well in English evaluation, surpassing other similar open source pre-training models and being competitive with larger-scale models. In terms of Chinese evaluation, Qwen-7B achieved the highest score on the C-Eval validation set and was competitive even with larger-scale models

The following is a comparison of the MMLU 5-shot accuracy results of Qwen-7B

Alibaba Cloud has built an AI assistant Qwen-7B-Chat based on the base model through the alignment mechanism. It is a large language model of Chinese and English dialogue based on Transformer, which has successfully achieved alignment with human cognition. The model uses a variety of pre-training data, including online texts, professional books, codes, etc., covering a wide range of areas

The zero-shot accuracy of the Qwen-7B-Chat model on both the C-Eval validation set and the MMLU evaluation set exceeds that of other similar alignment models

The following is a comparison of the zero-shot accuracy results on the C-Eval test set

Alibaba Cloud became the first large technology company in China to join the ranks of open source large models. In July this year, it jointly released with Meta a commercial version of the open source AI model Llama 2, which can replace OpenAI and Google's models. In addition, Zhipu AI and Tsinghua KEG Laboratory also announced China’s top open source large model

in July

The advantages of open source models are to increase user acceptance and provide more data for artificial intelligence processing. The larger the data volume of LLM, the more powerful its function. In addition, the open source model helps researchers and developers find and solve vulnerabilities, improving technology and security levels

At the Alibaba Cloud Summit in April 2023, Alibaba announced the opening of Tongyi Qianwen to enterprises, allowing enterprises to use Tongyi Qianwen’s capabilities to train their own large models

Zhou Jingren, Chief Technology Officer (CTO) of Alibaba Cloud Intelligence Group, said that in the future, enterprises can make full use of Alibaba Cloud's Tongyi Qianwen capabilities and combine their own industry knowledge and application scenarios to train customized enterprise large models. For example, each company can have its own intelligent customer service, intelligent shopping guide, intelligent voice assistant, copywriting assistant, AI designer and self-driving model and other functions

Zhang Yong, CEO of Alibaba Group and CEO of Alibaba Cloud Intelligence Group, said that all Alibaba products will be integrated with the Tongyi Qianwen large model

Alibaba Cloud hopes to help more companies use large models to adapt to the needs of the AI ​​era, so that each company can have its own dedicated large model for its industry capabilities, and reconstruct it based on Tongyi Qianwen

The above is the detailed content of The 'Android moment' of domestic large AI models has arrived! Alibaba Cloud Tongyi Qianwen is free, open source, and available for commercial use. For more information, please follow other related articles on the PHP Chinese website!