Qwen1.5-MoE-A2.7B

Name: Qwen1.5-MoE-A2.7B
Author: 阿里巴巴

基础大模型

Qwen1.5-MoE-A2.7B

Release date: 2024-03-28更新于: 2024-04-07 22:05:35587

Live demo

Qwen1.5-MoE-A2.7B is an AI model published by 阿里巴巴, released on 2024-03-28, for 基础大模型, with 143.0B parameters, and 1K tokens context length, requiring about 3.46GB storage, under the Tongyi Qianwen RESEARCH LICENSE AGREEMENT license.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

Qwen1.5-MoE-A2.7B

Model basics

Reasoning traces

Not supported

Thinking modes

Thinking modes not supported

Context length

1K tokens

Max output length

No data

Model type

基础大模型

Release date

2024-03-28

Model file size

3.46GB

MoE architecture

Total params / Active params

143.0B / N/A

Knowledge cutoff

No data

Qwen1.5-MoE-A2.7B

Open source & experience

Code license

Tongyi Qianwen RESEARCH LICENSE AGREEMENT

Weights license

Tongyi Qianwen RESEARCH LICENSE AGREEMENT- 免费商用授权

GitHub repo

https://github.com/QwenLM/Qwen1.5

Hugging Face

https://huggingface.co/Qwen

Live demo

No live demo

Qwen1.5-MoE-A2.7B

Model Overview

阿里巴巴开源的阿里系首个MoE大语言模型，143亿参数模型效果与70亿差不多，但是每次推理只激活27亿参数，可以在手机端运行。

Qwen1.5-MoE-A2.7B

Model basics

Open source & experience

Official resources

API details

Benchmark Results

Publisher

Model Overview

DataLearner 官方微信