DeepSeekMoE 16B Base

Name: DeepSeekMoE 16B Base
Author: DeepSeek-AI

Foundation modelDeepSeekMoE

Release date: 2024-01-11Updated: 2024-01-11 14:40:02.873653

Live demoGitHub Hugging Face Compare

Parameters

16.4B

Context length

Chinese support

Supported

Reasoning ability

DeepSeekMoE 16B Base is an AI model published by DeepSeek-AI, released on 2024-01-11, for Foundation model, with 16.4B parameters, and 4K context length, requiring about 32.77GB storage, under the DEEPSEEK LICENSE AGREEMENT license.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

DeepSeekMoE 16B Base

Model basics

Reasoning traces

Not supported

Thinking modes

Thinking modes not supported

Context length

4K tokens

Max output length

No data

Model type

Foundation model

Modality (in / out)

No data

Release date

2024-01-11

Model file size

32.77GB

MoE architecture

Total params / Active params

16.4B / N/A

Knowledge cutoff

No data

DeepSeekMoE 16B Base

Open source & experience

Code license

MIT License

Weights license

DEEPSEEK LICENSE AGREEMENT- 免费商用授权

GitHub repo

https://github.com/deepseek-ai/DeepSeek-MoE

Hugging Face

https://huggingface.co/deepseek-ai/deepseek-moe-16b-base

Live demo

No live demo

DeepSeekMoE 16B Base

Official resources

Paper

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

DataLearnerAI blog

No blog post yet

DeepSeekMoE 16B Base

API details

API speed

No data

No public API pricing yet.

DeepSeekMoE 16B Base

Benchmark Results

No benchmark data to show.

Compare with other models

No curated comparisons for this model yet.

Want a custom combination? Open the compare tool

DeepSeekMoE 16B Base

Publisher

DeepSeek-AI

View publisher details

DeepSeekMoE 16B Base

Model Overview

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.