DataLearner logo
DE

DeepSeekMoE 16B Base

Foundation modelDeepSeekMoEDeepSeekMoE

DeepSeekMoE 16B Base

Release date: 2024-01-11Updated: 2024-01-11Views: 663
Parameters
16.4B
Context length
4K
Multilingual
Supported
Reasoning ability
No data

DeepSeekMoE 16B Base is an AI model published by DeepSeek-AI, released on 2024-01-11, for Foundation model, with 16.4B parameters, and 4K context length, requiring about 32.77GB storage.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

DeepSeekMoE 16B Base

Model basics

Reasoning traces
No data
Thinking modes
Thinking modes not supported
Context length
4K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2024-01-11
Model file size
32.77GB
MoE architecture
No
Total params / Active params
16.4B / Not applicable
Knowledge cutoff
No data
DeepSeekMoE 16B Base

Open source & experience

Code license
Weights license
DeepSeek License Agreement- Commercial use permitted
Live demo
N/A
DeepSeekMoE 16B Base

Official resources

Paper
DataLearnerAI blog
N/A
DeepSeekMoE 16B Base

API details

API speed
No data
No public API pricing yet.
DeepSeekMoE 16B Base

Publisher

DeepSeekMoE 16B Base

Model Overview

DeepSeekMoE 16B Base is an AI model published by DeepSeek-AI, released on 2024-01-11, for Foundation model, with 16.4B parameters, and 4K context length, requiring about 32.77GB storage.

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.

DataLearner WeChat QR code