MP
MPT 7B
Foundation modelMosaicML Pretrained Transformer-7B
Release date: 2023-05-05Updated: 2023-06-23Views: 372
Parameters
7B
Context length
2K
Multilingual
No data
Reasoning ability
No data
MosaicML Pretrained Transformer-7B is an AI model published by MosaicML, released on 2023-05-05, for Foundation model, with 7B parameters, and 2K context length, requiring about 13.3GB storage.
Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology
MPT 7B
Model basics
Reasoning traces
No data
Thinking modes
Thinking modes not supported
Context length
2K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2023-05-05
Model file size
13.3GB
MoE architecture
No
Total params / Active params
7B / Not applicable
Knowledge cutoff
No data
MPT 7B
Open source & experience
MPT 7B
Official resources
Paper
DataLearnerAI blog
N/A
MPT 7B
API details
API speed
No data
No public API pricing yet.
MPT 7B
Publisher
MosaicML
View publisher details MosaicML Pretrained Transformer-7B
Model Overview
MosaicML Pretrained Transformer-7B is an AI model published by MosaicML, released on 2023-05-05, for Foundation model, with 7B parameters, and 2K context length, requiring about 13.3GB storage.
Foundation model
MPT
View detailsDataLearner on WeChat
Follow DataLearner on WeChat for AI model updates and research notes.
