加载中...

DBRX Instruct - AI Model Details and Benchmarks | DataLearnerAI

DBRX Instruct

Name: DBRX Instruct
Author: databricks

Release date: 2024-03-27更新于: 2024-03-27 21:38:08562

Live demo GitHub Hugging Face Compare

Parameters

1320.0亿

Context length

32K

Chinese support

Not supported

Reasoning ability

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

DBRX Instruct

Model basics

Reasoning traces

Not supported

Context length

32K tokens

Max output length

No data

Model type

聊天大模型

Release date

2024-03-27

Model file size

DBRX Instruct

Open source & experience

Code license

Databricks Open Model License

Weights license

Databricks Open Model License- 免费商用授权

GitHub repo

https://github.com/databricks/dbrx

Hugging Face

https://huggingface.co/databricks/dbrx-instruct

DBRX Instruct

Official resources

Paper

Introducing DBRX: A New State-of-the-Art Open LLM

DataLearnerAI blog

No blog post yet

DBRX Instruct

API details

API speed

No data

No public API pricing yet.

DBRX Instruct

Benchmark Results

No benchmark data to show.

DBRX Instruct

Publisher

databricks

View publisher details

DBRX Instruct

Model Overview

DBRX Instruct是基于DBRX Base模型进行指令优化微调得到的一个大语言模型。它是由Databricks开源。包含了1320亿参数的混合专家大模型。共16个专家网络，每次推理有4个专家工作，激活360亿的参数。

该模型在各个评测结果上表现都很好，超过了另外两个著名的混合专家模型Mixtral-8*7B-MoE模型和马斯克开眼的Grok-1模型。前者是由MistralAI开源的著名的混合专家模型，也是此前开源大模型中表现最好的模型之一。

关于Mixtral-8*7B-MoE模型参考： https://www.datalearner.com/ai-models/pretrained-models/Mistral-7B-MoE

关于Grok-1模型参考： https://www.datalearner.com/ai-models/pretrained-models/Grok-1

DataLearner 官方微信

欢迎关注 DataLearner 官方微信，获得最新 AI 技术推送