Llama3-400B-Instruct-InTraining

Name: Llama3-400B-Instruct-InTraining
Author: Facebook AI研究实验室

基础大模型

Release date: 2024-04-18更新于: 2024-04-19 00:44:26584

Live demo

Llama3-400B-Instruct-InTraining is an AI model published by Facebook AI研究实验室, released on 2024-04-18, for 基础大模型, with 4000.0B parameters, and 8K tokens context length, requiring about 800GB storage, under the Llama 2 Community License Agreement license.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

Llama3-400B-Instruct-InTraining

Model basics

Reasoning traces

Not supported

Thinking modes

Thinking modes not supported

Context length

8K tokens

Max output length

No data

Model type

基础大模型

Release date

2024-04-18

Model file size

800GB

MoE architecture

Total params / Active params

4000.0B / N/A

Knowledge cutoff

No data

Llama3-400B-Instruct-InTraining

Open source & experience

Code license

Llama 2 Community License Agreement

Weights license

Llama 2 Community License Agreement- 免费商用授权

GitHub repo

https://github.com/meta-llama/llama3

Hugging Face

Hugging Face link unavailable

Live demo

No live demo

Llama3-400B-Instruct-InTraining

Model Overview

还在训练中的4000亿参数规模的Llama3-400B-Instruct

Llama3-400B-Instruct-InTraining

Model basics

Open source & experience

Official resources

API details

Benchmark Results

Publisher

Model Overview

DataLearner 官方微信