DataLearner logo
LL

Llama3.1-405B Instruct

Foundation modelLlama3.1

Llama3.1-405B Instruct

Release date: 2024-07-23Updated: 2024-07-23Views: 665
Parameters
405B
Context length
128K
Multilingual
No data
Reasoning ability
No data

Llama3.1-405B Instruct is an AI model published by Facebook AI Research Lab, released on 2024-07-23, for Foundation model, with 405B parameters, and 128K context length, requiring about 800GB storage, with a 867.50 score on Creative Writing.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

Llama3.1-405B Instruct

Model basics

Reasoning traces
No data
Thinking modes
Thinking modes not supported
Context length
128K tokens
Max output length
No data
Model type
Foundation model
Modality (in / out)
No data
Release date
2024-07-23
Model file size
800GB
MoE architecture
No
Total params / Active params
405B / Not applicable
Knowledge cutoff
No data
Llama3.1-405B Instruct

Open source & experience

Code license
Weights license
- Commercial use permitted
Live demo
Llama3.1-405B Instruct

Official resources

Paper
DataLearnerAI blog
Llama3.1-405B Instruct

API details

API speed
No data
No public API pricing yet.
Llama3.1-405B Instruct

Benchmark Results

Llama3.1-405B Instruct currently shows benchmark results led by MBPP (1 / 70, score 88.60), HumanEval (9 / 101, score 89), MMLU (17 / 124, score 88.60). This page also consolidates core specs, context limits, and API pricing so you can evaluate the model from benchmark results and deployment constraints together.

Thinking

General Knowledge

3 evaluations
Benchmark / mode
Score
Rank/total
BBH
Standard Mode
89.20
6 / 21
MMLU
Standard Mode
88.60
17 / 124
MMLU Pro
Standard Mode
73.40
88 / 133

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
MATH
Standard Mode
73.90
17 / 42
GSM8K
Standard Mode
0
68 / 70

Coding and Software Engineer

3 evaluations
Benchmark / mode
Score
Rank/total
HumanEval
Standard Mode
89
9 / 101
MBPP
Standard Mode
88.60
1 / 70
LiveCodeBench
Standard Mode
30.20
122 / 127

Truthfulness Evaluation

1 evaluations
Benchmark / mode
Score
Rank/total
TruthfulQA
Standard Mode
0
2 / 4

General Evaluation

1 evaluations
Benchmark / mode
Score
Rank/total
GPQA Diamond
Standard Mode
49
244 / 270

Common Sense

1 evaluations
Benchmark / mode
Score
Rank/total
SimpleQA
Standard Mode
17.10
36 / 47

Writing and Creative Capabilities

1 evaluations
Benchmark / mode
Score
Rank/total
Creative Writing
Standard Mode
867.50
86 / 99
Llama3.1-405B Instruct

Publisher

Facebook AI Research Lab
Facebook AI Research Lab
View publisher details
Llama3.1-405B Instruct

Model Overview

Llama3.1-405B Instruct is an AI model published by Facebook AI Research Lab, released on 2024-07-23, for Foundation model, with 405B parameters, and 128K context length, requiring about 800GB storage, with a 867.50 score on Creative Writing.

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.

DataLearner WeChat QR code