DataLearner logo

Llama3.1-405B Instruct Benchmark Details

Llama3.1-405B Instruct currently shows benchmark results led by MBPP (1 / 28, score 88.60), HumanEval (9 / 39, score 89), MMLU (16 / 66, score 88.60).

Benchmark Results

Llama3.1-405B Instruct

Benchmark Results

Thinking

General Knowledge

4 evaluations
Benchmark / mode
Score
Rank/total
BBH
89.20
6 / 21
MMLU
88.60
16 / 66
MMLU Pro
73.40
87 / 132
GPQA Diamond
49
162 / 187

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
MATH
73.90
17 / 42
GSM8K
0
24 / 26

Coding and Software Engineer

3 evaluations
Benchmark / mode
Score
Rank/total
HumanEval
89
9 / 39
MBPP
88.60
1 / 28
LiveCodeBench
30.20
118 / 123

Other

1 evaluations
Benchmark / mode
Score
Rank/total

Common Sense

1 evaluations
Benchmark / mode
Score
Rank/total
SimpleQA
17.10
36 / 47
Compare with other models