DataLearner logo

Llama3.1-8B Benchmark Details

Llama3.1-8B currently shows benchmark results led by GSM8K (41 / 70, score 55.30), MBPP (60 / 96, score 53.90), MMLU (81 / 124, score 66.60).

Benchmark Results

Llama3.1-8B

Benchmark Results

Thinking

General Knowledge

4 evaluations
Benchmark / mode
Score
Rank/total
MMLU
Standard Mode
66.60
81 / 124
BBH
Standard Mode
57.70
16 / 21
MMLU Pro
Standard Mode
35.40
159 / 176
MMLU Pro
unknown
36.60
158 / 176

Math and Reasoning

2 evaluations
Benchmark / mode
Score
Rank/total
GSM8K
Standard Mode
55.30
41 / 70
MATH
Standard Mode
20.50
40 / 42

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
MBPP
Standard Mode
53.90
60 / 96
HumanEval
Standard Mode
33.50
114 / 140

Common Sense Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
ARC
Standard Mode
59.30
4 / 4

Other

1 evaluations
Benchmark / mode
Score
Rank/total
GPQA Diamond
Standard Mode
25.80
454 / 462
Compare with other models