LLaMA2 70B Benchmark Details

LLaMA2 70B currently shows benchmark results led by AGIEval (6 / 28, score 54.20), GSM8K (38 / 70, score 56.80), MBPP pass@100 (8 / 13, score 83.10).

Benchmark Results

LLaMA2 70B

Benchmark Results

General Knowledge

1 evaluations

Benchmark / mode

Score

Rank/total

MMLU

Standard Mode

68.90

77 / 124

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

GSM8K

Standard Mode

56.80

38 / 70

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

MBPP

Standard Mode

45.40

54 / 70

HumanEval

Standard Mode

30.50

79 / 101

Other

1 evaluations

Benchmark / mode

Score

Rank/total

AGIEval

Standard Mode

54.20

6 / 28

Other

4 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

15 / 21

MBPP pass@100

Standard Mode

83.10

8 / 13

MBPP pass@10

Standard Mode

66.20

9 / 13

HumanEval pass@10

Standard Mode

59.40

13 / 18

Compare with other models