Mistral-7B-Instruct-v0.3 Benchmark Details

Mistral-7B-Instruct-v0.3 currently shows benchmark results led by ARC (3 / 4, score 60), GSM8K (22 / 26, score 36.20), BBH (17 / 20, score 56.10).

Benchmark Results

Mistral-7B-Instruct-v0.3

Benchmark Results

综合评估

4 evaluations

Benchmark / mode

Score

Rank/total

MMLU

Standard Mode

64.20

64 / 65

BBH

Standard Mode

56.10

17 / 20

MMLU Pro

Standard Mode

30.90

122 / 124

GPQA Diamond

Standard Mode

24.70

171 / 175

数学推理

2 evaluations

Benchmark / mode

Score

Rank/total

GSM8K

Standard Mode

36.20

22 / 26

MATH

Standard Mode

10.20

41 / 42

编程与软件工程

2 evaluations

Benchmark / mode

Score

Rank/total

MBPP

Standard Mode

51.10

26 / 28

HumanEval

Standard Mode

29.30

37 / 39

常识推理

1 evaluations

Benchmark / mode

Score

Rank/total

ARC

Standard Mode

3 / 4

Compare with other models