PaLM Benchmark Details

PaLM currently shows benchmark results led by HumanEval pass@100 (10 / 21, score 88.40), GSM8K (40 / 70, score 56.50), MMLU (76 / 124, score 69.30).

Benchmark Results

PaLM

Benchmark Results

General Knowledge

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

69.30

76 / 124

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

56.50

40 / 70

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

47

50 / 70

Standard Mode

26.20

87 / 101

Other

1 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

88.40

10 / 21

Compare with other models