DataLearner logo

PaLM2-S Benchmark Details

PaLM2-S currently shows benchmark results led by HumanEval pass@100 (10 / 21, score 88.40), MBPP (43 / 70, score 50), HumanEval (66 / 101, score 37.60).

Benchmark Results

PaLM2-S

Benchmark Results

Thinking

Coding and Software Engineer

2 evaluations
Benchmark / mode
Score
Rank/total
MBPP
Standard Mode
50
43 / 70
HumanEval
Standard Mode
37.60
66 / 101

Other

1 evaluations
Benchmark / mode
Score
Rank/total
HumanEval pass@100
Standard Mode
88.40
10 / 21
Compare with other models