PanGu-Coder2 Benchmark Details

PanGu-Coder2 currently shows benchmark results led by HumanEval pass@10 (2 / 18, score 79.55), HumanEval pass@100 (5 / 21, score 91.76), HumanEval (41 / 101, score 61.64).

Benchmark Results

PanGu-Coder2

Benchmark Results

Coding and Software Engineer

1 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

61.64

41 / 101

Other

2 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

91.76

5 / 21

HumanEval pass@10

Standard Mode

79.55

2 / 18

Compare with other models