CodeLLaMA-13B Benchmark Details

CodeLLaMA-13B currently shows benchmark results led by MBPP pass@100 (3 / 13, score 87.10), MBPP pass@10 (5 / 13, score 71.70), HumanEval pass@100 (9 / 21, score 89.80).

Benchmark Results

CodeLLaMA-13B

Benchmark Results

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

47

50 / 70

Standard Mode

36

67 / 101

Other

4 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

89.80

9 / 21

Standard Mode

87.10

3 / 13

Standard Mode

71.70

5 / 13

HumanEval pass@10

Standard Mode

69.40

9 / 18

Compare with other models