CodeLLaMA-Instruct-13B Benchmark Details

CodeLLaMA-Instruct-13B currently shows benchmark results led by HumanEval pass@100 (6 / 21, score 91.60), HumanEval pass@10 (7 / 18, score 71.60), MBPP pass@10 (6 / 13, score 71.20).

Benchmark Results

CodeLLaMA-Instruct-13B

Benchmark Results

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

49.40

44 / 70

Standard Mode

42.70

57 / 101

Other

4 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

91.60

6 / 21

Standard Mode

84.10

7 / 13

HumanEval pass@10

Standard Mode

71.60

7 / 18

Standard Mode

71.20

6 / 13

Compare with other models