CodeLLaMA-7B Benchmark Details

CodeLLaMA-7B currently shows benchmark results led by MBPP pass@10 (8 / 13, score 66.70), HumanEval pass@10 (12 / 18, score 59.60), MBPP pass@100 (9 / 13, score 82.50).

Benchmark Results

CodeLLaMA-7B

Benchmark Results

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

Standard Mode

41.40

56 / 70

Standard Mode

33.50

76 / 101

Other

4 evaluations

Benchmark / mode

Score

Rank/total

HumanEval pass@100

Standard Mode

85.90

16 / 21

Standard Mode

82.50

9 / 13

Standard Mode

66.70

8 / 13

HumanEval pass@10

Standard Mode

59.60

12 / 18

Compare with other models