C4AI Aya Vision 32B Benchmark Details

C4AI Aya Vision 32B currently shows benchmark results led by MATH (21 / 42, score 69.30), MBPP (17 / 28, score 70.43), HumanEval (29 / 39, score 62.20).

Benchmark Results

C4AI Aya Vision 32B

Benchmark Results

General Knowledge

4 evaluations

Benchmark / mode

Score

Rank/total

MMLU

72.14

57 / 66

MMLU Pro

47.16

123 / 132

GPQA

34.38

15 / 15

GPQA Diamond

33.84

178 / 188

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

MBPP

70.43

17 / 28

HumanEval

62.20

29 / 39

Math and Reasoning

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

69.30

21 / 42

Common Sense

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

7.65

45 / 47

Compare with other models