C4AI Aya Vision 32B Benchmark Details

C4AI Aya Vision 32B currently shows benchmark results led by MBPP (17 / 69, score 70.43), HumanEval (40 / 101, score 62.20), MATH (21 / 42, score 69.30).

Benchmark Results

C4AI Aya Vision 32B

Benchmark Results

Knowledge Exams

2 evaluations

Benchmark / mode

Score

Rank/total

MMLU

Standard Mode

72.14

69 / 124

MMLU-Pro

Standard Mode

47.16

145 / 175

Code Generation & Editing

2 evaluations

Benchmark / mode

Score

Rank/total

MBPP

Standard Mode

70.43

17 / 69

HumanEval

Standard Mode

62.20

40 / 101

Mathematics

1 evaluations

Benchmark / mode

Score

Rank/total

MATH

Standard Mode

69.30

21 / 42

Scientific Reasoning

2 evaluations

Benchmark / mode

Score

Rank/total

GPQA

Standard Mode

34.38

17 / 17

GPQA Diamond

Standard Mode

33.84

246 / 253

Honesty & Factuality

1 evaluations

Benchmark / mode

Score

Rank/total

SimpleQA

Standard Mode

7.65

45 / 46

Compare with other models