DataLearner logo

Ember-1 Benchmark Details

Ember-1 currently shows benchmark results led by Vibe Code Bench v1.1 (19 / 112, score 83.87), Legal Research Bench (19 / 81, score 44.71), EMB (Excel Modeling) (28 / 75, score 63.37).

Benchmark Results

Ember-1

Benchmark Results

Thinking

Legal

1 evaluations
Benchmark / mode
Score
Rank/total
44.71
19 / 81

Maintenance & Optimization

1 evaluations
Benchmark / mode
Score
Rank/total
Code Migration
unknownTools
32.51
39 / 78

Code Generation & Editing

1 evaluations
Benchmark / mode
Score
Rank/total
83.87
19 / 112

Algorithmic Coding

1 evaluations
Benchmark / mode
Score
Rank/total
IOI (Vals v2)
unknownTools
46.33
30 / 45

Finance

1 evaluations
Benchmark / mode
Score
Rank/total
63.37
28 / 75

Mathematics

1 evaluations
Benchmark / mode
Score
Rank/total
61
21 / 51

Service Workflows

1 evaluations
Benchmark / mode
Score
Rank/total
66.17
19 / 50

Scientific Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
MysteryMechanism
unknownTools
22.52
19 / 28