DataLearner logo
CL

Claude 3.5 Sonnet New

Chat modelSonnetClaude 3.5

Claude 3.5 Sonnet New

Release date: 2024-10-22Updated: 2024-11-27 09:06:552,019
Live demoGitHubHugging FaceCompare
Parameters
Not disclosed
Context length
200K
Chinese support
Supported
Reasoning ability

Claude 3.5 Sonnet New is an AI model published by Anthropic, released on 2024-10-22, for Chat model, and 200K context length, with a 93.70 score on HumanEval.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

Claude 3.5 Sonnet New

Model basics

Reasoning traces
Not supported
Thinking modes
Thinking modes not supported
Context length
200K tokens
Max output length
No data
Model type
Chat model
Modality (in / out)
No data
Release date
2024-10-22
Model file size
No data
MoE architecture
No
Total params / Active params
No data / N/A
Knowledge cutoff
No data
Claude 3.5 Sonnet New

Open source & experience

Code license
Proprietary
Weights license
Proprietary
GitHub repo
GitHub link unavailable
Hugging Face
Hugging Face link unavailable
Live demo
No live demo
Claude 3.5 Sonnet New

Official resources

Paper
DataLearnerAI blog
Claude 3.5 Sonnet New

API details

API speed
No data
💡Default unit: $/1M tokens. If vendors use other units, follow their published pricing.
Standard
TypeConditionInputOutput
Text-$3.00/ 1M$15.00/ 1M
Claude 3.5 Sonnet New

Benchmark Results

Claude 3.5 Sonnet New currently shows benchmark results led by HumanEval (3 / 39, score 93.70), BBH (2 / 21, score 92.60), MMLU (18 / 66, score 88.30). This page also consolidates core specs, context limits, and API pricing so you can evaluate the model from benchmark results and deployment constraints together.

Thinking

General Knowledge

4 evaluations
Benchmark / mode
Score
Rank/total
92.60
2 / 21
88.30
18 / 66
78
72 / 132
65
138 / 188

Coding and Software Engineer

3 evaluations
Benchmark / mode
Score
Rank/total
93.70
3 / 39
38.70
105 / 123

Math and Reasoning

5 evaluations
Benchmark / mode
Score
Rank/total
78.30
12 / 42
78
42 / 44
16
59 / 62
2.10
47 / 60
0
72 / 80

Common Sense

1 evaluations
Benchmark / mode
Score
Rank/total
28.40
26 / 47

Writing and Creative Capabilities

1 evaluations
Benchmark / mode
Score
Rank/total
78.15
20 / 23

Common Sense Reasoning

1 evaluations
Benchmark / mode
Score
Rank/total
Simple Bench
Standard Mode
41.40
36 / 63

Agent Level Benchmark

1 evaluations
Benchmark / mode
Score
Rank/total
Aider-Polyglot
Standard Mode
51.60
32 / 59

Compare with other models

No curated comparisons for this model yet.

Want a custom combination? Open the compare tool

Claude 3.5 Sonnet New

Publisher

Claude 3.5 Sonnet New

Model Overview

Claude 3.5 Sonnet New is an AI model published by Anthropic, released on 2024-10-22, for Chat model, and 200K context length, with a 93.70 score on HumanEval.

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.

DataLearner WeChat QR code