Gemini 1.5 Pro

Name: Gemini 1.5 Pro
Author: Google Deep Mind

Foundation modelGemini ProGemini 1.5

Gemini 1.5 Pro

Release date: 2024-02-15Updated: 2024-02-16Views: 1,191

Live demoGitHubHugging FaceCompare

Parameters

No data

Context length

10000K

Multilingual

Supported

Reasoning ability

No data

Gemini 1.5 Pro is an AI model published by Google Deep Mind, released on 2024-02-15, for Foundation model, and 10000K context length, with a 89.00 score on HumanEval.

Data sourced primarily from official releases (GitHub, Hugging Face, papers), then benchmark leaderboards, then third-party evaluators. Learn about our data methodology

Gemini 1.5 Pro

Model basics

Reasoning traces

No data

Thinking modes

Thinking modes not supported

Context length

10000K tokens

Max output length

No data

Model type

Foundation model

Modality (in / out)

No data

Release date

2024-02-15

Model file size

No data

MoE architecture

Total params / Active params

No data / Not applicable

Knowledge cutoff

No data

Gemini 1.5 Pro

Open source & experience

Code license

Proprietary

Weights license

Proprietary

GitHub repo

N/A

Hugging Face

N/A

Live demo

N/A

Gemini 1.5 Pro

Official resources

Paper

DataLearnerAI blog

N/A

Gemini 1.5 Pro

API details

API speed

No data

No public API pricing yet.

Gemini 1.5 Pro

Benchmark Results

Gemini 1.5 Pro currently shows benchmark results led by MBPP (2 / 70, score 87.80), HumanEval (9 / 101, score 89), MMLU (26 / 124, score 87.10). This page also consolidates core specs, context limits, and API pricing so you can evaluate the model from benchmark results and deployment constraints together.

General Knowledge

3 evaluations

Benchmark / mode

Score

Rank/total

MMLU

Standard Mode

87.10

26 / 124

MMLU Pro

Standard Mode

76.10

80 / 133

BBH

Standard Mode

20 / 21

Math and Reasoning

2 evaluations

Benchmark / mode

Score

Rank/total

MATH

Standard Mode

82.90

11 / 42

GSM8K

Standard Mode

68 / 70

Coding and Software Engineer

2 evaluations

Benchmark / mode

Score

Rank/total

HumanEval

Standard Mode

9 / 101

MBPP

Standard Mode

87.80

2 / 70

Truthfulness Evaluation

1 evaluations

Benchmark / mode

Score

Rank/total

TruthfulQA

Standard Mode

2 / 4

General Evaluation

1 evaluations

Benchmark / mode

Score

Rank/total

GPQA Diamond

Standard Mode

53.50

237 / 270

View benchmark analysis Compare with other models

Gemini 1.5 Pro

Publisher

Google Deep Mind

View publisher details

Gemini 1.5 Pro

Model Overview

Gemini 1.5 Pro is an AI model published by Google Deep Mind, released on 2024-02-15, for Foundation model, and 10000K context length, with a 89.00 score on HumanEval.

DataLearner on WeChat

Follow DataLearner on WeChat for AI model updates and research notes.