Gemini 2.5 Pro is Google's most advanced AI model, engineered for deep reasoning and thoughtful response generation. It outperforms on key benchmarks, demonstrating exceptional logic and coding proficiency. Optimized for building dynamic web applications, autonomous code systems, and code adaptation, it delivers high-level performance. With built-in multimodal capabilities and an extended context window, the model efficiently processes large datasets and integrates diverse information sources to tackle complex challenges.
Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
| Gemini 2.5 Pro | Claude 3.5 Haiku | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images voice video | text |
API Providers
| Google AI Studio, Vertex AI, Gemini app | Anthropic, AWS Bedrock, Vertex AI |
Knowledge Cut-off Date
| - | 01.04.2024 |
Open Source
| No | No |
Pricing Input
| Not available | $0.80 per million tokens |
Pricing Output
| Not available | $4.00 |
MMLU
| Not available | Not available |
MMLU-Pro
| Not available | 65% 0-shot CoT Source |
MMMU
| 81.7% Source | Not available |
HellaSwag
| Not available | Not available |
HumanEval
| Not available | 88.1% 0-shot Source |
MATH
| Not available | 69.4% 0-shot CoT Source |
GPQA
| 84.0% Diamond Science Source | Not available |
IFEval
| Not available | Not available |
SimpleQA
| 52.9% | - |
AIME 2024 | 92.0% | - |
AIME 2025 | 86.7% | - |
Aider Polyglot
| 74.0% / 68.6% | - |
LiveCodeBench v5
| 70.4% | - |
Global MMLU (Lite)
| 89.8% | - |
MathVista
| - | - |
Mobile Application | ||
VideoGameBench | ||
Total score | 0.48% | - |
Doom II | 0% | - |
Dream DX | 4.8% | - |
Awakening DX | 0% | - |
Civilization I | 0% | - |
Pokemon Crystal | 0% | - |
The Need for Speed | 0% | - |
The Incredible Machine | 0% | - |
Secret Game 1 | 0% | - |
Secret Game 2 | 0% | - |
Secret Game 3 | 0% | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.