Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
Gemini 2.0 Pro is Google's most advanced model to date, delivering exceptional coding performance and handling complex prompts with ease. It comes equipped with enhanced capabilities such as native tool integration, image generation, and speech synthesis. Designed for advanced reasoning, the model supports multimodal inputs, including text, images, video, and audio. Available via Google AI Studio and Vertex AI, it offers substantial performance improvements over previous versions while maintaining high efficiency.
| Claude 3.5 Haiku | Gemini 2.0 Pro | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text | text images voice video |
API Providers
| Anthropic, AWS Bedrock, Vertex AI | Google AI Studio, Vertex AI |
Knowledge Cut-off Date
| 01.04.2024 | 08.2024 |
Open Source
| No | No |
Pricing Input
| $0.80 per million tokens | $0.10 per million tokens |
Pricing Output
| $4.00 | $0.40 per million tokens |
MMLU
| Not available | Not available |
MMLU-Pro
| 65% 0-shot CoT Source | 79.1% Source |
MMMU
| Not available | 72.7% Source |
HellaSwag
| Not available | Not available |
HumanEval
| 88.1% 0-shot Source | Not available |
MATH
| 69.4% 0-shot CoT Source | 91.8% Source |
GPQA
| Not available | 64.7% Diamond Source |
IFEval
| Not available | Not available |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.