Claude 3.5 Haiku

Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.

Gemini 2.0 Pro

Gemini 2.0 Pro is Google's most advanced model to date, delivering exceptional coding performance and handling complex prompts with ease. It comes equipped with enhanced capabilities such as native tool integration, image generation, and speech synthesis. Designed for advanced reasoning, the model supports multimodal inputs, including text, images, video, and audio. Available via Google AI Studio and Vertex AI, it offers substantial performance improvements over previous versions while maintaining high efficiency.

Claude 3.5 HaikuGemini 2.0 Pro
Provider
Web Site
Release Date
Nov 04, 2024
5 months ago
Dec 11, 2024
4 months ago
Modalities
text ?
text ?
images ?
voice ?
video ?
API Providers
Anthropic, AWS Bedrock, Vertex AI
Google AI Studio, Vertex AI
Knowledge Cut-off Date
01.04.2024
08.2024
Open Source
No
No
Pricing Input
$0.80 per million tokens
$0.10 per million tokens
Pricing Output
$4.00
$0.40 per million tokens
MMLU
Not available
Not available
MMLU Pro
65%
0-shot CoT
Source
79.1%
Source
MMMU
Not available
72.7%
Source
HellaSwag
Not available
Not available
HumanEval
88.1%
0-shot
Source
Not available
MATH
69.4%
0-shot CoT
Source
91.8%
Source
GPQA
Not available
64.7%
Diamond
Source
IFEval
Not available
Not available
Mobile Application

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.