Claude 3.5 Haiku

Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.

Claude 3.7 Sonnet

Claude 3.7 Sonnet is Anthropic's most advanced model yet and the first hybrid reasoning AI on the market. It offers both standard and extended thinking modes, with the latter providing transparent, step-by-step reasoning. The model excels in coding and front-end web development, achieving state-of-the-art results on SWE-bench Verified and TAU-bench. Available via Claude.ai, the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI, it sets a new benchmark for intelligent AI-driven problem-solving.

Claude 3.5 HaikuClaude 3.7 Sonnet
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
text ?
images ?
API Providers ?
Anthropic, AWS Bedrock, Vertex AI
Claude.ai, Anthropic API, Amazon Bedrock, Google Cloud Vertex AI
Knowledge Cut-off Date ?
01.04.2024
-
Open Source ?
No
No
Pricing Input ?
$0.80 per million tokens
$3.00 per million tokens
Pricing Output ?
$4.00
$15.00 per million tokens
MMLU ?
Not available
Not available
MMLU-Pro ?
65%
0-shot CoT
Source
Not available
MMMU ?
Not available
71.8%
Source
HellaSwag ?
Not available
Not available
HumanEval ?
88.1%
0-shot
Source
Not available
MATH ?
69.4%
0-shot CoT
Source
82.2%
Source
GPQA ?
Not available
68%
Diamond
Source
IFEval ?
Not available
90.8%
Source
SimpleQA ?
-
-
AIME 2024
-
-
AIME 2025
-
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
-
-
Global MMLU (Lite) ?
-
-
MathVista ?
-
-
Mobile Application

VideoGameBench ?

Total score
-
0%
Doom II
-
0%
Dream DX
-
0%
Awakening DX
-
0%
Civilization I
-
0%
Pokemon Crystal
-
0%
The Need for Speed
-
0%
The Incredible Machine
-
0%
Secret Game 1
-
0%
Secret Game 2
-
0%
Secret Game 3
-
0%

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.