Claude 3.5 Haiku

Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.

GPT-4.1

GPT-4.1, launched by OpenAI on April 14, 2025, introduces a 1 million token context window and supports outputs of up to 32,768 tokens per request. It delivers outstanding performance on coding tasks, achieving 54.6% on the SWE-Bench Verified benchmark, and shows a 10.5% improvement over GPT-4o on MultiChallenge for instruction following. The model's knowledge cutoff is set at June 2024. Pricing is $2.00 per million tokens for input and $8.00 per million tokens for output, with a 75% discount applied to cached inputs, making it highly cost-efficient for repeated queries.

Claude 3.5 HaikuGPT-4.1
Provider
Web Site
Release Date
Nov 04, 2024
5 months ago
Apr 14, 2025
2 weeks ago
Modalities
text ?
text ?
images ?
API Providers
Anthropic, AWS Bedrock, Vertex AI
OpenAI API
Knowledge Cut-off Date
01.04.2024
-
Open Source
No
No
Pricing Input
$0.80 per million tokens
$2.00 per million tokens
Pricing Output
$4.00
$8.00 per million tokens
MMLU
Not available
90.2%
pass@1
Source
MMLU Pro
65%
0-shot CoT
Source
-
MMMU
Not available
74.8%
Source
HellaSwag
Not available
-
HumanEval
88.1%
0-shot
Source
-
MATH
69.4%
0-shot CoT
Source
-
GPQA
Not available
66.3%
Diamond
Source
IFEval
Not available
-
Mobile Application

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.