Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
GPT-4.1, launched by OpenAI on April 14, 2025, introduces a 1 million token context window and supports outputs of up to 32,768 tokens per request. It delivers outstanding performance on coding tasks, achieving 54.6% on the SWE-Bench Verified benchmark, and shows a 10.5% improvement over GPT-4o on MultiChallenge for instruction following. The model's knowledge cutoff is set at June 2024. Pricing is $2.00 per million tokens for input and $8.00 per million tokens for output, with a 75% discount applied to cached inputs, making it highly cost-efficient for repeated queries.
| Claude 3.5 Haiku | GPT-4.1 | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text | text images |
API Providers
| Anthropic, AWS Bedrock, Vertex AI | OpenAI API |
Knowledge Cut-off Date
| 01.04.2024 | - |
Open Source
| No | No |
Pricing Input
| $0.80 per million tokens | $2.00 per million tokens |
Pricing Output
| $4.00 | $8.00 per million tokens |
MMLU
| Not available | 90.2% pass@1 Source |
MMLU-Pro
| 65% 0-shot CoT Source | - |
MMMU
| Not available | 74.8% Source |
HellaSwag
| Not available | - |
HumanEval
| 88.1% 0-shot Source | - |
MATH
| 69.4% 0-shot CoT Source | - |
GPQA
| Not available | 66.3% Diamond Source |
IFEval
| Not available | - |
SimpleQA
| - | - |
AIME 2024 | - | 48.1% Source |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | 87.3% pass@1 Source |
MathVista
| - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.