Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
| o4-mini | Claude 3.5 Haiku | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Apr 16, 2025 1 week ago | Nov 04, 2024 5 months ago |
Modalities | text images | text |
API Providers | OpenAI API | Anthropic, AWS Bedrock, Vertex AI |
Knowledge Cut-off Date | - | 01.04.2024 |
Open Source | No | No |
Pricing Input | $1.10 per million tokens | $0.80 per million tokens |
Pricing Output | $4.40 per million tokens | $4.00 |
MMLU | fort | Not available |
MMLU Pro | - | 65% 0-shot CoT Source |
MMMU | 81.6% Source | Not available |
HellaSwag | - | Not available |
HumanEval | 14.28% Source | 88.1% 0-shot Source |
MATH | - | 69.4% 0-shot CoT Source |
GPQA | 81.4% Source | Not available |
IFEval | - | Not available |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.