Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
OpenAI o4-mini is the newest lightweight model in the o-series, engineered for efficient and capable reasoning across text and visual tasks. Optimized for speed and performance, it excels in code generation and image-based understanding, while maintaining a balance between latency and reasoning depth. The model supports a 200,000-token context window with up to 100,000 output tokens, making it suitable for extended, high-volume interactions. It handles both text and image inputs, producing textual outputs with advanced reasoning capabilities. With its compact architecture and versatile performance, o4-mini is ideal for a wide array of real-world applications demanding fast, cost-effective intelligence.
| Claude 3.5 Haiku | o4-mini | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Nov 04, 2024 6 months ago | Apr 16, 2025 1 month ago |
Modalities | text | text images |
API Providers | Anthropic, AWS Bedrock, Vertex AI | OpenAI API |
Knowledge Cut-off Date | 01.04.2024 | - |
Open Source | No | No |
Pricing Input | $0.80 per million tokens | $1.10 per million tokens |
Pricing Output | $4.00 | $4.40 per million tokens |
MMLU | Not available | fort |
MMLU Pro | 65% 0-shot CoT Source | - |
MMMU | Not available | 81.6% Source |
HellaSwag | Not available | - |
HumanEval | 88.1% 0-shot Source | 14.28% Source |
MATH | 69.4% 0-shot CoT Source | - |
GPQA | Not available | 81.4% Source |
IFEval | Not available | - |
Array | - | - |
AIME 2024 | - | 93.4% Source |
AIME 2025 | - | 92.7% Source |
Array | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.