Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
The OpenAI o3-mini is a high-speed, cost-effective reasoning model designed for STEM applications, with strong performance in science, mathematics, and coding. Launched in January 2025, it includes essential developer features such as function calling, structured outputs, and developer messages. The model offers three reasoning effort levels—low, medium, and high—allowing users to optimize between deeper analysis and faster response times. Unlike the o3 model, it lacks vision capabilities. Initially available to select developers in API usage tiers 3-5, it can be accessed via the Chat Completions API, Assistants API, and Batch API.
| Claude 3.5 Haiku | o3-mini | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text | text |
API Providers
| Anthropic, AWS Bedrock, Vertex AI | OpenAI API |
Knowledge Cut-off Date
| 01.04.2024 | Unknown |
Open Source
| No | No |
Pricing Input
| $0.80 per million tokens | $1.10 per million tokens |
Pricing Output
| $4.00 | $4.40 per million tokens |
MMLU
| Not available | 86.9% pass@1, high effort Source |
MMLU-Pro
| 65% 0-shot CoT Source | Not available |
MMMU
| Not available | Not available |
HellaSwag
| Not available | Not available |
HumanEval
| 88.1% 0-shot Source | Not available |
MATH
| 69.4% 0-shot CoT Source | 97.9% pass@1, high effort Source |
GPQA
| Not available | 79.7% 0-shot, high effort Source |
IFEval
| Not available | Not available |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.