OpenAI o3 is the most advanced reasoning model from OpenAI, purpose-built for handling complex, high-cognition tasks. Launched in April 2025, it delivers exceptional performance in software engineering, mathematics, and scientific problem-solving. The model introduces three levels of reasoning effort—low, medium, and high—allowing users to balance between latency and depth of reasoning based on task complexity. o3 supports essential tools for developers, including function calling, structured outputs, and system-level messaging. With built-in vision capabilities, o3 can interpret and analyze images, making it suitable for multimodal applications. It’s available through Chat Completions API, Assistants API, and Batch API for flexible integration into enterprise and research workflows.
Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
| o3 | Claude 3.5 Haiku | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images | text |
API Providers
| OpenAI API | Anthropic, AWS Bedrock, Vertex AI |
Knowledge Cut-off Date
| - | 01.04.2024 |
Open Source
| No | No |
Pricing Input
| $10.00 per million tokens | $0.80 per million tokens |
Pricing Output
| $40.00 per million tokens | $4.00 |
MMLU
| 82.9% Source | Not available |
MMLU-Pro
| - | 65% 0-shot CoT Source |
MMMU
| - | Not available |
HellaSwag
| - | Not available |
HumanEval
| - | 88.1% 0-shot Source |
MATH
| - | 69.4% 0-shot CoT Source |
GPQA
| 83.3% Diamond, no tools Source | Not available |
IFEval
| - | Not available |
SimpleQA
| - | - |
AIME 2024 | 91.6% Source | - |
AIME 2025 | 88.9% Source | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.