OpenAI o4-mini is the newest lightweight model in the o-series, engineered for efficient and capable reasoning across text and visual tasks. Optimized for speed and performance, it excels in code generation and image-based understanding, while maintaining a balance between latency and reasoning depth. The model supports a 200,000-token context window with up to 100,000 output tokens, making it suitable for extended, high-volume interactions. It handles both text and image inputs, producing textual outputs with advanced reasoning capabilities. With its compact architecture and versatile performance, o4-mini is ideal for a wide array of real-world applications demanding fast, cost-effective intelligence.
| Grok 4 | o4-mini | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images voice video | text images |
API Providers
| xAI | OpenAI API |
Knowledge Cut-off Date
| - | - |
Open Source
| No | No |
Pricing Input
| $3.00 per million tokens | $1.10 per million tokens |
Pricing Output
| $15.00 per million tokens | $4.40 per million tokens |
MMLU
| - | fort |
MMLU-Pro
| - | - |
MMMU
| - | 81.6% Source |
HellaSwag
| - | - |
HumanEval
| - | 14.28% Source |
MATH
| - | - |
GPQA
| 87.5% Science Source | 81.4% Source |
IFEval
| - | - |
SimpleQA
| - | - |
AIME 2024 | - | 93.4% Source |
AIME 2025 | 91.7% Competition Math Source | 92.7% Source |
Aider Polyglot
| - | - |
LiveCodeBench v5
| 79% Competitive Coding Source | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | ||
MathArena | ||
| Avg. Score | 89% | 87% |
AIME 2025 A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models. | 91% | 92% |
HMMT February 2025 A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models. | 92% | 83% |
BRUMO 2025 | 95% | 87% |
SMT 2025 A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models. | 86% | 89% |
CMIMC 2025 A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models. | 83% | 84% |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2026 All Right Reserved.