Grok 4

o3-mini

The OpenAI o3-mini is a high-speed, cost-effective reasoning model designed for STEM applications, with strong performance in science, mathematics, and coding. Launched in January 2025, it includes essential developer features such as function calling, structured outputs, and developer messages. The model offers three reasoning effort levels—low, medium, and high—allowing users to optimize between deeper analysis and faster response times. Unlike the o3 model, it lacks vision capabilities. Initially available to select developers in API usage tiers 3-5, it can be accessed via the Chat Completions API, Assistants API, and Batch API.

Grok 4o3-mini
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
images ?
voice ?
video ?
text ?
API Providers ?
xAI
OpenAI API
Knowledge Cut-off Date ?
-
Unknown
Open Source ?
No
No
Pricing Input ?
$3.00 per million tokens
$1.10 per million tokens
Pricing Output ?
$15.00 per million tokens
$4.40 per million tokens
MMLU ?
-
86.9%
pass@1, high effort
Source
MMLU-Pro ?
-
Not available
MMMU ?
-
Not available
HellaSwag ?
-
Not available
HumanEval ?
-
Not available
MATH ?
-
97.9%
pass@1, high effort
Source
GPQA ?
87.5%
Science
Source
79.7%
0-shot, high effort
Source
IFEval ?
-
Not available
SimpleQA ?
-
-
AIME 2024
-
-
AIME 2025
91.7%
Competition Math
Source
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
79%
Competitive Coding
Source
-
Global MMLU (Lite) ?
-
-
MathVista ?
-
-
Mobile Application

MathArena ?

Avg. Score
89%
-
AIME 2025
A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models.
91%
-
HMMT February 2025
A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models.
92%
-
BRUMO 2025
95%
-
SMT 2025
A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models.
86%
-
CMIMC 2025
A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models.
83%
-

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.