o3

OpenAI o3 is the most advanced reasoning model from OpenAI, purpose-built for handling complex, high-cognition tasks. Launched in April 2025, it delivers exceptional performance in software engineering, mathematics, and scientific problem-solving. The model introduces three levels of reasoning effort—low, medium, and high—allowing users to balance between latency and depth of reasoning based on task complexity. o3 supports essential tools for developers, including function calling, structured outputs, and system-level messaging. With built-in vision capabilities, o3 can interpret and analyze images, making it suitable for multimodal applications. It’s available through Chat Completions API, Assistants API, and Batch API for flexible integration into enterprise and research workflows.

Grok 3 Beta

Grok 3 is xAI's most advanced model, trained on the Colossus supercluster with 10 times the computational power of previous state-of-the-art models. It boasts a 1M-token context window and advanced reasoning capabilities, enhanced through large-scale reinforcement learning, enabling deep thought processes ranging from seconds to minutes for solving complex problems. The model achieves top-tier performance across academic benchmarks and real-world user evaluations, earning an Elo score of 1402 in the Chatbot Arena. It was released alongside Grok 3 Mini, a cost-efficient variant optimized for streamlined reasoning.

o3Grok 3 Beta
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
images ?
text ?
images ?
video ?
API Providers ?
OpenAI API
xAI
Knowledge Cut-off Date ?
-
2025-01
Open Source ?
No
No
Pricing Input ?
$10.00 per million tokens
Not available
Pricing Output ?
$40.00 per million tokens
Not available
MMLU ?
82.9%
Source
Not available
MMLU-Pro ?
-
79.9%
Base model
Source
MMMU ?
-
78%
With Think mode
Source
HellaSwag ?
-
Not available
HumanEval ?
-
Not available
MATH ?
-
Not available
GPQA ?
83.3%
Diamond, no tools
Source
84.6%
With Think mode, Diamond
Source
IFEval ?
-
Not available
SimpleQA ?
-
-
AIME 2024
91.6%
Source
-
AIME 2025
88.9%
Source
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
-
-
Global MMLU (Lite) ?
-
-
MathVista ?
-
-
Mobile Application

MathArena ?

Avg. Score
86%
-
AIME 2025
A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models.
89%
-
HMMT February 2025
A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models.
78%
-
BRUMO 2025
96%
-
SMT 2025
A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models.
88%
-
CMIMC 2025
A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models.
78%
-

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.