Grok 4

Grok 3 Beta

Grok 3 is xAI's most advanced model, trained on the Colossus supercluster with 10 times the computational power of previous state-of-the-art models. It boasts a 1M-token context window and advanced reasoning capabilities, enhanced through large-scale reinforcement learning, enabling deep thought processes ranging from seconds to minutes for solving complex problems. The model achieves top-tier performance across academic benchmarks and real-world user evaluations, earning an Elo score of 1402 in the Chatbot Arena. It was released alongside Grok 3 Mini, a cost-efficient variant optimized for streamlined reasoning.

Grok 4Grok 3 Beta
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
images ?
voice ?
video ?
text ?
images ?
video ?
API Providers ?
xAI
xAI
Knowledge Cut-off Date ?
-
2025-01
Open Source ?
No
No
Pricing Input ?
$3.00 per million tokens
Not available
Pricing Output ?
$15.00 per million tokens
Not available
MMLU ?
-
Not available
MMLU-Pro ?
-
79.9%
Base model
Source
MMMU ?
-
78%
With Think mode
Source
HellaSwag ?
-
Not available
HumanEval ?
-
Not available
MATH ?
-
Not available
GPQA ?
87.5%
Science
Source
84.6%
With Think mode, Diamond
Source
IFEval ?
-
Not available
SimpleQA ?
-
-
AIME 2024
-
-
AIME 2025
91.7%
Competition Math
Source
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
79%
Competitive Coding
Source
-
Global MMLU (Lite) ?
-
-
MathVista ?
-
-
Mobile Application

MathArena ?

Avg. Score
89%
-
AIME 2025
A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models.
91%
-
HMMT February 2025
A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models.
92%
-
BRUMO 2025
95%
-
SMT 2025
A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models.
86%
-
CMIMC 2025
A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models.
83%
-

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.