Grok 4

Mistral Large 2

Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.

Grok 4Mistral Large 2
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
images ?
voice ?
video ?
text ?
API Providers ?
xAI
Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex
Knowledge Cut-off Date ?
-
Unknown
Open Source ?
No
Yes
Pricing Input ?
$3.00 per million tokens
$3.00 per million tokens
Pricing Output ?
$15.00 per million tokens
$9.00 per million tokens
MMLU ?
-
84%
5-shot
Source
MMLU-Pro ?
-
50.69%
Source
MMMU ?
-
Not available
HellaSwag ?
-
Not available
HumanEval ?
-
Not available
MATH ?
-
1.13%
Source
GPQA ?
87.5%
Science
Source
24.94%
IFEval ?
-
84.01%
SimpleQA ?
-
-
AIME 2024
-
-
AIME 2025
91.7%
Competition Math
Source
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
79%
Competitive Coding
Source
-
Global MMLU (Lite) ?
-
-
MathVista ?
-
-
Mobile Application
-

MathArena ?

Avg. Score
89%
-
AIME 2025
A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models.
91%
-
HMMT February 2025
A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models.
92%
-
BRUMO 2025
95%
-
SMT 2025
A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models.
86%
-
CMIMC 2025
A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models.
83%
-

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.