GPT-4.1, launched by OpenAI on April 14, 2025, introduces a 1 million token context window and supports outputs of up to 32,768 tokens per request. It delivers outstanding performance on coding tasks, achieving 54.6% on the SWE-Bench Verified benchmark, and shows a 10.5% improvement over GPT-4o on MultiChallenge for instruction following. The model's knowledge cutoff is set at June 2024. Pricing is $2.00 per million tokens for input and $8.00 per million tokens for output, with a 75% discount applied to cached inputs, making it highly cost-efficient for repeated queries.
Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.
| GPT-4.1 | Mistral Large 2 | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Apr 14, 2025 2 weeks ago | Jun 24, 2024 10 months ago |
Modalities | text images | text |
API Providers | OpenAI API | Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex |
Knowledge Cut-off Date | - | Unknown |
Open Source | No | Yes |
Pricing Input | $2.00 per million tokens | $3.00 per million tokens |
Pricing Output | $8.00 per million tokens | $9.00 per million tokens |
MMLU | 90.2% pass@1 Source | 84% 5-shot Source |
MMLU Pro | - | 50.69% Source |
MMMU | 74.8% Source | Not available |
HellaSwag | - | Not available |
HumanEval | - | Not available |
MATH | - | 1.13% Source |
GPQA | 66.3% Diamond Source | 24.94% |
IFEval | - | 84.01% |
Mobile Application | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.