GPT-4.1

GPT-4.1, launched by OpenAI on April 14, 2025, introduces a 1 million token context window and supports outputs of up to 32,768 tokens per request. It delivers outstanding performance on coding tasks, achieving 54.6% on the SWE-Bench Verified benchmark, and shows a 10.5% improvement over GPT-4o on MultiChallenge for instruction following. The model's knowledge cutoff is set at June 2024. Pricing is $2.00 per million tokens for input and $8.00 per million tokens for output, with a 75% discount applied to cached inputs, making it highly cost-efficient for repeated queries.

Claude 3.7 Sonnet

Claude 3.7 Sonnet is Anthropic's most advanced model yet and the first hybrid reasoning AI on the market. It offers both standard and extended thinking modes, with the latter providing transparent, step-by-step reasoning. The model excels in coding and front-end web development, achieving state-of-the-art results on SWE-bench Verified and TAU-bench. Available via Claude.ai, the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI, it sets a new benchmark for intelligent AI-driven problem-solving.

GPT-4.1Claude 3.7 Sonnet
Web Site ?
Provider ?
Chat ?
Release Date ?
Modalities ?
text ?
images ?
text ?
images ?
API Providers ?
OpenAI API
Claude.ai, Anthropic API, Amazon Bedrock, Google Cloud Vertex AI
Knowledge Cut-off Date ?
-
-
Open Source ?
No
No
Pricing Input ?
$2.00 per million tokens
$3.00 per million tokens
Pricing Output ?
$8.00 per million tokens
$15.00 per million tokens
MMLU ?
90.2%
pass@1
Source
Not available
MMLU-Pro ?
-
Not available
MMMU ?
74.8%
Source
71.8%
Source
HellaSwag ?
-
Not available
HumanEval ?
-
Not available
MATH ?
-
82.2%
Source
GPQA ?
66.3%
Diamond
Source
68%
Diamond
Source
IFEval ?
-
90.8%
Source
SimpleQA ?
-
-
AIME 2024
48.1%
Source
-
AIME 2025
-
-
Aider Polyglot ?
-
-
LiveCodeBench v5 ?
-
-
Global MMLU (Lite) ?
87.3%
pass@1
Source
-
MathVista ?
-
-
Mobile Application

VideoGameBench ?

Total score
-
0%
Doom II
-
0%
Dream DX
-
0%
Awakening DX
-
0%
Civilization I
-
0%
Pokemon Crystal
-
0%
The Need for Speed
-
0%
The Incredible Machine
-
0%
Secret Game 1
-
0%
Secret Game 2
-
0%
Secret Game 3
-
0%

Compare LLMs

Add a Comment


10%
Our site uses cookies.

Privacy and Cookie Policy: This site uses cookies. By continuing to use the site, you agree to their use.