GPT-4.1, launched by OpenAI on April 14, 2025, introduces a 1 million token context window and supports outputs of up to 32,768 tokens per request. It delivers outstanding performance on coding tasks, achieving 54.6% on the SWE-Bench Verified benchmark, and shows a 10.5% improvement over GPT-4o on MultiChallenge for instruction following. The model's knowledge cutoff is set at June 2024. Pricing is $2.00 per million tokens for input and $8.00 per million tokens for output, with a 75% discount applied to cached inputs, making it highly cost-efficient for repeated queries.
Gemini 2.0 Flash is Google's high-performance, low-latency model designed to drive advanced agentic experiences. Equipped with native tool integration, it supports multimodal inputs, including text, images, video, and audio. Offering substantial improvements over previous versions, the model balances efficiency, speed, and enhanced capabilities for seamless real-time interactions.
| GPT-4.1 | Gemini 2.0 Flash | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images | text images voice video |
API Providers
| OpenAI API | Google AI Studio, Vertex AI |
Knowledge Cut-off Date
| - | 08.2024 |
Open Source
| No | No |
Pricing Input
| $2.00 per million tokens | $0.10 per million tokens |
Pricing Output
| $8.00 per million tokens | $0.40 per million tokens |
MMLU
| 90.2% pass@1 Source | Not available |
MMLU-Pro
| - | 77.6% Source |
MMMU
| 74.8% Source | 71.7% Source |
HellaSwag
| - | Not available |
HumanEval
| - | Not available |
MATH
| - | 90.9% Source |
GPQA
| 66.3% Diamond Source | 60.1% Diamond Source |
IFEval
| - | Not available |
SimpleQA
| - | - |
AIME 2024 | 48.1% Source | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| 87.3% pass@1 Source | - |
MathVista
| - | - |
Mobile Application | ||
VideoGameBench | ||
Total score | - | 0% |
Doom II | - | 0% |
Dream DX | - | 0% |
Awakening DX | - | 0% |
Civilization I | - | 0% |
Pokemon Crystal | - | 0% |
The Need for Speed | - | 0% |
The Incredible Machine | - | 0% |
Secret Game 1 | - | 0% |
Secret Game 2 | - | 0% |
Secret Game 3 | - | 0% |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.