OpenAI o4-mini is the newest lightweight model in the o-series, engineered for efficient and capable reasoning across text and visual tasks. Optimized for speed and performance, it excels in code generation and image-based understanding, while maintaining a balance between latency and reasoning depth. The model supports a 200,000-token context window with up to 100,000 output tokens, making it suitable for extended, high-volume interactions. It handles both text and image inputs, producing textual outputs with advanced reasoning capabilities. With its compact architecture and versatile performance, o4-mini is ideal for a wide array of real-world applications demanding fast, cost-effective intelligence.
Gemini 2.0 Flash is Google's high-performance, low-latency model designed to drive advanced agentic experiences. Equipped with native tool integration, it supports multimodal inputs, including text, images, video, and audio. Offering substantial improvements over previous versions, the model balances efficiency, speed, and enhanced capabilities for seamless real-time interactions.
| o4-mini | Gemini 2.0 Flash | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images | text images voice video |
API Providers
| OpenAI API | Google AI Studio, Vertex AI |
Knowledge Cut-off Date
| - | 08.2024 |
Open Source
| No | No |
Pricing Input
| $1.10 per million tokens | $0.10 per million tokens |
Pricing Output
| $4.40 per million tokens | $0.40 per million tokens |
MMLU
| fort | Not available |
MMLU-Pro
| - | 77.6% Source |
MMMU
| 81.6% Source | 71.7% Source |
HellaSwag
| - | Not available |
HumanEval
| 14.28% Source | Not available |
MATH
| - | 90.9% Source |
GPQA
| 81.4% Source | 60.1% Diamond Source |
IFEval
| - | Not available |
SimpleQA
| - | - |
AIME 2024 | 93.4% Source | - |
AIME 2025 | 92.7% Source | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | ||
VideoGameBench | ||
Total score | - | 0% |
Doom II | - | 0% |
Dream DX | - | 0% |
Awakening DX | - | 0% |
Civilization I | - | 0% |
Pokemon Crystal | - | 0% |
The Need for Speed | - | 0% |
The Incredible Machine | - | 0% |
Secret Game 1 | - | 0% |
Secret Game 2 | - | 0% |
Secret Game 3 | - | 0% |
MathArena | ||
| Avg. Score | 87% | - |
AIME 2025 A test based on problems from the American Invitational Mathematics Examination, designed to assess the mathematical skills of models. | 92% | - |
HMMT February 2025 A test based on problems from the Harvard-MIT Mathematics Tournament, February 2025, designed to assess the mathematical skills of models. | 83% | - |
BRUMO 2025 | 87% | - |
SMT 2025 A test based on problems from the Stanford Math Tournament, 2025, designed to assess the mathematical skills of models. | 89% | - |
CMIMC 2025 A test based on problems from the Canadian Mathematical Olympiad, 2025, designed to assess the mathematical skills of models. | 84% | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2026 All Right Reserved.