LLaMA 4 Maverick is a cutting-edge multimodal model featuring 17 billion active parameters within a Mixture-of-Experts architecture of 128 experts, totaling 400 billion parameters. It leads its class by outperforming models like GPT-4o and Gemini 2.0 Flash across a wide range of benchmarks, and it matches DeepSeek V3 in reasoning and coding tasks—using less than half the active parameters. Designed for efficiency and scalability, Maverick delivers a best-in-class performance-to-cost ratio, with an experimental chat variant achieving an ELO score of 1417 on LMArena. Despite its scale, it runs on a single NVIDIA H100 host, ensuring simple and practical deployment.
Gemini 2.0 Flash Thinking is an advanced reasoning model designed to enhance performance and explainability by making its thought process visible. It excels in complex problem-solving, coding challenges, and mathematical reasoning, demonstrating step-by-step solutions. Optimized for tasks that demand detailed explanations and logical analysis, the model also features native tool integration, including code execution and Google Search capabilities.
| Llama 4 Maverick | Gemini 2.0 Flash Thinking | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images video | text images |
API Providers
| Meta AI, Hugging Face, Fireworks, Together, DeepInfra | Google AI Studio, Vertex AI, Gemini API |
Knowledge Cut-off Date
| 2024-08 | 04.2024 |
Open Source
| Yes (Source) | No |
Pricing Input
| Not available | Not available |
Pricing Output
| Not available | Not available |
MMLU
| Not available | Not available |
MMLU-Pro
| 80.5% Source | Not available |
MMMU
| 73.4% Source | 75.4% Source |
HellaSwag
| Not available | Not available |
HumanEval
| Not available | Not available |
MATH
| Not available | Not available |
GPQA
| 69.8% Diamond Source | 74.2% Diamond Science Source |
IFEval
| Not available | Not available |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | - | |
VideoGameBench | ||
Total score | 0% | - |
Doom II | 0% | - |
Dream DX | 0% | - |
Awakening DX | 0% | - |
Civilization I | 0% | - |
Pokemon Crystal | 0% | - |
The Need for Speed | 0% | - |
The Incredible Machine | 0% | - |
Secret Game 1 | %0 | - |
Secret Game 2 | 0% | - |
Secret Game 3 | 0% | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.