LLaMA 4 Maverick is a cutting-edge multimodal model featuring 17 billion active parameters within a Mixture-of-Experts architecture of 128 experts, totaling 400 billion parameters. It leads its class by outperforming models like GPT-4o and Gemini 2.0 Flash across a wide range of benchmarks, and it matches DeepSeek V3 in reasoning and coding tasks—using less than half the active parameters. Designed for efficiency and scalability, Maverick delivers a best-in-class performance-to-cost ratio, with an experimental chat variant achieving an ELO score of 1417 on LMArena. Despite its scale, it runs on a single NVIDIA H100 host, ensuring simple and practical deployment.
Over the past five months since the release of Qwen2-VL, developers have built new models based on it, contributing valuable feedback. Now, Qwen2.5-VL introduces enhanced capabilities, including precise analysis of images, text, and charts, as well as object localization with structured JSON outputs. It understands long videos, identifies key events, and functions as an agent, interacting with tools on computers and phones. The model's architecture features dynamic video processing and an optimized ViT encoder for improved speed and accuracy.
Llama 4 Maverick | Qwen2.5-VL-32B | |
---|---|---|
Provider | ||
Web Site | ||
Release Date | Apr 05, 2025 1 month ago | Mar 25, 2025 2 months ago |
Modalities | text images video | text images video |
API Providers | Meta AI, Hugging Face, Fireworks, Together, DeepInfra | - |
Knowledge Cut-off Date | 2024-08 | Unknown |
Open Source | Yes (Source) | Yes (Source) |
Pricing Input | Not available | $0 |
Pricing Output | Not available | $0 |
MMLU | Not available | 78.4% Source |
MMLU Pro | 80.5% Source | 49.5% |
MMMU | 73.4% Source | 70% |
HellaSwag | Not available | Not available |
HumanEval | Not available | Not available |
MATH | Not available | 82.2% |
GPQA | 69.8% Diamond Source | 46.0% Diamond |
IFEval | Not available | Not available |
Array | - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Mobile Application | - | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.