Over the past five months since the release of Qwen2-VL, developers have built new models based on it, contributing valuable feedback. Now, Qwen2.5-VL introduces enhanced capabilities, including precise analysis of images, text, and charts, as well as object localization with structured JSON outputs. It understands long videos, identifies key events, and functions as an agent, interacting with tools on computers and phones. The model's architecture features dynamic video processing and an optimized ViT encoder for improved speed and accuracy.
Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.
| Qwen2.5-VL-32B | Mistral Large 2 | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images video | text |
API Providers
| - | Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex |
Knowledge Cut-off Date
| Unknown | Unknown |
Open Source
| Yes (Source) | Yes |
Pricing Input
| $0 | $3.00 per million tokens |
Pricing Output
| $0 | $9.00 per million tokens |
MMLU
| 78.4% Source | 84% 5-shot Source |
MMLU-Pro
| 49.5% | 50.69% Source |
MMMU
| 70% | Not available |
HellaSwag
| Not available | Not available |
HumanEval
| Not available | Not available |
MATH
| 82.2% | 1.13% Source |
GPQA
| 46.0% Diamond | 24.94% |
IFEval
| Not available | 84.01% |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | - | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.