Over the past five months since the release of Qwen2-VL, developers have built new models based on it, contributing valuable feedback. Now, Qwen2.5-VL introduces enhanced capabilities, including precise analysis of images, text, and charts, as well as object localization with structured JSON outputs. It understands long videos, identifies key events, and functions as an agent, interacting with tools on computers and phones. The model's architecture features dynamic video processing and an optimized ViT encoder for improved speed and accuracy.
Llama 3.3 70B Instruct, created by Meta, is a multilingual large language model specifically fine-tuned for instruction-based tasks and optimized for conversational applications. It is capable of processing and generating text in multiple languages, with a context window supporting up to 128,000 tokens. Launched on December 6, 2024, the model surpasses numerous open-source and proprietary chat models in various industry benchmarks. It utilizes Grouped-Query Attention (GQA) to improve scalability and has been trained on a diverse dataset comprising over 15 trillion tokens from publicly available sources. The model's knowledge is current up to December 2023.
| Qwen2.5-VL-32B | Llama 3.3 70B Instruct | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images video | text |
API Providers
| - | Fireworks, Together, DeepInfra, Hyperbolic |
Knowledge Cut-off Date
| Unknown | 12.2024 |
Open Source
| Yes (Source) | Yes |
Pricing Input
| $0 | $0.23 per million tokens |
Pricing Output
| $0 | $0.40 per million tokens |
MMLU
| 78.4% Source | 86% 0-shot, CoT Source |
MMLU-Pro
| 49.5% | 68.9% 5-shot, CoT Source |
MMMU
| 70% | Not available |
HellaSwag
| Not available | Not available |
HumanEval
| Not available | 88.4% pass@1 Source |
MATH
| 82.2% | 77% 0-shot, CoT Source |
GPQA
| 46.0% Diamond | 50.5% 0-shot, CoT Source |
IFEval
| Not available | 92.1% Source |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | - | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.