Over the past five months since the release of Qwen2-VL, developers have built new models based on it, contributing valuable feedback. Now, Qwen2.5-VL introduces enhanced capabilities, including precise analysis of images, text, and charts, as well as object localization with structured JSON outputs. It understands long videos, identifies key events, and functions as an agent, interacting with tools on computers and phones. The model's architecture features dynamic video processing and an optimized ViT encoder for improved speed and accuracy.
Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
| Qwen2.5-VL-32B | Claude 3.5 Haiku | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Mar 25, 2025 4 weeks ago | Nov 04, 2024 5 months ago |
Modalities | text images video | text |
API Providers | - | Anthropic, AWS Bedrock, Vertex AI |
Knowledge Cut-off Date | Unknown | 01.04.2024 |
Open Source | Yes (Source) | No |
Pricing Input | $0 | $0.80 per million tokens |
Pricing Output | $0 | $4.00 |
MMLU | 78.4% Source | Not available |
MMLU Pro | 49.5% | 65% 0-shot CoT Source |
MMMU | 70% | Not available |
HellaSwag | Not available | Not available |
HumanEval | Not available | 88.1% 0-shot Source |
MATH | 82.2% | 69.4% 0-shot CoT Source |
GPQA | 46.0% Diamond | Not available |
IFEval | Not available | Not available |
Mobile Application | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.