Claude 3.7 Sonnet is Anthropic's most advanced model yet and the first hybrid reasoning AI on the market. It offers both standard and extended thinking modes, with the latter providing transparent, step-by-step reasoning. The model excels in coding and front-end web development, achieving state-of-the-art results on SWE-bench Verified and TAU-bench. Available via Claude.ai, the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI, it sets a new benchmark for intelligent AI-driven problem-solving.
Over the past five months since the release of Qwen2-VL, developers have built new models based on it, contributing valuable feedback. Now, Qwen2.5-VL introduces enhanced capabilities, including precise analysis of images, text, and charts, as well as object localization with structured JSON outputs. It understands long videos, identifies key events, and functions as an agent, interacting with tools on computers and phones. The model's architecture features dynamic video processing and an optimized ViT encoder for improved speed and accuracy.
| Claude 3.7 Sonnet | Qwen2.5-VL-32B | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text images | text images video |
API Providers
| Claude.ai, Anthropic API, Amazon Bedrock, Google Cloud Vertex AI | - |
Knowledge Cut-off Date
| - | Unknown |
Open Source
| No | Yes (Source) |
Pricing Input
| $3.00 per million tokens | $0 |
Pricing Output
| $15.00 per million tokens | $0 |
MMLU
| Not available | 78.4% Source |
MMLU-Pro
| Not available | 49.5% |
MMMU
| 71.8% Source | 70% |
HellaSwag
| Not available | Not available |
HumanEval
| Not available | Not available |
MATH
| 82.2% Source | 82.2% |
GPQA
| 68% Diamond Source | 46.0% Diamond |
IFEval
| 90.8% Source | Not available |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | - | |
VideoGameBench | ||
Total score | 0% | - |
Doom II | 0% | - |
Dream DX | 0% | - |
Awakening DX | 0% | - |
Civilization I | 0% | - |
Pokemon Crystal | 0% | - |
The Need for Speed | 0% | - |
The Incredible Machine | 0% | - |
Secret Game 1 | 0% | - |
Secret Game 2 | 0% | - |
Secret Game 3 | 0% | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.