Claude 3.7 Sonnet is Anthropic's most advanced AI model yet and the first hybrid reasoning system on the market. It offers both standard and extended thinking modes, with the latter providing transparent, step-by-step reasoning. The model demonstrates significant improvements in coding and front-end web development, achieving state-of-the-art results on SWE-bench Verified and TAU-bench. Available via Claude.ai, the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI, it sets a new standard for intelligent AI-powered problem-solving.
Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.
| Claude 3.7 Sonnet - Extended Thinking | Mistral Large 2 | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Feb 24, 2025 1 month ago | Jun 24, 2024 9 months ago |
Modalities | text images | text |
API Providers | Claude.ai, Anthropic API, Amazon Bedrock, Google Cloud Vertex AI | Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex |
Knowledge Cut-off Date | - | Unknown |
Open Source | No | Yes |
Pricing Input | $3.00 per million tokens | $3.00 per million tokens |
Pricing Output | $15.00 per million tokens | $9.00 per million tokens |
MMLU | Not available | 84% 5-shot Source |
MMLU Pro | Not available | 50.69% Source |
MMMU | 75% Source | Not available |
HellaSwag | Not available | Not available |
HumanEval | Not available | Not available |
MATH | 96.2% Source | 1.13% Source |
GPQA | 84.8% Diamond Source | 24.94% |
IFEval | 93.2% Source | 84.01% |
Mobile Application | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.