Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.
| Claude 3.5 Haiku | Mistral Large 2 | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Nov 04, 2024 5 months ago | Jun 24, 2024 9 months ago |
Modalities | text | text |
API Providers | Anthropic, AWS Bedrock, Vertex AI | Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex |
Knowledge Cut-off Date | 01.04.2024 | Unknown |
Open Source | No | Yes |
Pricing Input | $0.80 per million tokens | $3.00 per million tokens |
Pricing Output | $4.00 | $9.00 per million tokens |
MMLU | Not available | 84% 5-shot Source |
MMLU Pro | 65% 0-shot CoT Source | 50.69% Source |
MMMU | Not available | Not available |
HellaSwag | Not available | Not available |
HumanEval | 88.1% 0-shot Source | Not available |
MATH | 69.4% 0-shot CoT Source | 1.13% Source |
GPQA | Not available | 24.94% |
IFEval | Not available | 84.01% |
Mobile Application | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.