Claude 3.5 Haiku, developed by Anthropic, offers a 200,000-token context window. Pricing is set at $1 per million input tokens and $5 per million output tokens, with potential savings of up to 90% through prompt caching and 50% via the Message Batches API. Released on November 4, 2024, this model excels in code completion, interactive chatbots, data extraction and labeling, as well as real-time content moderation.
LLaMA 4 Scout is a 17-billion parameter model leveraging a Mixture-of-Experts architecture with 16 active experts, positioning it as the top multimodal model in its category. It consistently outperforms competitors like Gemma 3, Gemini 2.0 Flash-Lite, and Mistral 3.1 across diverse benchmark tasks. Despite its performance, LLaMA 4 Scout is remarkably efficient—capable of running on a single NVIDIA H100 GPU with Int4 quantization. It also boasts an industry-leading 10 million token context window and is natively multimodal, seamlessly processing text, images, and video inputs for advanced real-world applications.
| Claude 3.5 Haiku | Llama 4 Scout | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | Nov 04, 2024 6 months ago | Apr 05, 2025 1 month ago |
Modalities | text | text images video |
API Providers | Anthropic, AWS Bedrock, Vertex AI | Meta AI, Hugging Face, Fireworks, Together, DeepInfra |
Knowledge Cut-off Date | 01.04.2024 | 2025-04 |
Open Source | No | Yes (Source) |
Pricing Input | $0.80 per million tokens | Not available |
Pricing Output | $4.00 | Not available |
MMLU | Not available | Not available |
MMLU Pro | 65% 0-shot CoT Source | 74.3% Reasoning & Knowledge Source |
MMMU | Not available | 69.4% Image Reasoning Source |
HellaSwag | Not available | Not available |
HumanEval | 88.1% 0-shot Source | Not available |
MATH | 69.4% 0-shot CoT Source | Not available |
GPQA | Not available | 57.2% Diamond Source |
IFEval | Not available | Not available |
Array | - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Mobile Application | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.