Llama 3.3 70B Instruct, created by Meta, is a multilingual large language model specifically fine-tuned for instruction-based tasks and optimized for conversational applications. It is capable of processing and generating text in multiple languages, with a context window supporting up to 128,000 tokens. Launched on December 6, 2024, the model surpasses numerous open-source and proprietary chat models in various industry benchmarks. It utilizes Grouped-Query Attention (GQA) to improve scalability and has been trained on a diverse dataset comprising over 15 trillion tokens from publicly available sources. The model's knowledge is current up to December 2023.
Mistral Large 2, developed by Mistral, offers a 128K-token context window and is priced at $3.00 per million input tokens and $9.00 per million output tokens. Released on July 24, 2024, the model scored 84.0 on the MMLU benchmark in a 5-shot evaluation, demonstrating strong performance in diverse tasks.
| Llama 3.3 70B Instruct | Mistral Large 2 | |
|---|---|---|
Web Site
| ||
Provider
| ||
Chat
| ||
Release Date
| ||
Modalities
| text | text |
API Providers
| Fireworks, Together, DeepInfra, Hyperbolic | Azure AI, AWS Bedrock, Google AI Studio, Vertex AI, Snowflake Cortex |
Knowledge Cut-off Date
| 12.2024 | Unknown |
Open Source
| Yes | Yes |
Pricing Input
| $0.23 per million tokens | $3.00 per million tokens |
Pricing Output
| $0.40 per million tokens | $9.00 per million tokens |
MMLU
| 86% 0-shot, CoT Source | 84% 5-shot Source |
MMLU-Pro
| 68.9% 5-shot, CoT Source | 50.69% Source |
MMMU
| Not available | Not available |
HellaSwag
| Not available | Not available |
HumanEval
| 88.4% pass@1 Source | Not available |
MATH
| 77% 0-shot, CoT Source | 1.13% Source |
GPQA
| 50.5% 0-shot, CoT Source | 24.94% |
IFEval
| 92.1% Source | 84.01% |
SimpleQA
| - | - |
AIME 2024 | - | - |
AIME 2025 | - | - |
Aider Polyglot
| - | - |
LiveCodeBench v5
| - | - |
Global MMLU (Lite)
| - | - |
MathVista
| - | - |
Mobile Application | - | - |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.