Grok 3 is xAI's most advanced model, trained on the Colossus supercluster with 10 times the computational power of previous state-of-the-art models. It boasts a 1M-token context window and advanced reasoning capabilities, enhanced through large-scale reinforcement learning, enabling deep thought processes ranging from seconds to minutes for solving complex problems. The model achieves top-tier performance across academic benchmarks and real-world user evaluations, earning an Elo score of 1402 in the Chatbot Arena. It was released alongside Grok 3 Mini, a cost-efficient variant optimized for streamlined reasoning.
| Claude Sonnet 4 | Grok 3 Beta | |
|---|---|---|
Provider | ||
Web Site | ||
Release Date | May 22, 2025 3 days ago | Jan 19, 2025 4 months ago |
Modalities | text images | text images video |
API Providers | Anthropic API, Amazon Bedrock, Google Cloud's Vertex AI | xAI |
Knowledge Cut-off Date | Unknown | 2025-01 |
Open Source | No | No |
Pricing Input | $3 per million tokens | Not available |
Pricing Output | $15 per million tokens | Not available |
MMLU | 86.5% Source | Not available |
MMLU Pro | - | 79.9% Base model Source |
MMMU | 74.4% Source | 78% With Think mode Source |
HellaSwag | - | Not available |
HumanEval | - | Not available |
MATH | - | Not available |
GPQA | 75.4% Diamond Source | 84.6% With Think mode, Diamond Source |
IFEval | - | Not available |
Array | - | - |
AIME 2024 | - | - |
AIME 2025 | 75.5% Source | - |
Array | - | - |
Array | - | - |
Array | - | - |
Array | - | - |
Mobile Application |
Compare AI. Test. Benchmarks. Mobile Apps Chatbots, Sketch
Copyright © 2025 All Right Reserved.