xAI: Grok 3 Beta

Grok 3 Beta, xAI's flagship model, demonstrates competitive response times, performing among the faster models with a 58th percentile speed ranking. However, it is positioned at premium pricing levels, ranking in the 11th percentile for cost. A standout feature is its exceptional reliability, achieving a perfect 100% success rate across all benchmarks, indicating minimal technical failures. The model exhibits perfect accuracy in critical areas such as Hallucinations, General Knowledge, and Ethics, often being the most accurate at its price point and speed. It also performs strongly in Email Classification (99.0% accuracy) and Coding (92.0% accuracy), placing it in the upper percentiles for these categories. While its Instruction Following (64.0% accuracy) and Reasoning (76.0% accuracy) capabilities are solid, they are not as dominant as its knowledge-based and ethical performance. Grok 3 Beta excels in structured tasks and benchmarks like GPQA, LCB, and MMLU-Pro, outperforming Grok 3 Mini even on high-thinking tasks, aligning with its description as a model suited for enterprise use cases like data extraction and text summarization, and possessing deep domain knowledge.