Inflection: Inflection 3 Pi

Inflection 3 Pi, created on October 10, 2024, demonstrates exceptional speed and cost-efficiency, consistently ranking among the fastest and most competitively priced models across eight benchmarks. Its reliability is strong, achieving a 92% success rate, indicating few technical issues. In terms of performance across benchmarks, Inflection 3 Pi shows particular strength in ethical reasoning and email classification, achieving 98.0% and 97.0% accuracy respectively. It also performs reasonably well in acknowledging uncertainty, with a 90.0% accuracy in hallucination detection. However, the model exhibits significant weaknesses in instruction following, scoring 0.0% accuracy, suggesting a critical area for improvement. Its performance in general knowledge, mathematics, reasoning, and coding is moderate, generally falling in the lower percentiles compared to other models. The model's ability to mirror user tone and style, along with its access to recent news and suitability for customer support and roleplay, are notable features.