StepFun: Step3

StepFun: Step3, a cutting-edge multimodal reasoning model, demonstrates a unique performance profile. Despite its advanced architecture, including a Mixture-of-Experts design with 321B total parameters and 38B active, it tends to have longer response times, ranking in the 3rd percentile for speed across benchmarks. Similarly, its pricing is positioned at premium levels, placing it in the 20th percentile for cost competitiveness. However, Step3 excels in reliability, boasting an exceptional 99% success rate, indicating minimal technical failures and consistent provision of usable responses. In terms of specific benchmarks, Step3 achieved 99.0% accuracy in Ethics (53rd percentile), though at a high cost and very long duration. Its strongest performance was in Reasoning, where it scored 86.0% accuracy (84th percentile), showcasing strong complex problem-solving capabilities, albeit with the longest duration among all tests. In Email Classification, it achieved 96.0% accuracy (40th percentile) with a more moderate cost and duration. Overall, Step3's key strengths lie in its high reliability and strong reasoning abilities, while its primary weaknesses are its slow processing speed and premium pricing.