StepFun: Step 3.5 Flash

Step 3.5 Flash, StepFun's open-source foundation model, demonstrates exceptional performance across a wide range of benchmarks. Leveraging a sparse Mixture of Experts (MoE) architecture, it efficiently activates 11B of its 196B parameters, contributing to its impressive speed. The model consistently performs among the fastest, ranking in the 77th percentile for speed across eight benchmarks. Furthermore, it offers highly competitive pricing, placing in the 86th percentile. Reliability is a standout feature, with Step 3.5 Flash achieving a perfect 100% success rate across all evaluated benchmarks, indicating minimal technical failures. Across all eight benchmark categories—Hallucinations, Instruction Following, Coding, General Knowledge, Email Classification, Reasoning, Ethics, and Mathematics—Step 3.5 Flash achieved a perfect 100% accuracy. This remarkable consistency highlights its robust capabilities in diverse tasks, from complex reasoning and coding to nuanced instruction following and ethical considerations. Its key strengths lie in its unparalleled accuracy across all tested domains, combined with its speed efficiency and cost-effectiveness. The model exhibits no notable weaknesses based on the provided benchmark data, consistently delivering top-tier results in accuracy, often at competitive price points and impressive speeds.