OpenAI: gpt-oss-20b

OpenAI's gpt-oss-20b demonstrates exceptional speed, consistently ranking among the fastest models, and offers highly competitive pricing. This open-weight, 21B parameter model, utilizing a Mixture-of-Experts (MoE) architecture, is optimized for lower-latency inference and deployability on consumer hardware. The model exhibits strong performance in several key areas. It achieved perfect accuracy in two instances of Keyword Topic Relevance Classification, showcasing excellent semantic understanding and conceptual relationship recognition, with one instance also being the fastest recorded. Its General Knowledge and Coding capabilities are impressive, scoring 99.0% (70th percentile) and 92.0% (81th percentile) respectively. The model also performs well in Ethics (99.0% accuracy, 62nd percentile), Instruction Following (66.0% accuracy, 74th percentile), and Reasoning (89.8% accuracy, 80th percentile). However, gpt-oss-20b shows significant weaknesses in certain Keyword Topic Relevance Classification tasks, with multiple 0.0% accuracy scores, indicating inconsistency or specific challenges in those particular test sets. Its Mathematics performance is moderate at 66.7% accuracy (31st percentile) and notably slow, ranking in the 2nd percentile for duration. Hallucinations are also a concern, with 70.0% accuracy (17th percentile), suggesting it sometimes fails to acknowledge uncertainty.