Meituan: LongCat 2.0

Meituan's LongCat 2.0, a sparse mixture-of-experts model with 48B active parameters, demonstrates exceptional reliability with a 99% success rate across benchmarks, consistently providing usable responses. However, its speed performance tends to be slower, ranking in the 18th percentile, and its pricing is moderate, falling into the 39th percentile. The model exhibits significant strengths in several key areas. It achieves perfect accuracy in General Knowledge, Reasoning, and Ethics, often being the most accurate model at its price point and among models of similar speed. Its Coding and Mathematics capabilities are also very strong, ranking in the 97th and 95th percentiles respectively. While its Hallucinations accuracy is 94.0%, indicating a good ability to acknowledge uncertainty, its Instruction Following (76.8%) and Email Classification (96.0%) performance are more moderate compared to its other high-performing categories. The primary weakness across all benchmarks is its consistently longer response times, particularly noticeable in Coding and Mathematics.