Meituan: LongCat Flash Chat

LongCat-Flash-Chat, Meituan's 560B parameter MoE model, demonstrates a strong overall performance profile, particularly excelling in reliability. With a 99% success rate across benchmarks, it consistently provides usable responses, indicating exceptional stability. In terms of speed, the model exhibits moderate performance, ranking in the 29th percentile, suggesting it is not among the fastest but offers acceptable latency. Cost-wise, LongCat-Flash-Chat is generally cost-effective, placing in the 62nd percentile. The model showcases remarkable accuracy in foundational knowledge and ethical reasoning, achieving perfect scores in both General Knowledge and Ethics benchmarks, often being the most accurate at its price point and speed. It also performs very well in Email Classification and Instruction Following, securing 88th percentile accuracy in both. Its reasoning capabilities are strong, with an 80% accuracy, placing it in the 87th percentile. While its Coding performance is solid at 84% accuracy, it ranks lower at the 60th percentile compared to other models. Key strengths include its high reliability, exceptional accuracy in knowledge-based and ethical tasks, and strong instruction following and reasoning. No significant weaknesses are apparent, though its speed is moderate rather than leading.