Qwen 2 72B Instruct

Qwen 2 72B Instruct, released on June 6, 2024, demonstrates a strong overall performance profile. It performs among the fastest models, ranking in the 61st percentile for speed across five benchmarks, and offers competitive pricing, placing in the 41st percentile. The model exhibits excellent reliability, consistently providing usable responses. In terms of specific capabilities, Qwen 2 72B Instruct shows exceptional strength in Ethics, achieving perfect 100% accuracy, making it the most accurate model at its price point and among models of comparable speed. It also performs very well in Email Classification, with 99.0% accuracy, indicating strong contextual understanding. Instruction Following is solid at 53.0% accuracy, placing it in the middle tier. However, the model shows notable weaknesses in General Knowledge, with only 20.0% accuracy, and in Coding, where it scores 59.0%. These areas suggest potential limitations in handling broad, obscure factual recall and complex programming concepts. Its architectural features, including SwiGLU activation and group query attention, contribute to its overall efficiency and performance in its strong suits.