Google: Gemini 2.0 Flash Lite

Google's Gemini 2.0 Flash Lite, created on February 25, 2025, is designed for speed and cost-efficiency, offering a significantly faster time to first token (TTFT) than its predecessor, Gemini Flash 1.5, while aiming for quality comparable to Gemini Pro 1.5. The model consistently ranks among the fastest, achieving an Infinityth percentile across 8 benchmarks, and offers highly competitive pricing, also at an Infinityth percentile. Its reliability is exceptional, demonstrating a 100% success rate across all 8 benchmarks. In terms of performance, Gemini 2.0 Flash Lite excels in Ethics, achieving perfect accuracy and being the most accurate model at its price point and among models of similar speed. It also shows strong performance in Email Classification (99.0% accuracy, 92nd percentile) and General Knowledge (99.0% accuracy, 66th percentile), where it is noted as the most accurate among models of comparable speed. While its Hallucinations accuracy is 92.0% (46th percentile), indicating a reasonable ability to acknowledge uncertainty, a notable weakness is its 0.0% accuracy in Instruction Following, suggesting significant limitations in handling complex, multi-layered instructions. Performance in Mathematics (82.0% accuracy, 38th percentile), Reasoning (74.0% accuracy, 53rd percentile), and Coding (84.0% accuracy, 51st percentile) is moderate.