Sao10K: Llama 3 8B Lunaris

Sao10K: Llama 3 8B Lunaris demonstrates strong performance in terms of operational efficiency, consistently ranking among the fastest models (81st percentile) and offering highly competitive pricing (96th percentile) across various benchmarks. However, its accuracy across most evaluated categories is generally low. The model struggles significantly with complex tasks such as Coding (4% accuracy), Mathematics (19% accuracy), and Reasoning (20% accuracy), indicating notable weaknesses in these areas. Its performance in General Knowledge (69% accuracy) and Ethics (68.5% accuracy) is also below average. A key weakness is its high hallucination rate, with only 52% accuracy in acknowledging uncertainty, placing it in the 8th percentile. While it shows moderate capability in Instruction Following (41% accuracy) and Email Classification (89% accuracy), the latter still ranks in the 15th percentile. Overall, Lunaris 8B is a cost-effective and fast model, but its current accuracy levels suggest it is better suited for applications where speed and low cost are paramount, and high accuracy in complex reasoning or factual recall is not the primary requirement.