Goliath 120B

Goliath 120B, a merged model from alpindale, demonstrates exceptional speed and cost efficiency. It consistently ranks among the fastest models and offers highly competitive pricing across all evaluated benchmarks. However, its performance in accuracy-based tasks is generally low. In Ethics and Mathematics, it achieved 44.0% and 3.0% accuracy respectively, placing it in the lower percentiles. Similarly, its Coding accuracy was 22.0%. A significant weakness is observed in Instruction Following, where it scored 0.0% accuracy, indicating a substantial challenge in processing and executing complex directives. The model's strongest performance was in Email Classification, achieving 95.0% accuracy, which suggests a capability for specific classification tasks. Overall, Goliath 120B excels in operational efficiency (speed and cost) but struggles significantly with tasks requiring nuanced understanding, ethical reasoning, mathematical problem-solving, and precise instruction adherence.