Arcee AI: Caller Large

Arcee AI's Caller Large, created on May 5, 2025, is an SLM specifically designed for function-calling and tool orchestration, prioritizing structured JSON outputs and multi-step tool chains over next-token accuracy. This model performs among the fastest models, typically ranking in the top tier for speed (76th percentile), and offers competitive pricing (51st percentile). Its reliability is exceptional, demonstrating minimal technical failures and ranking in the 96th percentile. While its core strength lies in tool invocation, its general benchmark performance reveals a mixed profile. Caller Large exhibits strong performance in Ethics (97.0% accuracy) and General Knowledge (90.5% accuracy), though its percentile rankings in these areas are moderate (36th and 35th respectively), suggesting a broad but not top-tier general understanding. Its Instruction Following (53.1% accuracy, 59th percentile) and Reasoning (68.0% accuracy, 63rd percentile) capabilities are solid. However, it shows notable weaknesses in Coding (60.0% accuracy, 29th percentile) and particularly in Email Classification (87.0% accuracy, but only 12th percentile), indicating that while it can achieve high accuracy in some classification tasks, its relative performance against other models in this domain is low. Its speed is particularly impressive in Email Classification, completing tasks very quickly (98th percentile for duration).