Perceptron: Perceptron Mk1

Perceptron Mk1, a vision-language model from perceptron, demonstrates competitive response times, ranking in the 49th percentile across seven benchmarks. It offers cost-effective solutions, placing in the 68th percentile for pricing. Notably, the model exhibits exceptional reliability with a 99% success rate, indicating consistent and usable responses. In terms of performance across categories, Perceptron Mk1 excels in Instruction Following, achieving 91.4% accuracy and ranking in the 96th percentile, making it a significant strength. Its Email Classification accuracy is also strong at 97.8%. However, the model shows weaknesses in General Knowledge (83.8% accuracy, 22nd percentile), Coding (77.8% accuracy, 33rd percentile), and particularly in Reasoning (55.1% accuracy, 32nd percentile). While its hallucination rate is relatively low at 88.4% accuracy for acknowledging uncertainty, this places it in the 34th percentile. The model's Ethics performance is 96.8% accurate but ranks in the 28th percentile. Overall, Perceptron Mk1 is a highly reliable and cost-efficient model with strong instruction following capabilities, though it could benefit from improvements in general knowledge, coding, and complex reasoning tasks.