Inference.net: Schematron V2 Small

Inference.net's Schematron V2 Small, a 3B-parameter HTML-to-JSON extraction model, demonstrates exceptional operational efficiency. It consistently ranks among the fastest models, achieving the 93rd percentile across 8 benchmarks, and offers highly competitive pricing, placing in the 88th percentile. The model exhibits outstanding reliability with a 100% success rate across all benchmarks, indicating minimal technical failures. While optimized for HTML-to-JSON extraction, its performance across general benchmarks reveals areas for improvement. The model struggles significantly with Instruction Following (1% accuracy), Reasoning (16% accuracy), and Hallucinations (32% accuracy), suggesting limitations in complex cognitive tasks and uncertainty handling. Performance in General Knowledge (82%), Ethics (85%), and Mathematics (38%) is below average compared to other models. Its Email Classification (59%) and Coding (46%) capabilities also show room for growth. Schematron V2 Small's core strength lies in its intended purpose of extraction quality for complex schemas and long pages, which is not directly measured here, alongside its impressive speed, cost-effectiveness, and reliability.