The SCAM leaderboard
ModelOut of the Box± Avg Critical FailuresSkill± Avg Critical FailuresImprovementGemini 3 Flash75.6%2.199.3% 0.7+23.7Claude Opus 4.692.4%0.598.3% 0.2+5.9Claude Sonnet 449.4%1.798.1% 0.7+48.7Claude Haiku 4.565.5%5.497.8% 1.2+32.3GPT-5.281.0%1.496.6% 1.2+15.5GPT-4.137.9%2.496.2% 0.7+58.3Gemini 2.5 Flash34.9%3.494.8% 1.4+59.9GPT-4.1 Mini35.8%0.394.7% 2.9+58.8 The baseline rankings follow the pattern you'd expect: larger, more capable models score higher. But the skill rankings tell a different stor