Run by Vals AI (benchmark by Google Research). Leaderboard dated 9 Jan 2026 (no longer updated by the source). Last checked 22 Oct 2026. Showing top 25 of 75 models listed.
Leaderboard Ranked
Q Highlighting Alibaba models. Other providers are dimmed. Show all providers
A AnthropicO OpenAIG GoogleM MetaD DeepSeekQ AlibabaMGSM: top 15 by Accuracy Bars from zero. Leader: Claude Opus 4.5 (Thinking) at 95.20%. Alibaba models highlighted. Full values in the table below. 0% 20% 40% 60% 80% 100% Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 (Thinking) 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 (Nonthinkin… 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 (Thinking) 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 (Nonthinkin… 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Claude 3.7 Sonnet (Thinking) (Anthropic), rank 13: 92.98% A Claude 3.7 Sonnet 92.98% GPT 5 (OpenAI), rank 14: 92.84% O GPT 5 92.84% Claude 3.5 Sonnet Latest (Anthropic), rank 15: 92.58% A Claude 3.5 Sonnet Latest 92.58% Qwen 3 (235B) (Alibaba), rank 17: 92.47% Q #17 Qwen 3 92.47% Qwen 3 Max Preview (Alibaba), rank 23: 92.15% Q #23 Qwen 3 Max Preview 92.15% Qwen 3 Max (Alibaba), rank 25: 91.82% Q #25 Qwen 3 Max 91.82%
MGSM: top 12 by Accuracy Bars from zero. Leader: Claude Opus 4.5 (Thinking) at 95.20%. Alibaba models highlighted. Full values in the table below. 0% 50% 100% Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 … 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 … 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 … 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 … 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Qwen 3 (235B) (Alibaba), rank 17: 92.47% Q #17 Qwen 3 92.47% Qwen 3 Max Preview (Alibaba), rank 23: 92.15% Q #23 Qwen 3 Max P… 92.15% Qwen 3 Max (Alibaba), rank 25: 91.82% Q #25 Qwen 3 Max 91.82%
MGSM: top 15 by Accuracy Dot plot, axis starting at 85% (not zero). Leader: Claude Opus 4.5 (Thinking) at 95.20%. Alibaba models highlighted. Full values in the table below. 85% 87.5% 90% 92.5% 95% ACCURACY · AXIS STARTS AT 85%, NOT ZERO Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 (Thinking) 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 (Nonthinkin… 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 (Thinking) 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 (Nonthinkin… 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Claude 3.7 Sonnet (Thinking) (Anthropic), rank 13: 92.98% A Claude 3.7 Sonnet 92.98% GPT 5 (OpenAI), rank 14: 92.84% O GPT 5 92.84% Claude 3.5 Sonnet Latest (Anthropic), rank 15: 92.58% A Claude 3.5 Sonnet Latest 92.58% Qwen 3 (235B) (Alibaba), rank 17: 92.47% Q #17 Qwen 3 92.47% Qwen 3 Max Preview (Alibaba), rank 23: 92.15% Q #23 Qwen 3 Max Preview 92.15% Qwen 3 Max (Alibaba), rank 25: 91.82% Q #25 Qwen 3 Max 91.82%
MGSM: top 12 by Accuracy Dot plot, axis starting at 85% (not zero). Leader: Claude Opus 4.5 (Thinking) at 95.20%. Alibaba models highlighted. Full values in the table below. 85% 90% 95% 100% AXIS STARTS AT 85%, NOT ZERO Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 … 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 … 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 … 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 … 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Qwen 3 (235B) (Alibaba), rank 17: 92.47% Q #17 Qwen 3 92.47% Qwen 3 Max Preview (Alibaba), rank 23: 92.15% Q #23 Qwen 3 Max P… 92.15% Qwen 3 Max (Alibaba), rank 25: 91.82% Q #25 Qwen 3 Max 91.82%
Last updated by Vals in January 2026, so newer models are missing.