Run by Vals AI (benchmark by Google Research). Leaderboard dated 9 Jan 2026 (no longer updated by the source). Last checked 22 Oct 2026. Showing top 25 of 75 models listed.
Leaderboard Ranked
O Highlighting OpenAI models. Other providers are dimmed. Show all providers
A AnthropicO OpenAIG GoogleM MetaD DeepSeekQ AlibabaMGSM: top 15 by Accuracy Bars from zero. Leader: Claude Opus 4.5 (Thinking) at 95.20%. OpenAI models highlighted. Full values in the table below. 0% 20% 40% 60% 80% 100% Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 (Thinking) 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 (Nonthinkin… 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 (Thinking) 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 (Nonthinkin… 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Claude 3.7 Sonnet (Thinking) (Anthropic), rank 13: 92.98% A Claude 3.7 Sonnet 92.98% GPT 5 (OpenAI), rank 14: 92.84% O GPT 5 92.84% Claude 3.5 Sonnet Latest (Anthropic), rank 15: 92.58% A Claude 3.5 Sonnet Latest 92.58% GPT 5 Mini (OpenAI), rank 16: 92.58% O #16 GPT 5 Mini 92.58% GPT OSS 120B (OpenAI), rank 24: 92.04% O #24 GPT OSS 120B 92.04%
MGSM: top 12 by Accuracy Bars from zero. Leader: Claude Opus 4.5 (Thinking) at 95.20%. OpenAI models highlighted. Full values in the table below. 0% 50% 100% Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 … 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 … 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 … 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 … 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% GPT 5 (OpenAI), rank 14: 92.84% O #14 GPT 5 92.84% GPT 5 Mini (OpenAI), rank 16: 92.58% O #16 GPT 5 Mini 92.58% GPT OSS 120B (OpenAI), rank 24: 92.04% O #24 GPT OSS 120B 92.04%
MGSM: top 15 by Accuracy Dot plot, axis starting at 85% (not zero). Leader: Claude Opus 4.5 (Thinking) at 95.20%. OpenAI models highlighted. Full values in the table below. 85% 87.5% 90% 92.5% 95% ACCURACY · AXIS STARTS AT 85%, NOT ZERO Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 (Thinking) 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 (Nonthinkin… 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 (Thinking) 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 (Nonthinkin… 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% Claude 3.7 Sonnet (Thinking) (Anthropic), rank 13: 92.98% A Claude 3.7 Sonnet 92.98% GPT 5 (OpenAI), rank 14: 92.84% O GPT 5 92.84% Claude 3.5 Sonnet Latest (Anthropic), rank 15: 92.58% A Claude 3.5 Sonnet Latest 92.58% GPT 5 Mini (OpenAI), rank 16: 92.58% O #16 GPT 5 Mini 92.58% GPT OSS 120B (OpenAI), rank 24: 92.04% O #24 GPT OSS 120B 92.04%
MGSM: top 12 by Accuracy Dot plot, axis starting at 85% (not zero). Leader: Claude Opus 4.5 (Thinking) at 95.20%. OpenAI models highlighted. Full values in the table below. 85% 90% 95% 100% AXIS STARTS AT 85%, NOT ZERO Claude Opus 4.5 (Thinking) (Anthropic), rank 1: 95.20% A Claude Opus 4.5 … 95.20% Claude Opus 4.5 (Nonthinking) (Anthropic), rank 2: 94.76% A Claude Opus 4.5 … 94.76% Claude Opus 4.1 (Thinking) (Anthropic), rank 3: 94.44% A Claude Opus 4.1 … 94.44% Claude Sonnet 4.5 (Thinking) (Anthropic), rank 4: 94.33% A Claude Sonnet 4.5 94.33% Claude Opus 4.1 (Nonthinking) (Anthropic), rank 5: 94.22% A Claude Opus 4.1 … 94.22% GPT 5.2 (OpenAI), rank 6: 94.00% O GPT 5.2 94.00% Gemini 3 Pro (11/25) (Google), rank 7: 93.93% G Gemini 3 Pro 93.93% Claude Opus 4 (Nonthinking) (Anthropic), rank 8: 93.78% A Claude Opus 4 93.78% o4 Mini (OpenAI), rank 9: 93.42% O o4 Mini 93.42% Gemini 3 Flash (12/25) (Google), rank 10: 93.31% G Gemini 3 Flash 93.31% Claude Sonnet 4 (Nonthinking) (Anthropic), rank 11: 93.02% A Claude Sonnet 4 93.02% GPT 5.1 (OpenAI), rank 12: 92.98% O GPT 5.1 92.98% GPT 5 (OpenAI), rank 14: 92.84% O #14 GPT 5 92.84% GPT 5 Mini (OpenAI), rank 16: 92.58% O #16 GPT 5 Mini 92.58% GPT OSS 120B (OpenAI), rank 24: 92.04% O #24 GPT OSS 120B 92.04%
Last updated by Vals in January 2026, so newer models are missing.