Share promptsSign inExplore benchmarks
← Health & medical benchmarks

MedQA leaderboard (Apr 2026): AI model scores

As of 16 Apr 2026, the highest reported Anthropic score on MedQA is Claude Opus 4.5 (Thinking) (Anthropic) at 95.88%, #10 on that leaderboard, per Vals AI. The source no longer updates this leaderboard.

What it measures

Medical exam questions, run with and without demographic cues to check for bias.

US medical licensing exam style multiple-choice questions, including variants that test for demographic bias.

What the score means

Accuracy

Share of exam questions answered correctly.

Results from published AI leaderboards. Compare models within each benchmark; scores from different tests aren’t directly comparable. How we collect these results

Scores by model

Run by Vals AI. Leaderboard dated 16 Apr 2026 (no longer updated by the source). Last checked 22 Oct 2026. Showing top 25 of 95 models listed.

Highlight a provider: Anthropic OpenAI Google xAI DeepSeek Alibaba Z.ai Moonshot

Highlighting Anthropic models. Other providers are dimmed. Show all providers

  • Anthropic
  • OpenAI
  • Google
  • xAI
  • DeepSeek
  • Alibaba
  • Z.ai
  • Moonshot
MedQA: top 15 by AccuracyBars from zero. Leader: o1 at 96.52%. Anthropic models highlighted. Full values in the table below.0%20%40%60%80%100%o1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro Preview96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.5 (Thinking)95.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Qwen 3.5 Plus (Alibaba), rank 13: 95.21%QQwen 3.5 Plus95.21%o3 Mini (OpenAI), rank 14: 94.83%Oo3 Mini94.83%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%AClaude Sonnet 4.594.71%Claude Opus 4.1 (Thinking) (Anthropic), rank 22: 93.59%A#22 Claude Opus 4.193.59%Claude Opus 4.5 (Nonthinking) (Anthropic), rank 24: 93.16%A#24 Claude Opus 4.5 (Nonthi…93.16%
MedQA: top 12 by AccuracyBars from zero. Leader: o1 at 96.52%. Anthropic models highlighted. Full values in the table below.0%50%100%o1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro P…96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.5 …95.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%A#15 Claude Sonne…94.71%Claude Opus 4.1 (Thinking) (Anthropic), rank 22: 93.59%A#22 Claude Opus …93.59%Claude Opus 4.5 (Nonthinking) (Anthropic), rank 24: 93.16%A#24 Claude Opus …93.16%
MedQA: top 15 by AccuracyDot plot, axis starting at 87.5% (not zero). Leader: o1 at 96.52%. Anthropic models highlighted. Full values in the table below.87.5%90%92.5%95%97.5%100%ACCURACY · AXIS STARTS AT 87.5%, NOT ZEROo1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro Preview96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.5 (Thinking)95.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Qwen 3.5 Plus (Alibaba), rank 13: 95.21%QQwen 3.5 Plus95.21%o3 Mini (OpenAI), rank 14: 94.83%Oo3 Mini94.83%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%AClaude Sonnet 4.594.71%Claude Opus 4.1 (Thinking) (Anthropic), rank 22: 93.59%A#22 Claude Opus 4.193.59%Claude Opus 4.5 (Nonthinking) (Anthropic), rank 24: 93.16%A#24 Claude Opus 4.5 (Nonthi…93.16%
MedQA: top 12 by AccuracyDot plot, axis starting at 85% (not zero). Leader: o1 at 96.52%. Anthropic models highlighted. Full values in the table below.85%90%95%100%AXIS STARTS AT 85%, NOT ZEROo1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro P…96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.5 …95.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%A#15 Claude Sonne…94.71%Claude Opus 4.1 (Thinking) (Anthropic), rank 22: 93.59%A#22 Claude Opus …93.59%Claude Opus 4.5 (Nonthinking) (Anthropic), rank 24: 93.16%A#24 Claude Opus …93.16%
Accuracy
Share of exam questions answered correctly.

All scores

MedQA scores, Anthropic models highlighted
RankModelProviderAccuracyPrice in / out ($/1M tokens)
1 o1OpenAI96.52%$15 / $60
2 GPT 5.1OpenAI96.38%$1.25 / $10
3 Gemini 3.1 Pro Preview (02/26)Google96.37%$2 / $12
4 GPT 5OpenAI96.32%$1.25 / $10
5 GPT 5.4 (xhigh)OpenAI96.09%$2.5 / $15
6 o3OpenAI96.06%$2 / $8
7 GPT 5 MiniOpenAI96.06%$0.25 / $2
8 Gemini 3 Pro (11/25)Google96.03%$2 / $12
9 o4 MiniOpenAI96.02%$1.1 / $4.4
10 Claude Opus 4.5 (Thinking)Anthropic95.88%$5 / $25
Show 15 more rows
RankModelProviderAccuracyPrice in / out ($/1M tokens)
11 Gemini 3 Flash (12/25)Google95.81%$0.5 / $3
12 Claude Opus 4.6 (Thinking)Anthropic95.41%$5 / $25
13 Qwen 3.5 PlusAlibaba95.21%$0.4 / $2.4
14 o3 MiniOpenAI94.83%$1.1 / $4.4
15 Claude Sonnet 4.5 (Thinking)Anthropic94.71%$3 / $15
16 Grok 4.20 (Reasoning)xAI94.55%$2 / $6
17 Kimi K2.5Moonshot94.37%$0.6 / $3
18 GLM 5Z.ai94.27%$1 / $3.2
19 GPT 5.2OpenAI94.13%$1.75 / $14
20 DeepSeek V3.2 (Thinking)DeepSeek93.92%$0.56 / $1.68
21 GLM 4.7Z.ai93.74%$0.6 / $2.2
22 Claude Opus 4.1 (Thinking)Anthropic93.59%$15 / $75
23 GPT 5 NanoOpenAI93.26%$0.05 / $0.4
24 Claude Opus 4.5 (Nonthinking)Anthropic93.16%$5 / $25
25 Gemini 2.5 Pro ExpGoogle93.14%$1.25 / $10

Source: Vals AI leaderboard ↗

Best-ranked Anthropic model here: Claude Opus 4.5 (Thinking) (Anthropic). Try prompts for Claude →