Share promptsSign inExplore benchmarks
← Health & medical benchmarks

MedQA leaderboard (Apr 2026): AI model scores

As of 16 Apr 2026, the highest reported Z.ai score on MedQA is GLM 5 (Z.ai) at 94.27%, #18 on that leaderboard, per Vals AI. The source no longer updates this leaderboard.

What it measures

Medical exam questions, run with and without demographic cues to check for bias.

US medical licensing exam style multiple-choice questions, including variants that test for demographic bias.

What the score means

Accuracy

Share of exam questions answered correctly.

Results from published AI leaderboards. Compare models within each benchmark; scores from different tests aren’t directly comparable. How we collect these results

Scores by model

Run by Vals AI. Leaderboard dated 16 Apr 2026 (no longer updated by the source). Last checked 22 Oct 2026. Showing top 25 of 95 models listed.

Highlight a provider: Anthropic OpenAI Google xAI DeepSeek Alibaba Z.ai Moonshot

Highlighting Z.ai models. Other providers are dimmed. Show all providers

  • Anthropic
  • OpenAI
  • Google
  • xAI
  • DeepSeek
  • Alibaba
  • Z.ai
  • Moonshot
MedQA: top 15 by AccuracyBars from zero. Leader: o1 at 96.52%. Z.ai models highlighted. Full values in the table below.0%20%40%60%80%100%o1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro Preview96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.595.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Qwen 3.5 Plus (Alibaba), rank 13: 95.21%QQwen 3.5 Plus95.21%o3 Mini (OpenAI), rank 14: 94.83%Oo3 Mini94.83%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%AClaude Sonnet 4.594.71%GLM 5 (Z.ai), rank 18: 94.27%Z#18 GLM 594.27%GLM 4.7 (Z.ai), rank 21: 93.74%Z#21 GLM 4.793.74%
MedQA: top 12 by AccuracyBars from zero. Leader: o1 at 96.52%. Z.ai models highlighted. Full values in the table below.0%50%100%o1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro P…96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.595.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%GLM 5 (Z.ai), rank 18: 94.27%Z#18 GLM 594.27%GLM 4.7 (Z.ai), rank 21: 93.74%Z#21 GLM 4.793.74%
MedQA: top 15 by AccuracyDot plot, axis starting at 88% (not zero). Leader: o1 at 96.52%. Z.ai models highlighted. Full values in the table below.88%90%92%94%96%98%100%ACCURACY · AXIS STARTS AT 88%, NOT ZEROo1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro Preview96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.595.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%Qwen 3.5 Plus (Alibaba), rank 13: 95.21%QQwen 3.5 Plus95.21%o3 Mini (OpenAI), rank 14: 94.83%Oo3 Mini94.83%Claude Sonnet 4.5 (Thinking) (Anthropic), rank 15: 94.71%AClaude Sonnet 4.594.71%GLM 5 (Z.ai), rank 18: 94.27%Z#18 GLM 594.27%GLM 4.7 (Z.ai), rank 21: 93.74%Z#21 GLM 4.793.74%
MedQA: top 12 by AccuracyDot plot, axis starting at 85% (not zero). Leader: o1 at 96.52%. Z.ai models highlighted. Full values in the table below.85%90%95%100%AXIS STARTS AT 85%, NOT ZEROo1 (OpenAI), rank 1: 96.52%Oo196.52%GPT 5.1 (OpenAI), rank 2: 96.38%OGPT 5.196.38%Gemini 3.1 Pro Preview (02/26) (Google), rank 3: 96.37%GGemini 3.1 Pro P…96.37%GPT 5 (OpenAI), rank 4: 96.32%OGPT 596.32%GPT 5.4 (xhigh) (OpenAI), rank 5: 96.09%OGPT 5.496.09%o3 (OpenAI), rank 6: 96.06%Oo396.06%GPT 5 Mini (OpenAI), rank 7: 96.06%OGPT 5 Mini96.06%Gemini 3 Pro (11/25) (Google), rank 8: 96.03%GGemini 3 Pro96.03%o4 Mini (OpenAI), rank 9: 96.02%Oo4 Mini96.02%Claude Opus 4.5 (Thinking) (Anthropic), rank 10: 95.88%AClaude Opus 4.595.88%Gemini 3 Flash (12/25) (Google), rank 11: 95.81%GGemini 3 Flash95.81%Claude Opus 4.6 (Thinking) (Anthropic), rank 12: 95.41%AClaude Opus 4.695.41%GLM 5 (Z.ai), rank 18: 94.27%Z#18 GLM 594.27%GLM 4.7 (Z.ai), rank 21: 93.74%Z#21 GLM 4.793.74%
Accuracy
Share of exam questions answered correctly.

All scores

MedQA scores, Z.ai models highlighted
RankModelProviderAccuracyPrice in / out ($/1M tokens)
1 o1OpenAI96.52%$15 / $60
2 GPT 5.1OpenAI96.38%$1.25 / $10
3 Gemini 3.1 Pro Preview (02/26)Google96.37%$2 / $12
4 GPT 5OpenAI96.32%$1.25 / $10
5 GPT 5.4 (xhigh)OpenAI96.09%$2.5 / $15
6 o3OpenAI96.06%$2 / $8
7 GPT 5 MiniOpenAI96.06%$0.25 / $2
8 Gemini 3 Pro (11/25)Google96.03%$2 / $12
9 o4 MiniOpenAI96.02%$1.1 / $4.4
10 Claude Opus 4.5 (Thinking)Anthropic95.88%$5 / $25
Show 15 more rows
RankModelProviderAccuracyPrice in / out ($/1M tokens)
11 Gemini 3 Flash (12/25)Google95.81%$0.5 / $3
12 Claude Opus 4.6 (Thinking)Anthropic95.41%$5 / $25
13 Qwen 3.5 PlusAlibaba95.21%$0.4 / $2.4
14 o3 MiniOpenAI94.83%$1.1 / $4.4
15 Claude Sonnet 4.5 (Thinking)Anthropic94.71%$3 / $15
16 Grok 4.20 (Reasoning)xAI94.55%$2 / $6
17 Kimi K2.5Moonshot94.37%$0.6 / $3
18 GLM 5Z.ai94.27%$1 / $3.2
19 GPT 5.2OpenAI94.13%$1.75 / $14
20 DeepSeek V3.2 (Thinking)DeepSeek93.92%$0.56 / $1.68
21 GLM 4.7Z.ai93.74%$0.6 / $2.2
22 Claude Opus 4.1 (Thinking)Anthropic93.59%$15 / $75
23 GPT 5 NanoOpenAI93.26%$0.05 / $0.4
24 Claude Opus 4.5 (Nonthinking)Anthropic93.16%$5 / $25
25 Gemini 2.5 Pro ExpGoogle93.14%$1.25 / $10

Source: Vals AI leaderboard ↗

Best-ranked Z.ai model here: GLM 5 (Z.ai). Browse prompts for any model →