Run by Legal Benchmarks. Leaderboard dated Oct 2026. Last checked 22 Oct 2026.
Substance vs form Ranked Performance vs cost
MM Highlighting MiniMax models. Other providers are dimmed. Show all providers
A AnthropicO OpenAIG GoogleX xAIM MetaD DeepSeekQ AlibabaZ Z.aiK MoonshotMM MiniMaxMi MistralLegal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. MiniMax models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM MiniMax M3 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. MiniMax models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM MiniMax M3 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: top 15 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. MiniMax models highlighted. Full values in the table below. 0% 10% 20% 30% 40% 50% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% Mistral Large 4 (Mistral), rank 9: 25.8% Mi Mistral Large 4 25.8% GPT-5.6 Sol (OpenAI), rank 14: 22.6% O GPT-5.6 Sol 22.6% Kimi K3 (Moonshot), rank 14: 22.6% K Kimi K3 22.6% MiniMax M3 (MiniMax), rank 23: 12.9% MM #23 MiniMax M3 12.9%
Legal Benchmarks: Contract Workflows: top 12 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. MiniMax models highlighted. Full values in the table below. 0% 20% 40% 60% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% MiniMax M3 (MiniMax), rank 23: 12.9% MM #23 MiniMax M3 12.9%
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. MiniMax models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM MiniMax M3 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. MiniMax models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM MiniMax M3 Claude Opus 5.5
October 2026 round. It ranks by task pass rate, so it is not comparable with the September round (Criterion Pass²) we charted before. Provider names follow ours (Qwen is listed under Alibaba). Latency is on the source page.