Run by Legal Benchmarks. Leaderboard dated Oct 2026. Last checked 22 Oct 2026.
Substance vs form Ranked Performance vs cost
Mi Highlighting Mistral models. Other providers are dimmed. Show all providers
A AnthropicO OpenAIG GoogleX xAIM MetaD DeepSeekQ AlibabaZ Z.aiK MoonshotMM MiniMaxMi MistralLegal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. Mistral models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Mistral Medium 3.5 Mistral Large 4 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. Mistral models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Mistral Medium 3.5 Mistral Large 4 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: top 15 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. Mistral models highlighted. Full values in the table below. 0% 10% 20% 30% 40% 50% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% Mistral Large 4 (Mistral), rank 9: 25.8% Mi Mistral Large 4 25.8% GPT-5.6 Sol (OpenAI), rank 14: 22.6% O GPT-5.6 Sol 22.6% Kimi K3 (Moonshot), rank 14: 22.6% K Kimi K3 22.6% Mistral Medium 3.5 (Mistral), rank 24: 9.7% Mi #24 Mistral Medium 3.5 9.7%
Legal Benchmarks: Contract Workflows: top 12 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. Mistral models highlighted. Full values in the table below. 0% 20% 40% 60% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% Mistral Large 4 (Mistral), rank 9: 25.8% Mi #9 Mistral Large… 25.8% Mistral Medium 3.5 (Mistral), rank 24: 9.7% Mi #24 Mistral Medi… 9.7%
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. Mistral models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Mistral Large 4 Mistral Medium 3.5 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. Mistral models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Mistral Large 4 Mistral Medium 3.5 Claude Opus 5.5
October 2026 round. It ranks by task pass rate, so it is not comparable with the September round (Criterion Pass²) we charted before. Provider names follow ours (Qwen is listed under Alibaba). Latency is on the source page.