Run by Legal Benchmarks. Leaderboard dated Oct 2026. Last checked 22 Oct 2026.
Substance vs form Ranked Performance vs cost
Z Highlighting Z.ai models. Other providers are dimmed. Show all providers
A AnthropicO OpenAIG GoogleX xAIM MetaD DeepSeekQ AlibabaZ Z.aiK MoonshotMM MiniMaxMi MistralLegal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. Z.ai models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z GLM-5.3 GLM-5.3 Flash Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Form vs Task pass rate Scatter plot of 24 models. Leader on Form: Claude Opus 5.5 at 93.9%. Z.ai models highlighted. Full values in the table below. 10% 20% 30% 40% 50% 60% 70% 80% 90% TASK PASS RATE FORM Mistral Medium 3.5 (Mistral): Task pass rate 9.7%, Form 75.0% Mi MiniMax M3 (MiniMax): Task pass rate 12.9%, Form 83.4% MM Claude Sonnet 5 (Anthropic): Task pass rate 16.1%, Form 86.9% A GPT-5.6 Terra (OpenAI): Task pass rate 16.1%, Form 86.0% O DeepSeek V4 Pro (DeepSeek): Task pass rate 19.4%, Form 88.3% D GPT-5.6 Luna (OpenAI): Task pass rate 19.4%, Form 86.1% O DeepSeek V4 Flash (DeepSeek): Task pass rate 22.6%, Form 73.4% D Kimi K3 (Moonshot): Task pass rate 22.6%, Form 84.7% K GPT-5.6 Sol (OpenAI): Task pass rate 22.6%, Form 89.2% O Mistral Large 4 (Mistral): Task pass rate 25.8%, Form 63.4% Mi Grok 4.6 (xAI): Task pass rate 25.8%, Form 76.8% X Gemini 3.8 Flash (Google): Task pass rate 25.8%, Form 76.4% G GPT-6.1 Sol (OpenAI): Task pass rate 25.8%, Form 90.8% O GPT-6 Astra (OpenAI): Task pass rate 25.8%, Form 91.9% O Qwen 3.8 Max (Alibaba): Task pass rate 29.0%, Form 64.2% Q Claude Sonnet 5.5 (Anthropic): Task pass rate 29.0%, Form 91.1% A Claude Haiku 5.5 (Anthropic): Task pass rate 35.5%, Form 83.1% A Qwen 3.8 Flash (Alibaba): Task pass rate 38.7%, Form 67.7% Q Claude Opus 5 (Anthropic): Task pass rate 45.2%, Form 90.8% A Muse Spark 1.3 (Meta): Task pass rate 48.4%, Form 87.8% M Claude Fable 5.1 (Anthropic): Task pass rate 48.4%, Form 89.7% A Claude Opus 5.5 (Anthropic): Task pass rate 48.4%, Form 93.9% A GLM-5.3 (Z.ai): Task pass rate 19.4%, Form 81.9% Z GLM-5.3 Flash (Z.ai): Task pass rate 22.6%, Form 67.8% Z GLM-5.3 GLM-5.3 Flash Claude Opus 5.5
Legal Benchmarks: Contract Workflows: top 15 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. Z.ai models highlighted. Full values in the table below. 0% 10% 20% 30% 40% 50% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% Mistral Large 4 (Mistral), rank 9: 25.8% Mi Mistral Large 4 25.8% GPT-5.6 Sol (OpenAI), rank 14: 22.6% O GPT-5.6 Sol 22.6% Kimi K3 (Moonshot), rank 14: 22.6% K Kimi K3 22.6% GLM-5.3 Flash (Z.ai), rank 14: 22.6% Z #14 GLM-5.3 Flash 22.6% GLM-5.3 (Z.ai), rank 18: 19.4% Z #18 GLM-5.3 19.4%
Legal Benchmarks: Contract Workflows: top 12 by Task pass rate Bars from zero. Leader: Claude Opus 5.5 at 48.4%. Z.ai models highlighted. Full values in the table below. 0% 20% 40% 60% Claude Opus 5.5 (Anthropic), rank 1: 48.4% A Claude Opus 5.5 48.4% Claude Fable 5.1 (Anthropic), rank 1: 48.4% A Claude Fable 5.1 48.4% Muse Spark 1.3 (Meta), rank 1: 48.4% M Muse Spark 1.3 48.4% Claude Opus 5 (Anthropic), rank 4: 45.2% A Claude Opus 5 45.2% Qwen 3.8 Flash (Alibaba), rank 5: 38.7% Q Qwen 3.8 Flash 38.7% Claude Haiku 5.5 (Anthropic), rank 6: 35.5% A Claude Haiku 5.5 35.5% Claude Sonnet 5.5 (Anthropic), rank 7: 29.0% A Claude Sonnet 5.5 29.0% Qwen 3.8 Max (Alibaba), rank 7: 29.0% Q Qwen 3.8 Max 29.0% GPT-6 Astra (OpenAI), rank 9: 25.8% O GPT-6 Astra 25.8% GPT-6.1 Sol (OpenAI), rank 9: 25.8% O GPT-6.1 Sol 25.8% Gemini 3.8 Flash (Google), rank 9: 25.8% G Gemini 3.8 Flash 25.8% Grok 4.6 (xAI), rank 9: 25.8% X Grok 4.6 25.8% GLM-5.3 Flash (Z.ai), rank 14: 22.6% Z #14 GLM-5.3 Flash 22.6% GLM-5.3 (Z.ai), rank 18: 19.4% Z #18 GLM-5.3 19.4%
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. Z.ai models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z GLM-5.3 Flash GLM-5.3 Claude Opus 5.5
Legal Benchmarks: Contract Workflows: Task pass rate vs Cost per task (USD) Scatter plot of 24 models. Leader on Task pass rate: Claude Opus 5.5 at 48.4%. Z.ai models highlighted. Full values in the table below. $.01 $.1 $1 $10 10% 20% 30% 40% 50% COST PER TASK (USD) · LOG SCALE TASK PASS RATE Mistral Medium 3.5 (Mistral): Cost per task (USD) $0.32, Task pass rate 9.7% Mi MiniMax M3 (MiniMax): Cost per task (USD) $0.030, Task pass rate 12.9% MM Claude Sonnet 5 (Anthropic): Cost per task (USD) $0.36, Task pass rate 16.1% A GPT-5.6 Terra (OpenAI): Cost per task (USD) $0.14, Task pass rate 16.1% O DeepSeek V4 Pro (DeepSeek): Cost per task (USD) $0.080, Task pass rate 19.4% D GPT-5.6 Luna (OpenAI): Cost per task (USD) $0.020, Task pass rate 19.4% O DeepSeek V4 Flash (DeepSeek): Cost per task (USD) $0.010, Task pass rate 22.6% D Kimi K3 (Moonshot): Cost per task (USD) $0.26, Task pass rate 22.6% K GPT-5.6 Sol (OpenAI): Cost per task (USD) $0.18, Task pass rate 22.6% O Mistral Large 4 (Mistral): Cost per task (USD) $0.090, Task pass rate 25.8% Mi Grok 4.6 (xAI): Cost per task (USD) $0.28, Task pass rate 25.8% X Gemini 3.8 Flash (Google): Cost per task (USD) $0.22, Task pass rate 25.8% G GPT-6.1 Sol (OpenAI): Cost per task (USD) $0.11, Task pass rate 25.8% O GPT-6 Astra (OpenAI): Cost per task (USD) $1.13, Task pass rate 25.8% O Qwen 3.8 Max (Alibaba): Cost per task (USD) $0.39, Task pass rate 29.0% Q Claude Sonnet 5.5 (Anthropic): Cost per task (USD) $0.98, Task pass rate 29.0% A Claude Haiku 5.5 (Anthropic): Cost per task (USD) $0.16, Task pass rate 35.5% A Qwen 3.8 Flash (Alibaba): Cost per task (USD) $0.030, Task pass rate 38.7% Q Claude Opus 5 (Anthropic): Cost per task (USD) $0.90, Task pass rate 45.2% A Muse Spark 1.3 (Meta): Cost per task (USD) $0.20, Task pass rate 48.4% M Claude Fable 5.1 (Anthropic): Cost per task (USD) $1.50, Task pass rate 48.4% A Claude Opus 5.5 (Anthropic): Cost per task (USD) $1.47, Task pass rate 48.4% A GLM-5.3 (Z.ai): Cost per task (USD) $0.090, Task pass rate 19.4% Z GLM-5.3 Flash (Z.ai): Cost per task (USD) $0.020, Task pass rate 22.6% Z GLM-5.3 Flash GLM-5.3 Claude Opus 5.5
October 2026 round. It ranks by task pass rate, so it is not comparable with the September round (Criterion Pass²) we charted before. Provider names follow ours (Qwen is listed under Alibaba). Latency is on the source page.