Finance Agent: Accuracy vs Cost per test (USD) Scatter plot of 25 models. Leader on Accuracy: Claude Opus 5.5 at 67.85%. Google models highlighted. Full values in the table below. $.01 $.1 $1 $10 50% 55% 60% 65% COST PER TEST (USD) · LOG SCALE ACCURACY MiniMax-M3 (MiniMax): Cost per test (USD) $0.30, Accuracy 54.34% MM GPT-6 Luna (OpenAI): Cost per test (USD) $0.12, Accuracy 56.84% O DeepSeek V4 Pro 0813 (DeepSeek): Cost per test (USD) $0.82, Accuracy 57.12% D MiniMax-M3.1-Flash (MiniMax): Cost per test (USD) $0.16, Accuracy 58.83% MM Step 5 Preview (Other): Cost per test (USD) $0.58, Accuracy 58.90% · Kimi K3 (Moonshot): Cost per test (USD) $1.88, Accuracy 60.01% K GPT-6 Astra (OpenAI): Cost per test (USD) $7.82, Accuracy 60.43% O Grok 4.7 (xAI): Cost per test (USD) $2.24, Accuracy 60.59% X GLM 5.3 Flash (Z.ai): Cost per test (USD) $0.070, Accuracy 60.59% Z Muse Spark Open (Meta): Cost per test (USD) $2.76, Accuracy 60.66% M Mistral Large 4 (Mistral): Cost per test (USD) $1.02, Accuracy 61.38% Mi Hy4 Preview (Other): Cost per test (USD) $0.67, Accuracy 61.62% · GPT-6.1 Sol (OpenAI): Cost per test (USD) $1.63, Accuracy 61.82% O DeepSeek V4.1 Flash 1017 (DeepSeek): Cost per test (USD) $0.47, Accuracy 62.93% D MiMo V2.6 Flash (Xiaomi): Cost per test (USD) $0.070, Accuracy 63.32% Xi MiMo V2.6 Pro (Xiaomi): Cost per test (USD) $0.18, Accuracy 64.26% Xi GLM 5.3 (Z.ai): Cost per test (USD) $1.03, Accuracy 65.00% Z Claude Haiku 5.5 (Anthropic): Cost per test (USD) $1.64, Accuracy 65.37% A DeepSeek V4.1 Flash (DeepSeek): Cost per test (USD) $0.37, Accuracy 65.43% D Wonder (Meta): Cost per test (USD) $2.62, Accuracy 65.55% M Claude Sonnet 5.5 (Anthropic): Cost per test (USD) $6.95, Accuracy 67.28% A Wonder Full (Meta): Cost per test (USD) $2.68, Accuracy 67.58% M Claude Opus 5.5 (Anthropic): Cost per test (USD) $8.91, Accuracy 67.85% A Gemini 3.8 Flash (Google): Cost per test (USD) $1.99, Accuracy 65.76% G Gemini 4 Argon (Google): Cost per test (USD) $4.32, Accuracy 67.66% G Gemini 4 Argon Gemini 3.8 Flash Claude Opus 5.5
Finance Agent: Accuracy vs Cost per test (USD) Scatter plot of 25 models. Leader on Accuracy: Claude Opus 5.5 at 67.85%. Google models highlighted. Full values in the table below. $.01 $.1 $1 $10 50% 55% 60% 65% COST PER TEST (USD) · LOG SCALE ACCURACY MiniMax-M3 (MiniMax): Cost per test (USD) $0.30, Accuracy 54.34% MM GPT-6 Luna (OpenAI): Cost per test (USD) $0.12, Accuracy 56.84% O DeepSeek V4 Pro 0813 (DeepSeek): Cost per test (USD) $0.82, Accuracy 57.12% D MiniMax-M3.1-Flash (MiniMax): Cost per test (USD) $0.16, Accuracy 58.83% MM Step 5 Preview (Other): Cost per test (USD) $0.58, Accuracy 58.90% · Kimi K3 (Moonshot): Cost per test (USD) $1.88, Accuracy 60.01% K GPT-6 Astra (OpenAI): Cost per test (USD) $7.82, Accuracy 60.43% O Grok 4.7 (xAI): Cost per test (USD) $2.24, Accuracy 60.59% X GLM 5.3 Flash (Z.ai): Cost per test (USD) $0.070, Accuracy 60.59% Z Muse Spark Open (Meta): Cost per test (USD) $2.76, Accuracy 60.66% M Mistral Large 4 (Mistral): Cost per test (USD) $1.02, Accuracy 61.38% Mi Hy4 Preview (Other): Cost per test (USD) $0.67, Accuracy 61.62% · GPT-6.1 Sol (OpenAI): Cost per test (USD) $1.63, Accuracy 61.82% O DeepSeek V4.1 Flash 1017 (DeepSeek): Cost per test (USD) $0.47, Accuracy 62.93% D MiMo V2.6 Flash (Xiaomi): Cost per test (USD) $0.070, Accuracy 63.32% Xi MiMo V2.6 Pro (Xiaomi): Cost per test (USD) $0.18, Accuracy 64.26% Xi GLM 5.3 (Z.ai): Cost per test (USD) $1.03, Accuracy 65.00% Z Claude Haiku 5.5 (Anthropic): Cost per test (USD) $1.64, Accuracy 65.37% A DeepSeek V4.1 Flash (DeepSeek): Cost per test (USD) $0.37, Accuracy 65.43% D Wonder (Meta): Cost per test (USD) $2.62, Accuracy 65.55% M Claude Sonnet 5.5 (Anthropic): Cost per test (USD) $6.95, Accuracy 67.28% A Wonder Full (Meta): Cost per test (USD) $2.68, Accuracy 67.58% M Claude Opus 5.5 (Anthropic): Cost per test (USD) $8.91, Accuracy 67.85% A Gemini 3.8 Flash (Google): Cost per test (USD) $1.99, Accuracy 65.76% G Gemini 4 Argon (Google): Cost per test (USD) $4.32, Accuracy 67.66% G Gemini 4 Argon Gemini 3.8 Flash
Finance Agent: top 15 by Accuracy Dot plot, axis starting at 55% (not zero). Leader: Claude Opus 5.5 at 67.85%. Google models highlighted. Full values in the table below. 55% 60% 65% ACCURACY · AXIS STARTS AT 55%, NOT ZERO Claude Opus 5.5 (Anthropic), rank 1: 67.85% A Claude Opus 5.5 67.85% Gemini 4 Argon (Google), rank 2: 67.66% G Gemini 4 Argon 67.66% Wonder Full (Meta), rank 3: 67.58% M Wonder Full 67.58% Claude Sonnet 5.5 (Anthropic), rank 4: 67.28% A Claude Sonnet 5.5 67.28% Gemini 3.8 Flash (Google), rank 5: 65.76% G Gemini 3.8 Flash 65.76% Wonder (Meta), rank 6: 65.55% M Wonder 65.55% DeepSeek V4.1 Flash (DeepSeek), rank 7: 65.43% D DeepSeek V4.1 Flash 65.43% Claude Haiku 5.5 (Anthropic), rank 8: 65.37% A Claude Haiku 5.5 65.37% GLM 5.3 (Z.ai), rank 9: 65.00% Z GLM 5.3 65.00% MiMo V2.6 Pro (Xiaomi), rank 10: 64.26% Xi MiMo V2.6 Pro 64.26% MiMo V2.6 Flash (Xiaomi), rank 11: 63.32% Xi MiMo V2.6 Flash 63.32% DeepSeek V4.1 Flash 1017 (DeepSeek), rank 12: 62.93% D DeepSeek V4.1 Flash 1017 62.93% GPT-6.1 Sol (OpenAI), rank 13: 61.82% O GPT-6.1 Sol 61.82% Hy4 Preview (Other), rank 14: 61.62% · Hy4 Preview 61.62% Mistral Large 4 (Mistral), rank 15: 61.38% Mi Mistral Large 4 61.38%
Finance Agent: top 12 by Accuracy Dot plot, axis starting at 55% (not zero). Leader: Claude Opus 5.5 at 67.85%. Google models highlighted. Full values in the table below. 55% 60% 65% AXIS STARTS AT 55%, NOT ZERO Claude Opus 5.5 (Anthropic), rank 1: 67.85% A Claude Opus 5.5 67.85% Gemini 4 Argon (Google), rank 2: 67.66% G Gemini 4 Argon 67.66% Wonder Full (Meta), rank 3: 67.58% M Wonder Full 67.58% Claude Sonnet 5.5 (Anthropic), rank 4: 67.28% A Claude Sonnet 5.5 67.28% Gemini 3.8 Flash (Google), rank 5: 65.76% G Gemini 3.8 Flash 65.76% Wonder (Meta), rank 6: 65.55% M Wonder 65.55% DeepSeek V4.1 Flash (DeepSeek), rank 7: 65.43% D DeepSeek V4.1 Fl… 65.43% Claude Haiku 5.5 (Anthropic), rank 8: 65.37% A Claude Haiku 5.5 65.37% GLM 5.3 (Z.ai), rank 9: 65.00% Z GLM 5.3 65.00% MiMo V2.6 Pro (Xiaomi), rank 10: 64.26% Xi MiMo V2.6 Pro 64.26% MiMo V2.6 Flash (Xiaomi), rank 11: 63.32% Xi MiMo V2.6 Flash 63.32% DeepSeek V4.1 Flash 1017 (DeepSeek), rank 12: 62.93% D DeepSeek V4.1 Fl… 62.93%