Vals Index: Accuracy vs Cost per test (USD) Scatter plot of 23 models. Leader on Accuracy: Claude Sonnet 5.5 at 70.85%. Google models highlighted. Full values in the table below. $.1 $1 $10 $100 30% 40% 50% 60% 70% COST PER TEST (USD) · LOG SCALE ACCURACY Inkling Small (Other): Cost per test (USD) $0.40, Accuracy 27.59% · Inkling (Other): Cost per test (USD) $1.85, Accuracy 28.96% · Muse Spark Open (Meta): Cost per test (USD) $4.72, Accuracy 48.57% M GLM 5.3 Flash (Z.ai): Cost per test (USD) $1.13, Accuracy 50.86% Z GPT-6 Luna (OpenAI): Cost per test (USD) $0.45, Accuracy 52.32% O Kimi K3 (Moonshot): Cost per test (USD) $7.17, Accuracy 52.95% K DeepSeek V4 Pro 0813 (DeepSeek): Cost per test (USD) $2.50, Accuracy 52.97% D Hy4 Preview (Other): Cost per test (USD) $1.45, Accuracy 53.21% · MiniMax-M3.1-Flash (MiniMax): Cost per test (USD) $0.66, Accuracy 53.78% MM MiMo V2.6 Flash (Xiaomi): Cost per test (USD) $0.22, Accuracy 54.83% Xi MiMo V2.6 Pro (Xiaomi): Cost per test (USD) $0.43, Accuracy 57.81% Xi Grok 4.7 (xAI): Cost per test (USD) $12, Accuracy 58.56% X Claude Haiku 5.5 (Anthropic): Cost per test (USD) $3.17, Accuracy 58.71% A GLM 5.3 (Z.ai): Cost per test (USD) $8.52, Accuracy 59.73% Z DeepSeek V4.1 Flash 1017 (DeepSeek): Cost per test (USD) $0.66, Accuracy 61.26% D GPT-6.1 Sol (OpenAI): Cost per test (USD) $3.61, Accuracy 63.94% O Wonder (Meta): Cost per test (USD) $11, Accuracy 64.88% M GPT-6 Astra (OpenAI): Cost per test (USD) $21, Accuracy 65.02% O Wonder Full (Meta): Cost per test (USD) $6.81, Accuracy 66.79% M Claude Opus 5.5 (Anthropic): Cost per test (USD) $28, Accuracy 70.18% A Claude Sonnet 5.5 (Anthropic): Cost per test (USD) $19, Accuracy 70.85% A Gemini 3.8 Flash (Google): Cost per test (USD) $6.06, Accuracy 55.95% G Gemini 4 Argon (Google): Cost per test (USD) $13, Accuracy 69.24% G Gemini 4 Argon Gemini 3.8 Flash Claude Sonnet 5.5
Vals Index: Accuracy vs Cost per test (USD) Scatter plot of 23 models. Leader on Accuracy: Claude Sonnet 5.5 at 70.85%. Google models highlighted. Full values in the table below. $.1 $1 $10 $100 30% 40% 50% 60% 70% COST PER TEST (USD) · LOG SCALE ACCURACY Inkling Small (Other): Cost per test (USD) $0.40, Accuracy 27.59% · Inkling (Other): Cost per test (USD) $1.85, Accuracy 28.96% · Muse Spark Open (Meta): Cost per test (USD) $4.72, Accuracy 48.57% M GLM 5.3 Flash (Z.ai): Cost per test (USD) $1.13, Accuracy 50.86% Z GPT-6 Luna (OpenAI): Cost per test (USD) $0.45, Accuracy 52.32% O Kimi K3 (Moonshot): Cost per test (USD) $7.17, Accuracy 52.95% K DeepSeek V4 Pro 0813 (DeepSeek): Cost per test (USD) $2.50, Accuracy 52.97% D Hy4 Preview (Other): Cost per test (USD) $1.45, Accuracy 53.21% · MiniMax-M3.1-Flash (MiniMax): Cost per test (USD) $0.66, Accuracy 53.78% MM MiMo V2.6 Flash (Xiaomi): Cost per test (USD) $0.22, Accuracy 54.83% Xi MiMo V2.6 Pro (Xiaomi): Cost per test (USD) $0.43, Accuracy 57.81% Xi Grok 4.7 (xAI): Cost per test (USD) $12, Accuracy 58.56% X Claude Haiku 5.5 (Anthropic): Cost per test (USD) $3.17, Accuracy 58.71% A GLM 5.3 (Z.ai): Cost per test (USD) $8.52, Accuracy 59.73% Z DeepSeek V4.1 Flash 1017 (DeepSeek): Cost per test (USD) $0.66, Accuracy 61.26% D GPT-6.1 Sol (OpenAI): Cost per test (USD) $3.61, Accuracy 63.94% O Wonder (Meta): Cost per test (USD) $11, Accuracy 64.88% M GPT-6 Astra (OpenAI): Cost per test (USD) $21, Accuracy 65.02% O Wonder Full (Meta): Cost per test (USD) $6.81, Accuracy 66.79% M Claude Opus 5.5 (Anthropic): Cost per test (USD) $28, Accuracy 70.18% A Claude Sonnet 5.5 (Anthropic): Cost per test (USD) $19, Accuracy 70.85% A Gemini 3.8 Flash (Google): Cost per test (USD) $6.06, Accuracy 55.95% G Gemini 4 Argon (Google): Cost per test (USD) $13, Accuracy 69.24% G Gemini 4 Argon Gemini 3.8 Flash
Vals Index: top 15 by Accuracy Bars from zero. Leader: Claude Sonnet 5.5 at 70.85%. Google models highlighted. Full values in the table below. 0% 20% 40% 60% 80% Claude Sonnet 5.5 (Anthropic), rank 1: 70.85% A Claude Sonnet 5.5 70.85% Claude Opus 5.5 (Anthropic), rank 2: 70.18% A Claude Opus 5.5 70.18% Gemini 4 Argon (Google), rank 3: 69.24% G Gemini 4 Argon 69.24% Wonder Full (Meta), rank 4: 66.79% M Wonder Full 66.79% GPT-6 Astra (OpenAI), rank 5: 65.02% O GPT-6 Astra 65.02% Wonder (Meta), rank 6: 64.88% M Wonder 64.88% GPT-6.1 Sol (OpenAI), rank 7: 63.94% O GPT-6.1 Sol 63.94% DeepSeek V4.1 Flash 1017 (DeepSeek), rank 8: 61.26% D DeepSeek V4.1 Flash 1017 61.26% GLM 5.3 (Z.ai), rank 9: 59.73% Z GLM 5.3 59.73% Claude Haiku 5.5 (Anthropic), rank 10: 58.71% A Claude Haiku 5.5 58.71% Grok 4.7 (xAI), rank 11: 58.56% X Grok 4.7 58.56% MiMo V2.6 Pro (Xiaomi), rank 12: 57.81% Xi MiMo V2.6 Pro 57.81% Gemini 3.8 Flash (Google), rank 13: 55.95% G Gemini 3.8 Flash 55.95% MiMo V2.6 Flash (Xiaomi), rank 14: 54.83% Xi MiMo V2.6 Flash 54.83% MiniMax-M3.1-Flash (MiniMax), rank 15: 53.78% MM MiniMax-M3.1-Flash 53.78%
Vals Index: top 12 by Accuracy Bars from zero. Leader: Claude Sonnet 5.5 at 70.85%. Google models highlighted. Full values in the table below. 0% 25% 50% 75% Claude Sonnet 5.5 (Anthropic), rank 1: 70.85% A Claude Sonnet 5.5 70.85% Claude Opus 5.5 (Anthropic), rank 2: 70.18% A Claude Opus 5.5 70.18% Gemini 4 Argon (Google), rank 3: 69.24% G Gemini 4 Argon 69.24% Wonder Full (Meta), rank 4: 66.79% M Wonder Full 66.79% GPT-6 Astra (OpenAI), rank 5: 65.02% O GPT-6 Astra 65.02% Wonder (Meta), rank 6: 64.88% M Wonder 64.88% GPT-6.1 Sol (OpenAI), rank 7: 63.94% O GPT-6.1 Sol 63.94% DeepSeek V4.1 Flash 1017 (DeepSeek), rank 8: 61.26% D DeepSeek V4.1 Fl… 61.26% GLM 5.3 (Z.ai), rank 9: 59.73% Z GLM 5.3 59.73% Claude Haiku 5.5 (Anthropic), rank 10: 58.71% A Claude Haiku 5.5 58.71% Grok 4.7 (xAI), rank 11: 58.56% X Grok 4.7 58.56% MiMo V2.6 Pro (Xiaomi), rank 12: 57.81% Xi MiMo V2.6 Pro 57.81% Gemini 3.8 Flash (Google), rank 13: 55.95% G #13 Gemini 3.8 F… 55.95%