Benchmark Detail
Vending Machine System
MEDIUM232 models testedTop 79.1
Success Rate
68.0%
Quality Score
82
Avg Tests Passed
21
Models Tested
232
232 models
1–50 of 232
| Sel | # | Model | Config | Score ↓ | Success | Date | |
|---|---|---|---|---|---|---|---|
1 | GPT-5.5OpenAI Configmedium | medium | 79.1 | 77.4% | 94 | 2026-04 | |
2 | ↳ GPT-5.5 Configmedium | medium | 79.1 | 77.4% | 94 | 2026-07 | |
3 | GPT-5.6 Sol ProOpenAI Configlow | low | 79.1 | 77.4% | 94 | 2026-07 | |
4 | GPT 5.2OpenAI Config— | — | 78.9 | 77.4% | 92 | 2025-12 | |
5 | GPT-5.5OpenAI Confighigh | high | 78.9 | 77.4% | 92 | 2026-04 | |
6 | ↳ GPT-5.5 Configxhigh | xhigh | 78.9 | 77.4% | 92 | 2026-04 | |
7 | GPT-5.6 SolOpenAI Confighigh | high | 78.9 | 77.4% | 92 | 2026-07 | |
8 | GPT-5.6 Sol ProOpenAI Configmedium | medium | 78.9 | 77.4% | 92 | 2026-07 | |
9 | GPT-5.6 TerraOpenAI Configlow | low | 78.9 | 77.4% | 92 | 2026-07 | |
10 | GPT-5.6 Terra ProOpenAI Configmedium | medium | 78.9 | 77.4% | 92 | 2026-07 | |
11 | Claude Opus 5Anthropic Confighigh | high | 78.7 | 77.4% | 90 | 2026-07 | |
12 | ↳ Claude Opus 5 Configmedium | medium | 78.7 | 77.4% | 90 | 2026-07 | |
13 | Kimi K2.6Moonshotai Configlow | low | 78.7 | 77.4% | 90 | 2026-04 | |
14 | GPT 5.3 CodexOpenAI Config— | — | 78.7 | 77.4% | 90 | 2026-02 | |
15 | GPT 5.4OpenAI Confighigh | high | 78.7 | 77.4% | 90 | 2026-04 | |
16 | ↳ GPT 5.4 Configlow | low | 78.7 | 77.4% | 90 | 2026-04 | |
17 | ↳ GPT 5.4 Config— | — | 78.7 | 77.4% | 90 | 2026-03 | |
18 | GPT-5.6 LunaOpenAI Configlow | low | 78.7 | 77.4% | 90 | 2026-07 | |
19 | ↳ GPT-5.6 Luna Configmedium | medium | 78.7 | 77.4% | 90 | 2026-07 | |
20 | GPT-5.6 SolOpenAI Configlow | low | 78.7 | 77.4% | 90 | 2026-07 | |
21 | ↳ GPT-5.6 Sol Configmedium | medium | 78.7 | 77.4% | 90 | 2026-07 | |
22 | GPT-5.6 TerraOpenAI Confighigh | high | 78.7 | 77.4% | 90 | 2026-07 | |
23 | GPT-6 AstraOpenAI Confighigh | high | 78.7 | 77.4% | 90 | 2026-09 | |
24 | ↳ GPT-6 Astra Configlow | low | 78.7 | 77.4% | 90 | 2026-09 | |
25 | ↳ GPT-6 Astra Configmedium | medium | 78.7 | 77.4% | 90 | 2026-09 | |
26 | ↳ GPT-6 Astra Configgen | gen | 78.7 | 77.4% | 90 | 2026-09 | |
27 | Gemini 2.5 ProGoogle Config— | — | 78.5 | 77.4% | 88 | 2025-08 | |
28 | GPT-5.5OpenAI Configlow | low | 78.5 | 77.4% | 88 | 2026-04 | |
29 | ↳ GPT-5.5 Configlow | low | 78.5 | 77.4% | 88 | 2026-05 | |
30 | ↳ GPT-5.5 Confignone | none | 78.5 | 77.4% | 88 | 2026-04 | |
31 | GPT-5.6 LunaOpenAI Confighigh | high | 78.5 | 77.4% | 88 | 2026-07 | |
32 | GPT-5.6 Luna ProOpenAI Configlow | low | 78.5 | 77.4% | 88 | 2026-07 | |
33 | GPT-5.6 TerraOpenAI Configmedium | medium | 78.5 | 77.4% | 88 | 2026-07 | |
34 | GPT-5.6 Terra ProOpenAI Configlow | low | 78.5 | 77.4% | 88 | 2026-07 | |
35 | ↳ GPT-5.6 Terra Pro Configxhigh | xhigh | 78.5 | 77.4% | 88 | 2026-07 | |
36 | Claude Fable 5Anthropic Configlow | low | 78.3 | 77.4% | 86 | 2026-06 | |
37 | Claude Opus 4.7Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 78.3 | 77.4% | 86 | 2026-04 | |
38 | Claude Opus 5Anthropic Configlow | low | 78.3 | 77.4% | 86 | 2026-07 | |
39 | Gemma 4 31BGoogle Confighigh | high | 78.3 | 77.4% | 86 | 2026-04 | |
40 | Kimi K3Moonshotai Configmedium | medium | 78.3 | 77.4% | 86 | 2026-07 | |
41 | GPT 5.3 ChatOpenAI Config— | — | 78.3 | 77.4% | 86 | 2026-03 | |
42 | GPT-5.5OpenAI Confighigh | high | 78.3 | 77.4% | 86 | 2026-07 | |
43 | ↳ GPT-5.5 Config— | — | 78.3 | 77.4% | 86 | 2026-04 | |
44 | GPT-5.6 Luna ProOpenAI Configmedium | medium | 78.3 | 77.4% | 86 | 2026-07 | |
45 | GPT 5 nanoOpenAI Config— | — | 78.3 | 77.4% | 86 | 2025-08 | |
46 | OSS 120BOpenAI Config— | — | 78.3 | 77.4% | 86 | 2025-08 | |
47 | Qwen3.8 MaxQwen Configgen | gen | 78.3 | 77.4% | 86 | 2026-08 | |
48 | Claude Fable 5Anthropic Confighigh | high | 78.1 | 77.4% | 84 | 2026-06 | |
49 | ↳ Claude Fable 5 Configgen | gen | 78.1 | 77.4% | 84 | 2026-07 | |
50 | Claude Opus 4.7Anthropic Confighigh | high | 78.1 | 77.4% | 84 | 2026-05 |
1–50 of 232