Benchmark Detail
Parking Garage Management
MEDIUM201 models testedTop 85.2
Success Rate
50.2%
Quality Score
48
Avg Tests Passed
20
Models Tested
201
201 models
1–50 of 201
| Sel | # | Model | Config | Score ↓ | Success | Date | |
|---|---|---|---|---|---|---|---|
1 | GPT-5.5OpenAI Configlow | low | 85.2 | 84.6% | 90 | 2026-04 | |
2 | ↳ GPT-5.5 Configlow | low | 85.0 | 84.6% | 88 | 2026-07 | |
3 | ↳ GPT-5.5 Confighigh | high | 83.6 | 84.6% | 74 | 2026-04 | |
4 | GPT-5.6 SolOpenAI Confighigh | high | 80.1 | 79.5% | 86 | 2026-07 | |
5 | ↳ GPT-5.6 Sol Configmedium | medium | 80.1 | 79.5% | 86 | 2026-07 | |
6 | GPT-5.6 Sol ProOpenAI Configmedium | medium | 79.9 | 79.5% | 84 | 2026-07 | |
7 | GPT 5.4OpenAI Confighigh | high | 77.0 | 76.9% | 78 | 2026-04 | |
8 | GPT-5.6 Terra ProOpenAI Configxhigh | xhigh | 77.0 | 76.9% | 78 | 2026-07 | |
9 | GPT-5.6 Sol ProOpenAI Configlow | low | 76.2 | 76.9% | 70 | 2026-07 | |
10 | GPT-5.5OpenAI Configxhigh | xhigh | 75.7 | 79.5% | 42 | 2026-04 | |
11 | ↳ GPT-5.5 Confighigh | high | 73.9 | 74.4% | 70 | 2026-05 | |
12 | GPT-5.6 Terra ProOpenAI Configlow | low | 71.5 | 69.2% | 92 | 2026-07 | |
13 | GPT-5.6 TerraOpenAI Confighigh | high | 70.3 | 69.2% | 80 | 2026-07 | |
14 | GPT-5.5OpenAI Configlow | low | 69.6 | 66.7% | 96 | 2026-05 | |
15 | ↳ GPT-5.5 Config— | — | 69.4 | 66.7% | 94 | 2026-04 | |
16 | ↳ GPT-5.5 Confignone | none | 68.2 | 66.7% | 82 | 2026-04 | |
17 | Claude Sonnet 3.7Anthropic Config | 67.1 | 69.2% | 48 | 2025-08 | ||
18 | Claude Fable 5Anthropic Confighigh | high | 66.9 | 69.2% | 46 | 2026-06 | |
19 | Claude Sonnet 4.6Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 66.9 | 69.2% | 46 | 2026-04 | |
20 | Claude Opus 4.6Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 66.7 | 69.2% | 44 | 2026-04 | |
21 | Claude Sonnet 4.6Anthropic Configmedium· 2,048 tokens | medium· 2,048 tokens | 66.7 | 69.2% | 44 | 2026-04 | |
22 | Claude Fable 5Anthropic Configlow | low | 66.5 | 69.2% | 42 | 2026-07 | |
23 | ↳ Claude Fable 5 Configlow | low | 66.3 | 69.2% | 40 | 2026-06 | |
24 | ↳ Claude Fable 5 Configmedium | medium | 66.3 | 69.2% | 40 | 2026-06 | |
25 | ↳ Claude Fable 5 Configmedium | medium | 66.3 | 69.2% | 40 | 2026-07 | |
26 | Claude Sonnet 4.6Anthropic Config— | — | 66.3 | 69.2% | 40 | 2026-02 | |
27 | DeepSeek V3.2 ExpDeepSeek Config— | — | 66.3 | 69.2% | 40 | 2025-12 | |
28 | GLM 5.2Z Ai Configgen | gen | 66.3 | 69.2% | 40 | 2026-06 | |
29 | Claude Fable 5Anthropic Configgen | gen | 66.1 | 69.2% | 38 | 2026-07 | |
30 | Claude Opus 4.6 FastAnthropic Config— | — | 65.9 | 69.2% | 36 | 2026-04 | |
31 | Claude Opus 4.6Anthropic Config— | — | 65.9 | 69.2% | 36 | 2026-02 | |
32 | Claude Opus 4.7Anthropic Configmedium | medium | 65.9 | 69.2% | 36 | 2026-05 | |
33 | Grok 3xAI Config— | — | 65.9 | 69.2% | 36 | 2025-08 | |
34 | Claude Opus 4.6Anthropic Configmedium· 2,048 tokens | medium· 2,048 tokens | 65.7 | 69.2% | 34 | 2026-04 | |
35 | Claude Opus 4.7Anthropic Configlow | low | 65.7 | 69.2% | 34 | 2026-05 | |
36 | Claude Opus 4.8Anthropic Configgen | gen | 65.7 | 69.2% | 34 | 2026-05 | |
37 | Claude Fable 5Anthropic Confighigh | high | 65.5 | 69.2% | 32 | 2026-07 | |
38 | Claude Opus 4.8 (Fast)Anthropic Configmedium | medium | 64.6 | 66.7% | 46 | 2026-05 | |
39 | GPT-5.5OpenAI Confighigh | high | 64.5 | 64.1% | 68 | 2026-07 | |
40 | Claude Opus 4.5Anthropic Config— | — | 64.3 | 69.2% | 20 | 2025-11 | |
41 | GLM-5.1Z Ai Confighigh | high | 64.3 | 69.2% | 20 | 2026-04 | |
42 | GPT-5.6 SolOpenAI Configlow | low | 64.2 | 61.5% | 88 | 2026-07 | |
43 | Claude Opus 4Anthropic Config— | — | 64.1 | 69.2% | 18 | 2025-08 | |
44 | DeepSeek V3DeepSeek Config— | — | 64.1 | 64.1% | 64 | 2025-08 | |
45 | Claude Opus 4.8 (Fast)Anthropic Confighigh | high | 63.8 | 66.7% | 38 | 2026-05 | |
46 | Claude Sonnet 3.5Anthropic Config— | — | 63.4 | 61.5% | 80 | 2025-08 | |
47 | GPT 5.4OpenAI Configmedium | medium | 63.4 | 61.5% | 80 | 2026-04 | |
48 | Claude Sonnet 4Anthropic Config— | — | 63.2 | 66.7% | 32 | 2025-08 | |
49 | Claude Opus 4.8 (Fast)Anthropic Configlow | low | 63.0 | 66.7% | 30 | 2026-05 | |
50 | Claude Opus 4.1Anthropic Config— | — | 62.9 | 69.2% | 6 | 2025-08 |
1–50 of 201