Benchmark Detail
Calendar System
EASY214 models testedTop 92.1
Success Rate
78.8%
Quality Score
62
Avg Tests Passed
18
Models Tested
214
214 models
1–50 of 214
| Sel | # | Model | Config | Score ↓ | Success | Date | |
|---|---|---|---|---|---|---|---|
1 | OSS 120BOpenAI Config— | — | 92.1 | 95.7% | 60 | 2025-08 | |
2 | Gemma 4 26B A4BGoogle Confignone | none | 91.9 | 95.7% | 58 | 2026-04 | |
3 | Grok 4.5xAI Configlow | low | 91.7 | 95.7% | 56 | 2026-07 | |
4 | Claude Opus 4Anthropic Config— | — | 91.3 | 95.7% | 52 | 2025-08 | |
5 | Claude 4.5 HaikuAnthropic Config— | — | 90.9 | 95.7% | 48 | 2025-10 | |
6 | Claude Opus 4.1Anthropic Config— | — | 90.9 | 95.7% | 48 | 2025-08 | |
7 | Qwen3.8 27BQwen Configlow | low | 90.5 | 95.7% | 44 | 2026-08 | |
8 | Gemini 2.0 Flash 001Google Config— | — | 88.6 | 91.3% | 64 | 2025-08 | |
9 | GPT 5 nanoOpenAI Config— | — | 87.2 | 91.3% | 50 | 2025-08 | |
10 | GPT 4 TurboOpenAI Config— | — | 87.0 | 91.3% | 48 | 2025-08 | |
11 | GPT 5.1 Codex MiniOpenAI Config— | — | 86.7 | 87.0% | 84 | 2025-11 | |
12 | Kimi K2.6Moonshotai Configlow | low | 86.1 | 87.0% | 78 | 2026-04 | |
13 | Claude Opus 5Anthropic Confighigh | high | 85.9 | 87.0% | 76 | 2026-07 | |
14 | GPT 4.1OpenAI Config— | — | 85.6 | 91.3% | 34 | 2025-08 | |
15 | Claude Sonnet 4.6Anthropic Config— | — | 85.3 | 87.0% | 70 | 2026-02 | |
16 | Codestral 25.08Mistral Config— | — | 85.3 | 87.0% | 70 | 2025-08 | |
17 | Claude Fable 5Anthropic Configgen | gen | 85.1 | 87.0% | 68 | 2026-07 | |
18 | Claude Opus 4.8Anthropic Configmedium | medium | 85.1 | 87.0% | 68 | 2026-05 | |
19 | Gemini 3.5 FlashGoogle Configxhigh | xhigh | 85.1 | 87.0% | 68 | 2026-05 | |
20 | Claude Fable 5Anthropic Configlow | low | 84.9 | 87.0% | 66 | 2026-06 | |
21 | Claude Opus 4.8Anthropic Confighigh | high | 84.9 | 87.0% | 66 | 2026-05 | |
22 | Claude Sonnet 4.6Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 84.9 | 87.0% | 66 | 2026-04 | |
23 | Gemini 2.5 FlashGoogle Config— | — | 84.9 | 87.0% | 66 | 2025-08 | |
24 | GLM 5Z.AI Config— | — | 84.9 | 87.0% | 66 | 2026-02 | |
25 | Claude Fable 5Anthropic Confighigh | high | 84.7 | 87.0% | 64 | 2026-06 | |
26 | ↳ Claude Fable 5 Configlow | low | 84.7 | 87.0% | 64 | 2026-07 | |
27 | ↳ Claude Fable 5 Configmedium | medium | 84.7 | 87.0% | 64 | 2026-06 | |
28 | Claude Opus 4.6Anthropic Configmedium· 2,048 tokens | medium· 2,048 tokens | 84.7 | 87.0% | 64 | 2026-04 | |
29 | Claude Opus 4.7Anthropic Configlow | low | 84.7 | 87.0% | 64 | 2026-05 | |
30 | Grok 4xAI Config— | — | 84.7 | 87.0% | 64 | 2025-08 | |
31 | Claude 3.5 HaikuAnthropic Config— | — | 84.5 | 87.0% | 62 | 2025-08 | |
32 | Claude Fable 5Anthropic Confighigh | high | 84.5 | 87.0% | 62 | 2026-07 | |
33 | Claude Opus 4.5Anthropic Config— | — | 84.5 | 87.0% | 62 | 2025-11 | |
34 | Claude Opus 4.6Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 84.5 | 87.0% | 62 | 2026-04 | |
35 | Claude Opus 4.7Anthropic Configmedium | medium | 84.5 | 87.0% | 62 | 2026-05 | |
36 | ↳ Claude Opus 4.7 Configmedium· 2,048 tokens | medium· 2,048 tokens | 84.5 | 87.0% | 62 | 2026-04 | |
37 | Claude Opus 4.8Anthropic Configlow | low | 84.5 | 87.0% | 62 | 2026-05 | |
38 | Claude Opus 4.8 (Fast)Anthropic Configmedium | medium | 84.5 | 87.0% | 62 | 2026-05 | |
39 | Gemini 2.5 ProGoogle Config— | — | 84.5 | 87.0% | 62 | 2025-08 | |
40 | GPT 4.1 nanoOpenAI Config— | — | 84.5 | 87.0% | 62 | 2025-08 | |
41 | o4 miniOpenAI Config— | — | 84.5 | 87.0% | 62 | 2025-08 | |
42 | Claude Opus 4.6 FastAnthropic Config— | — | 84.3 | 87.0% | 60 | 2026-04 | |
43 | Claude Opus 4.6Anthropic Config— | — | 84.3 | 87.0% | 60 | 2026-02 | |
44 | Claude Opus 4.7Anthropic Confighigh· 8,192 tokens | high· 8,192 tokens | 84.3 | 87.0% | 60 | 2026-04 | |
45 | Claude Opus 4.8 (Fast)Anthropic Confighigh | high | 84.3 | 87.0% | 60 | 2026-05 | |
46 | DeepSeek V4 ProDeepSeek Configgen | gen | 84.3 | 87.0% | 60 | 2026-05 | |
47 | Gemini 3.1 Flash Lite PreviewGoogle Configmedium | medium | 84.3 | 87.0% | 60 | 2026-04 | |
48 | Kimi K2 ThinkingMoonshot AI Config | 84.3 | 87.0% | 60 | 2025-12 | ||
49 | Claude Opus 4.8 (Fast)Anthropic Configlow | low | 84.1 | 87.0% | 58 | 2026-05 | |
50 | Gemma 4 26B A4BGoogle Configlow | low | 84.1 | 87.0% | 58 | 2026-04 |
1–50 of 214