Benchmark Detail View

Calendar System

EASY Challenge43 models testedTop Score: 91.3

Success Rate

73.9%

Quality Score

Tests Passed

Models Tested

Calendar System Benchmark - Individual Model Results

Showing 43 of 43 models

	Family
1 Claude 4 Opus Claude • 08/2025 08/2025	Claude	08/2025	91.3	95.7%	52.0%
2 Gemini 2.0 Flash-001 Google • 08/2025 08/2025	Google	08/2025	88.6	91.3%	64.0%
3 OpenAI GPT-4 Turbo OpenAI • 08/2025 08/2025	OpenAI	08/2025	87.0	91.3%	48.0%
4 OpenAI GPT-4.1 OpenAI • 08/2025 08/2025	OpenAI	08/2025	85.6	91.3%	34.0%
5 Codestral 25.08 Mistral • 08/2025 08/2025	Mistral	08/2025	85.3	87.0%	70.0%
6 Gemini 2.5 Flash Google • 08/2025 08/2025	Google	08/2025	84.9	87.0%	66.0%
7 Grok 4 xAI • 08/2025 08/2025	xAI	08/2025	84.7	87.0%	64.0%
8 Claude 3.5 Haiku Claude • 08/2025 08/2025	Claude	08/2025	84.5	87.0%	62.0%
9 Gemini 2.5 Pro Google • 08/2025 08/2025	Google	08/2025	84.5	87.0%	62.0%
10 OpenAI o4-mini OpenAI • 08/2025 08/2025	OpenAI	08/2025	84.5	87.0%	62.0%
11 OpenAI GPT-4.1 nano OpenAI • 08/2025 08/2025	OpenAI	08/2025	84.5	87.0%	62.0%
12 Llama 4 Maverick Meta • 08/2025 08/2025	Meta	08/2025	83.9	87.0%	56.0%
13 OpenAI o1-mini OpenAI • 08/2025 08/2025	OpenAI	08/2025	83.7	87.0%	54.0%
14 OpenAI GPT-4 OpenAI • 08/2025 08/2025	OpenAI	08/2025	81.5	82.6%	72.0%
15 OpenAI o4-mini (High) OpenAI • 08/2025 08/2025	OpenAI	08/2025	80.8	82.6%	64.0%
16 OpenAI GPT-4.1 mini OpenAI • 08/2025 08/2025	OpenAI	08/2025	80.5	82.6%	62.0%
17 Coder Large Other • 08/2025 08/2025	Other	08/2025	80.3	82.6%	60.0%
18 Claude 3.5 Sonnet Claude • 08/2025 08/2025	Claude	08/2025	80.3	82.6%	60.0%
19 OpenAI o3-mini OpenAI • 08/2025 08/2025	OpenAI	08/2025	80.2	82.6%	58.0%
20 Claude 4 Sonnet Claude • 08/2025 08/2025	Claude	08/2025	79.5	82.6%	52.0%
21 OpenAI o3-mini (High) OpenAI • 08/2025 08/2025	OpenAI	08/2025	79.3	82.6%	50.0%
22 Claude 3.7 Sonnet (Thinking) Claude • 08/2025 08/2025	Claude	08/2025	78.8	82.6%	44.0%
23 Gemini 2.5 Flash Lite Google • 08/2025 08/2025	Google	08/2025	78.0	78.3%	76.0%
24 OpenAI GPT-4o OpenAI • 08/2025 08/2025	OpenAI	08/2025	78.0	78.3%	76.0%
25 OpenAI GPT-4o OpenAI • 08/2025 08/2025	OpenAI	08/2025	78.0	82.6%	36.0%
26 Horizon Beta Other • 08/2025 08/2025	Other	08/2025	76.6	78.3%	62.0%
27 Grok 3 Mini xAI • 08/2025 08/2025	xAI	08/2025	75.8	78.3%	54.0%
28 Nova Pro V1 Amazon • 08/2025 08/2025	Amazon	08/2025	73.7	73.9%	72.0%
29 Llama 4 Scout Meta • 08/2025 08/2025	Meta	08/2025	73.5	73.9%	70.0%
30 OpenAI GPT-4o mini OpenAI • 08/2025 08/2025	OpenAI	08/2025	73.3	73.9%	68.0%
31 DeepSeek V3 DeepSeek • 08/2025 08/2025	DeepSeek	08/2025	73.1	73.9%	66.0%
32 R1 DeepSeek • 08/2025 08/2025	DeepSeek	08/2025	72.1	73.9%	56.0%
33 Grok 3 xAI • 08/2025 08/2025	xAI	08/2025	65.1	65.2%	64.0%
34 Kimi K2 Moonshot • 08/2025 08/2025	Moonshot	08/2025	64.9	65.2%	62.0%
35 Claude 3.7 Sonnet Claude • 08/2025 08/2025	Claude	08/2025	63.5	65.2%	48.0%
36 Nova Lite V1 Amazon • 08/2025 08/2025	Amazon	08/2025	63.2	60.9%	84.0%
37 Mistral Medium 3 Mistral • 08/2025 08/2025	Mistral	08/2025	61.4	60.9%	66.0%
38 OpenAI GPT-3.5 Turbo OpenAI • 08/2025 08/2025	OpenAI	08/2025	59.7	56.5%	88.0%
39 Qwen 3 Coder Alibaba • 08/2025 08/2025	Alibaba	08/2025	59.2	60.9%	44.0%
40 Claude 3 Haiku Claude • 08/2025 08/2025	Claude	08/2025	56.0	52.2%	90.0%
41 Nova Micro V1 Amazon • 08/2025 08/2025	Amazon	08/2025	22.6	17.4%	70.0%
42 Gemma 3 4B IT Google • 08/2025 08/2025	Google	08/2025	15.7	13.0%	40.0%
43 Command A Cohere • 08/2025 08/2025	Cohere	08/2025	7.2	0.0%	72.0%

Top Performers

Calendar Challenge Champions

Claude

91.3

Claude 4 Opus

Success Rate

95.7%

Tests Passed

Quality

Issues

23 total tests

Google

88.6

Gemini 2.0 Flash-001

Success Rate

91.3%

Tests Passed

Quality

Issues

23 total tests

OpenAI

87.0

OpenAI GPT-4 Turbo

Success Rate

91.3%

Tests Passed

Quality

Issues

23 total tests

Explore More Benchmarks

See how models perform across different programming challenges and complexity levels.