AtlasBench Europe
Spatial reasoning over real European places, routes, streets and terrain. Made by @flowersslop.
Model performance
Sorted by score
0%255075100%
GPT-6.1 Sol Pro
84.67%
GPT-6 Astra
83.33%
Claude Fable 5.1
80.00%
Claude Opus 5.5
78.67%
GPT-6.1 Sol
78.00%
Grok 4.7
74.67%
Gemini 3.8 Flash
60.00%
Claude Sonnet 5.5
53.33%
GPT-6 Luna
32.67%
Claude Haiku 4.5
19.33%
GPT-4 Turbo
15.33%
GPT-3.5 Turbo
7.33%
Question explorer
Methodology
We created 100 questions grounded in verified European place, route, street and elevation data. Each model received the identical prompt through OpenRouter, using provider-default settings, with search and tools disabled, a no-outside-help instruction and a fixed JSON answer format.
We then selected 50 harder questions using pooled model performance, preserving six geographic categories and improving score separation. Existing answers were scored deterministically from 0–3 per question. Question selection and grading were refined after the initial runs, making these retrospective pilot results.