ai benchmarks
Real-world AI performance metrics
Artificial Analysis data updated
UL Gauntlet updated
Each line is one model, climbing from its lowest to its highest reasoning effort: up scores higher, right costs more per task.
- Pick models in the Models list.
- Hover or tap a dot for its effort, score and cost.
- Cost runs on a log scale: each equal step right is the same multiple of price.
Every model ranked by the best score it reaches within your budget, with what that setting costs per task.
- Drag the budget to the most you’ll pay per task.
- Dots run low → max effort; rings are over budget.
- Tap the dot by a name to add it to Curves.
UL’s Gauntlet: how well each model explains hard open questions, graded 0–4 on Deutsch’s criteria, against what its answers cost to generate at Artificial Analysis’s output list price.
- Up explains better; right costs more per answer.
- A line joins only the efforts the Gauntlet ran; one effort is one dot.
- Hover or tap a dot for its grade, cost, three runs and gap to the top. The methodology has the questions, judges and statistics.
The cheapest way to reach each score. Each white step is a setting nothing cheaper matches; grey dots are beaten for less.
- Find your score on the left; read across to the line.
- The table shows what each next step up costs.
- Pick models to see what beats their settings.
How fast reaching a score is getting cheaper: each line is the lowest cost per task to reach it with what was out by each date.
- Lower is cheaper; each drop is a cheaper release.
- The right-hand label is today’s cheapest price.
- Intelligence, Coding or Agentic changes the score.
Every change Artificial Analysis made to the data, newest first.
- Click a model to see its past scores.
No models selected.
- Claude Opus 5.5 (low): grade 2.81, $0.036 per answer
- Claude Opus 5.5 (medium): grade 2.80, $0.046 per answer
- Claude Opus 5.5 (high): grade 2.86, $0.053 per answer
- Claude Opus 5.5 (xhigh): grade 2.86, $0.078 per answer
- Claude Opus 5.5 (max): grade 3.15, $1.13 per answer
- Claude Fable 5.1 (low): grade 2.91, $0.085 per answer
- Claude Fable 5.1 (medium): grade 2.98, $0.11 per answer
- Claude Fable 5.1 (high): grade 2.99, $0.12 per answer
- Claude Fable 5.1 (xhigh): grade 3.07, $0.21 per answer
- Claude Fable 5.1 (max): grade 2.95, $0.53 per answer
- Claude Sonnet 5.5 (low): grade 2.43, $0.014 per answer
- Claude Sonnet 5.5 (medium): grade 2.55, $0.015 per answer
- Claude Sonnet 5.5 (high): grade 2.70, $0.025 per answer
- Claude Sonnet 5.5 (xhigh): grade 2.77, $0.036 per answer
- Claude Sonnet 5.5 (max): grade 2.80, $0.50 per answer
- Muse Wonder (low): grade 2.73, $0.028 per answer
- Muse Wonder (medium): grade 2.78, $0.032 per answer
- Muse Wonder (high): grade 2.67, $0.035 per answer
- Grok 4.7 (default): grade 2.54, $0.013 per answer
- Gemini 4 Argon (default): grade 2.31, $0.011 per answer
- GPT-5.6 Terra (medium): grade 2.21, $0.0064 per answer
- GPT-6 Astra (low): grade 2.14, $0.038 per answer
- GPT-6 Astra (medium): grade 2.09, $0.039 per answer
- GPT-6 Astra (high): grade 2.04, $0.051 per answer
- GPT-6 Astra (xhigh): grade 1.99, $0.11 per answer
- GPT-6.1 Sol (low): grade 2.06, $0.0077 per answer
- GPT-6.1 Sol (medium): grade 2.00, $0.0088 per answer
- GPT-6.1 Sol (high): grade 1.92, $0.013 per answer
- GPT-6.1 Sol (xhigh): grade 1.95, $0.024 per answer
- GPT-6 Luna (medium): grade 1.40, $0.0002 per answer
Claude Opus 5.5 max: highest observed
Marker size is the reasoning effort: the bigger the mark, the more effort, and one effort is about the same size on every model. Hover a mark for its exact grade and cost.
- Claude Opus 5.5lowmediumhighxhighmax
- Claude Fable 5.1lowmediumhighxhighmax
- Claude Sonnet 5.5lowmediumhighxhighmax
- Muse Wonderlowmediumhigh
- Grok 4.7default
- Gemini 4 Argondefault
- GPT-5.6 Terramedium
- GPT-6 Astralowmediumhighxhigh
- GPT-6.1 Sollowmediumhighxhigh
- GPT-6 Lunamedium
Cost is what each model spent generating its answers to the Gauntlet’s questions: its answer and thinking tokens (mean per answer over 3 runs of 14 questions), priced at Artificial Analysis’s output list price as of . The question itself is a few hundred input tokens, the same for every model, and is left out, because the input we measured also includes each answering tool’s own prompt. It is not Artificial Analysis’s own cost to run its index. Grades are the Explanation grades from the Ranking, on a 0–4 scale; the grade axis is cut to the range the models fall in. Full methodology
UL’s Gauntlet lineup
No Gauntlet lineup changes are recorded yet.