The benchmark board

Every score from our Model Drops from the last 90 days on one board, since Aug 11, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

86benchmarks

40models scored

645scores logged

27Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

Closed weights only

DeepSWE v1.1

Best score rose 5 points, from 74% (Claude Opus 5) to 79% (Muse Wonder Full).

Closed weights only

Terminal-Bench 4.0

Best score rose 18.8 points, from 51.8% (Claude Opus 5) to 70.6% (Claude Sonnet 5.5).

Closed weights only

Artificial Analysis Intelligence Index

Best score rose 7.2, from 50.8 (Claude Opus 5) to 58 (Claude Opus 5.5).

Closed weights only

GDPval-AA

Best score rose 123 Elo, from 1743 Elo (Claude Fable 5) to 1866 Elo (Claude Opus 5.5).

Closed weights only

GPQA Diamond

Best score rose 3.3 points, from 92.8% (GPT-5.4) to 96.1% (GPT-6 Astra).

Closed weights only

OSWorld 2

Best score rose 13.3 points, from 70.6% (Claude Opus 5) to 83.9% (Claude Sonnet 5.5).

Closed weights only

Harvey Legal Agent Benchmark

Best score rose 3.8 points, from 15.8% (Grok 4.6) to 19.6% (Grok 4.7).

Closed weights only

Terminal-Bench Science

Best score rose 39.1 points, from 29% (Claude Opus 5) to 68.1% (GPT-6 Astra).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

Claude Sonnet 5Claude Sonnet 5.5

Terminal-Bench 4.0: 10.3% to 70.6%

+60.3

Claude Haiku 4.5Claude Haiku 5.5

OSWorld 2 (offline subset): 15.7% to 72.4%

+56.7

GPT-5.6 TerraGPT-6.1 Terra

AA-Omniscience hallucination rate: 88% to 38%

+50

Muse Spark 1.2Muse Spark 1.3

MRCR 512K-1M: 55.5% to 98.1%

+42.6

Claude Opus 5Claude Opus 5.5

Terminal-Bench Science: 29% to 58.7%

+29.7

GPT-6 SolGPT-6.1 Sol

Terminal-Bench Science: 27.6% to 57%

+29.4

Fable 5Fable 5.1

Terminal-Bench Science: 24.7% to 52.6%

+27.9

Gemini 3.6 FlashGemini 3.7 Flash

ARC-AGI-2: 60.4% to 84.6%

+24.2

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Closed weights only

DeepSWE v1.1

Fixing issues in real repositories.

Muse Wonder Fullmax 79%

Muse Wondermax 78.8%

Gemini 4 Argonmax 77.9%

Muse Spark 1.3max 75.4%

GPT-6.1 Solhigh 75.2%

Claude Opus 5.5max 74.2%

20 more

GPT-6 Astramax 74.1%

Claude Opus 5 74%

Gemini 3.8 Flash 73.8%

GPT-5.6 Sol 73%

Particle-1max 72.6%

Grok 4.7high 71%

Fable 5xhigh 69.9%

Claude Fable 5 69.7%

GPT-5.6 Terramax 69.6%

GPT-6 Solmax 68.8%

Fable 5.1max 67.4%

GPT-6 Lunamax 66.6%

Gemini 3.7 Flashhigh 65.3%

Grok 4.6high 65.2%

Muse Spark 1.2xhigh 55%

Grok 4.5high 54%

Claude Sonnet 5max 53.8%

Gemini 3.6 Flash 48.6%

Fern 0.1 44.2%

Muse Glimmer-30Bmax 4.4%

26 models · 20 drops · Muse Wonder, Gemini 4 Argon, GPT-6 Astra, GPT-6.1 Sol, Kimi K3.1 Pro, MiniMax M3.1 Flash, Particle, "Introducing Particle-1", Grok 4.7, GPT-6 Sol & GPT-6 Luna, GLM-5.3, Gemini 3.8 Flash, Muse Spark 1.3, Grok 4.6, Gemini 3.7 Flash, Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Closed weights only

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Claude Sonnet 5.5max 70.6%

Claude Opus 5.5max 66.4%

Mythos 5.1 60.9%

GPT-6 Astramax 58.2%

Fable 5.1max 57.9%

Gemini 4 Argonmax 57.4%

16 more

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 55.9%

Muse Wondermax 52%

Claude Opus 5 51.8%

GPT-6.1 Terramax 50.3%

GPT-5.6 Sol 39.9%

Claude Haiku 5.5max 39.2%

Grok 4.7xhigh 37.6%

GPT-5.6 Terramax 21.5%

Grok 4.6high 20.3%

Gemini 3.8 Flashmax 19.1%

GPT-6 Luna 16.4%

Claude Sonnet 5 10.3%

Fern 0.1 6.1%

Muse Glimmer-30Bmax 1.6%

Claude Haiku 4.5 0%

22 models · 19 drops · GPT-6.1 Terra, Kimi K3.1 Pro, GPT-6 Astra, Gemini 4 Argon, Muse Wonder, MiniMax M3.1 Flash, Claude Haiku 5.5, Grok 4.7, Gemini 3.8 Flash, Claude Sonnet 5.5, Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Closed weights only

AutomationBench

Real business automations (Zapier).

Gemini 4 Argonmax 51.3%

Claude Opus 5 50.3%

Muse Spark 1.3max 49.6%

Claude Fable 5 46.2%

GPT-5.6 Sol 45.8%

Claude Sonnet 5.5max 44.7%

11 more

Claude Opus 5.5 42.5%

GPT-6 Astramax 41.4%

GPT-6.1 Solmax 36.1%

GPT-6 Sol 33.2%

Fable 5.1max 31.4%

Gemini 3.7 Flashhigh 30.4%

GPT-5.6 Terra 23.6%

GPT-6 Lunamax 20.7%

Gemini 3.6 Flash 17%

Muse Glimmer-30Bmax 15.2%

Claude Sonnet 5 10.7%

17 models · 16 drops · Gemini 4 Argon, MiniMax M3.1 Flash, Muse Spark 1.3, GLM-5.3, Claude Sonnet 5.5, GPT-6.1 Sol, Gemini 3.7 Flash, GPT-6 Sol & GPT-6 Luna, Nanbeige4.3-33B model card

Closed weights only

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

Grok 4.6 87

Gemini 4 Carbon 85.8

Claude Opus 5.5 85.2

GPT-6.1 Sol 80.9

Gemini 3.7 Flash 77.6

GPT-6 Astra 73.8

11 more

Muse Spark 1.3 73.2

Claude Haiku 5.5 71.4

Fable 5.1 69.9

GPT-6.1 Terra 69.2

GPT-6 Luna 69

Claude Sonnet 5.5 65.4

Gemini 3.8 Flash 65.3

Gemini 4 Argon 61.6

GPT-6 Sol 55.4

Muse Wonder 37

Grok 4.7 33.4

17 models · 16 drops · Every model's sources, quotes and method

Closed weights only

Artificial Analysis Intelligence Index

25 models compared.

Claude Opus 5.5 58

Claude Sonnet 5.5max 56

Muse Wonder Fullmax 55.8

GPT-6 Astra 53

Fable 5.1 53

Gemini 4 Argonhigh 53

19 more

Muse Wondermax 52.4

GPT-6.1 Solmax 52

Claude Opus 5 50.8

Claude Fable 5 49.6

Muse Spark 1.3 48.1

GPT-6.1 Terramax 48

GPT-5.6 Sol 47

Grok 4.7 46

Grok 4.6 44

Claude Haiku 5.5max 43

GPT-5.6 Terramax 42

Gemini 3.8 Flash 40.9

Qwen3.8-Max 40.2

Muse Spark 1.2xhigh 39.6

Gemini 3.7 Flash 39.1

Grok 4.5 38.8

Claude Sonnet 5max 38.2

GPT-6 Lunamax 38

Muse Glimmer-30B 17.5

25 models · 15 drops · Kimi K3.1 Pro, GPT-6.1 Terra, Muse Wonder, DeepSeek V4.1 Flash 1017, Grok 4.6, Muse Spark 1.3, Grok 4.7, Gemini 3.8 Flash, GLM-5.3, Gemini 3.7 Flash, Qwen3.8

Closed weights only

GDPval-AA

Professional work products, graded head to head (Elo).

Claude Opus 5.5max 1866 Elo

Muse Wonder Fullmax 1857 Elo

Claude Sonnet 5.5 1838 Elo

Muse Wondermax 1770 Elo

Fable 5.1max 1754 Elo

Muse Spark 1.3max 1754 Elo

17 more

Claude Fable 5 1743 Elo

Claude Opus 5 1708 Elo

Grok 4.7xhigh 1695 Elo

Claude Haiku 5.5max 1620 Elo

Muse Spark 1.2xhigh 1615 Elo

Grok 4.6high 1605 Elo

GPT-5.6 Sol 1588 Elo

GPT-6 Astramax 1573 Elo

Gemini 3.8 Flashmax 1545 Elo

GPT-5.6 Terramax 1528 Elo

Grok 4.5high 1526 Elo

Gemini 3.7 Flashhigh 1525 Elo

GPT-6 Sol 1487 Elo

Claude Sonnet 5 1449 Elo

GPT-6 Luna 1437 Elo

Gemini 3.6 Flash 1422 Elo

Claude Haiku 4.5 735 Elo

23 models · 14 drops · Kimi K3.1 Pro, Muse Wonder, Muse Spark 1.3, GLM-5.3, Claude Opus 5.5, Grok 4.7, Claude Haiku 5.5, MiMo-V2.6-Pro, Gemini 3.8 Flash, Grok 4.6, Gemini 3.7 Flash, Claude Sonnet 5.5

Closed weights only

Terminal-Bench 2.1

12 models compared.

Gemini 3.8 Flashmax 89.4%

Claude Opus 5 89.1%

GPT-5.6 Solmax 88.8%

Muse Spark 1.3max 88.8%

GPT-5.6 Terramax 87.4%

Gemini 3.7 Flashhigh 85.8%

6 more

Muse Spark 1.2xhigh 82.9%

Claude Sonnet 5max 80.4%

Particle-1max 79.9%

Claude Opus 4.6max 78.2%

Gemini 3.6 Flash 78%

Muse Glimmer-30Bmax 51.7%

12 models · 13 drops · Gemini 3.8 Flash, MiMo-V2.6-Pro, Muse Spark 1.3, Gemini 3.7 Flash, Particle, "Introducing Particle-1", Qwen3.8

Closed weights only

GPQA Diamond

9 models compared.

GPT-6 Astramax 96.1%

Claude Opus 5.5max 93.9%

Fable 5.1max 93.7%

GPT-5.4 92.8%

Claude Opus 4.6max 91.3%

Particle-1 90.4%

3 more

Claude Sonnet 4.6max 89.9%

MAI-Thinking-1 84.2%

Muse Glimmer-30Bmax 83.5%

9 models · 10 drops · Kimi K3.1 Pro, MAI-Thinking-1, Qwen3.8, Particle, "Introducing Particle-1"

Closed weights only

OSWorld 2

Using a computer: apps, files and the web.

Claude Sonnet 5.5max 83.9%

Claude Opus 5.5 81.8%

GPT-6.1 Solmax 78%

GPT-6.1 Terramax 74.2%

GPT-6 Astra 72.6%

Claude Opus 5 70.6%

6 more

Muse Spark 1.3max 66.9%

GPT-5.6 Sol 65.7%

Gemini 3.8 Flashmax 59%

GPT-5.6 Terramax 57.1%

Claude Sonnet 5 57%

GPT-6 Lunamax 55.5%

12 models · 8 drops · GPT-6.1 Terra, Claude Sonnet 5.5, GPT-6 Astra, MiniMax M3.1 Flash, Muse Spark 1.3, Gemini 3.8 Flash

Closed weights only

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Claude Opus 5.5 64.4%

Fable 5 57.8%

Fable 5.1max 57.6%

Claude Sonnet 5.5 56.9%

Claude Opus 5 56.3%

GPT-6 Astramax 53.6%

4 more

Claude Haiku 5.5max 45.9%

Claude Opus 4.8max 45.7%

GPT-5.6 Sol 44.5%

Claude Haiku 4.5 10.2%

10 models · 8 drops · Claude Opus 5.5, Fable 5.1, Kimi K3.1 Pro, Claude Haiku 5.5, DeepSeek V4.1 Flash 1017, Qwen3.8

Closed weights only

Harvey Legal Agent Benchmark

Legal work end to end.

Grok 4.7xhigh 19.6%

Gemini 4 Argonmax 19.6%

Fable 5.1max 19.1%

Grok 4.6high 15.8%

Muse Wonder Fullmax 13.1%

Grok 4.5high 12.9%

10 more

Claude Fable 5max 11.3%

Qwen3.8 Max 10.4%

Gemini 3.8 Flashmax 10%

Muse Wondermax 10%

GPT-6 Astramax 8.6%

Claude Opus 5max 6.7%

Claude Sonnet 5max 5%

Claude Opus 5.5max 4.2%

GPT-5.6 Solmax 2.5%

GPT-5.6 Terramax 0.8%

16 models · 7 drops · Grok 4.7, Gemini 4 Argon, Kimi K3.1 Pro, Muse Wonder, Grok 4.6, Mistral Large 4, Gemini 3.8 Flash

Closed weights only

Terminal-Bench Science

Scientific computing tasks in a terminal.

GPT-6 Astramax 68.1%

Claude Opus 5.5max 63.3%

GPT-6.1 Terramax 58.3%

GPT-6.1 Solmax 57%

Fable 5.1max 40%

Claude Opus 5 29%

3 more

GPT-6 Sol 27.6%

Fable 5 24.7%

GPT-5.6 Sol 22.4%

9 models · 6 drops · GPT-6.1 Terra, Kimi K3.1 Pro, Claude Opus 5.5, GPT-6.1 Sol, Fable 5.1

Closed weights only

SWE-bench Verified

5 models compared.

GPT-6 Astra 86%

Claude Opus 4.6 80.8%

Claude Sonnet 4.6max 79.6%

MAI-Thinking-1 73.5%

Fern 0.1 73.4%

5 models · 6 drops · Mirendil, "Introducing Fern", MAI-Thinking-1

Closed weights only

ProgramBench

7 models compared.

Claude Opus 5.5max 65%

Muse Wonder Fullmax 59%

Fable 5.1max 53.5%

Muse Wondermax 50%

GPT-6 Astramax 50%

Claude Opus 5 37%

1 more

GPT-5.6 Sol 23%

7 models · 5 drops · Kimi K3.1 Pro, Muse Wonder, DeepSeek V4.1 Flash 1017

Closed weights only

AA-LCR

15 models compared.

Fable 5.1max 85.3%

Claude Opus 5.5max 84.7%

Muse Wonder Fullmax 83.7%

Muse Glimmer-30Bmax 83.3%

GPT-6 Lunamax 83.3%

GPT-6.1 Solmax 83%

9 more

GPT-6.1 Terramax 82.7%

Claude Sonnet 5.5max 82.7%

Claude Haiku 5.5max 82.7%

Gemini 3.8 Flashhigh 81.3%

Muse Wondermax 80.7%

GPT-6 Astramax 80.7%

Gemini 4 Argonhigh 79.7%

Gemini 4 Carbonhigh 79.3%

Grok 4.7xhigh 76.7%

15 models · 4 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card

Closed weights only

OSWorld 2 (offline subset)

Using a computer, on the 82 OSWorld 2.1 tasks that need no internet.

Claude Opus 5.5max 87.2%

Claude Sonnet 5.5 83.9%

Gemini 4 Carbonmax 81.5%

GPT-6 Astramax 80.9%

Fable 5.1max 76.8%

Gemini 4 Argonmax 74.7%

7 more

Claude Haiku 5.5max 72.4%

GPT-6.1 Solmax 71.4%

Claude Opus 5max 70.2%

GPT-5.6 Sol 65.7%

GPT-6 Solmax 64.4%

GPT-6 Luna 48.9%

Claude Haiku 4.5 15.7%

13 models · 4 drops · Gemini 4 Carbon, Claude Haiku 5.5, GPT-6.1 Sol, GPT-6 Sol & GPT-6 Luna

Closed weights only

SWE-bench Pro

7 models compared.

Fable 5max 80%

Claude Opus 4.8max 69.2%

GPT-5.6 Solmax 64.6%

GPT-5.4 57.7%

Claude Opus 4.6max 53.4%

MAI-Thinking-1 52.8%

1 more

Muse Glimmer-30Bmax 51.2%

7 models · 4 drops · Qwen3.8, MAI-Thinking-1

Closed weights only

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Claude Opus 5.5 67.7%

Fable 5.1max 65.6%

GPT-5.6 Sol 64.5%

Claude Fable 5 63.9%

Claude Opus 5 63.6%

GPT-6 Astramax 57.2%

6 models · 4 drops · Claude Opus 5.5, Kimi K3.1 Pro, GLM-5.3

Closed weights only

Agents' Last Exam

4 models compared.

Claude Opus 5.5max 42.6%

GPT-6 Astramax 32.8%

Claude Opus 5 32.2%

GPT-5.6 Sol 30.6%

4 models · 4 drops · Kimi K3.1 Pro, MiniMax M3.1 Flash

Closed weights only

JobBench

3 models compared.

Claude Opus 5max 65.7%

Muse Spark 1.3max 64.9%

GPT-5.6 Solmax 45.4%

3 models · 4 drops · MiMo-V2.6-Pro, Muse Spark 1.3

Closed weights only

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Gemini 4 Carbonhigh 65.2%

Claude Sonnet 5.5max 63.6%

Claude Opus 5.5max 59.6%

GPT-6 Astramax 59.1%

Gemini 4 Argonhigh 57.1%

Muse Wonder Fullmax 57.1%

8 more

GPT-6.1 Solmax 56.1%

GPT-6.1 Terramax 55.6%

Fable 5.1max 52%

Muse Wondermax 52%

Claude Haiku 5.5max 32.8%

Grok 4.7xhigh 25.8%

Gemini 3.8 Flashhigh 19.7%

GPT-6 Lunamax 12.6%

14 models · 3 drops · Artificial Analysis (2026-11-04)

Closed weights only

AA-Omniscience hallucination rate

Lower is better.

Muse Wonder Fullmax 23%

Muse Wondermax 26.5%

Grok 4.7 29%

Grok 4.6 34%

GPT-6.1 Terra 38%

Claude Sonnet 5.5 47%

4 more

GPT-6 Astra 51.3%

Claude Opus 5.5 58.6%

Fable 5.1 72.6%

GPT-5.6 Terra 88%

10 models · 3 drops · Muse Wonder, Grok 4.7, GPT-6.1 Terra

Closed weights only

GDP.pdf

Work products built from PDFs (Surge AI).

GPT-6 Astramax 34.2%

Gemini 3.7 Flashhigh 34%

GPT-6.1 Solhigh 32%

Claude Opus 5.5max 30.6%

Claude Sonnet 5 28%

GPT-6 Sol 28%

4 more

Fable 5.1max 27.6%

GPT-5.6 Terra 24.7%

Gemini 3.6 Flash 22%

Muse Spark 1.2 16%

10 models · 3 drops · Kimi K3.1 Pro, Gemini 3.7 Flash, GPT-6.1 Sol

Closed weights only

ARC-AGI-2

9 models compared.

GPT-5.6 Sol 92.5%

Claude Opus 5 90.4%

Claude Fable 5 89.2%

Gemini 3.8 Flash 89.2%

Gemini 3.7 Flash 84.6%

GPT-5.6 Terramax 83.9%

3 more

Grok 4.6 65.1%

Gemini 3.6 Flashhigh 60.4%

Grok 4.5 52.6%

9 models · 3 drops · Grok 4.6, Gemini 3.8 Flash, Gemini 3.7 Flash

Closed weights only

FrontierCode v1.1

Hard, long coding tasks.

Claude Opus 5.5 54.4%

GPT-6 Astra 53.3%

Claude Sonnet 5.5xhigh 52.1%

Fable 5.1 50.3%

GPT-6 Sol 49.3%

Claude Opus 5 48%

3 more

Claude Haiku 5.5max 46.4%

Claude Sonnet 5 42.4%

GPT-6 Luna 42.4%

9 models · 3 drops · Claude Sonnet 5.5, Claude Opus 5.5, Claude Haiku 5.5

Closed weights only

Terminal-Bench 3.0

9 models compared.

Claude Opus 5 43.5%

GPT-5.6 Solmax 34.6%

Claude Fable 5 33.7%

Grok 4.6high 26%

GPT-5.6 Terra 20.8%

Grok 4.5high 15.7%

3 more

Gemini 3.7 Flashhigh 14.9%

Claude Sonnet 5 14.6%

Gemini 3.6 Flash 5.4%

9 models · 3 drops · Grok 4.6, GLM-5.3, Gemini 3.7 Flash

Closed weights only

BabyVision (with tools)

6 models compared.

Claude Opus 5.5max 97.7%

GPT-6 Astramax 96.6%

Fable 5.1max 95.1%

Claude Opus 5 94.1%

Particle-1 89.2%

GPT-5.6 Sol 88.9%

6 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Particle, "Introducing Particle-1"

Closed weights only

ZeroBench (with tools)

5 models compared.

Claude Opus 5.5max 61%

Fable 5.1max 59%

GPT-6 Astramax 58%

GPT-5.6 Sol 53%

Claude Opus 5 52%

5 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Closed weights only

NL2Repo

3 models compared.

Claude Opus 5 75.3%

GPT-5.6 Sol 56.8%

Muse Glimmer-30Bmax 27.4%

3 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

Closed weights only

BrowseComp

2 models compared.

GPT-6 Astramax 91.5%

Claude Opus 5.5max 90.8%

2 models · 3 drops · Kimi K3.1 Pro

Closed weights only

AA-Briefcase v1.1

16 models compared.

Claude Sonnet 5.5max 1813 Elo

Claude Opus 5.5max 1800 Elo

Muse Wonder Fullmax 1729 Elo

Fable 5.1max 1669 Elo

Muse Wondermax 1659 Elo

Grok 4.7xhigh 1637 Elo

10 more

Gemini 4 Carbonhigh 1610 Elo

Claude Haiku 5.5max 1574 Elo

GPT-6 Astramax 1569 Elo

GPT-6.1 Solmax 1555 Elo

Grok 4.6high 1546 Elo

GPT-5.6 Solmax 1487 Elo

Gemini 4 Argonhigh 1484 Elo

GPT-6.1 Terramax 1401 Elo

GPT-6 Lunamax 1337 Elo

Gemini 3.8 Flashhigh 1203 Elo

16 models · 2 drops · Artificial Analysis (2026-11-04), Grok 4.7

Closed weights only

AutomationBench-AA

Business automations, run by Artificial Analysis.

Gemini 4 Carbonhigh 77.8%

Gemini 4 Argonhigh 77.5%

Claude Sonnet 5.5max 71.8%

Muse Wonder Fullmax 71.3%

Claude Opus 5.5max 69.5%

GPT-6 Astramax 68.5%

8 more

Muse Wondermax 68.1%

Grok 4.7xhigh 65.6%

GPT-6.1 Solmax 64.9%

GPT-6.1 Terramax 60.2%

Gemini 3.8 Flashhigh 59.9%

Fable 5.1max 59.4%

GPT-6 Lunamax 53.2%

Claude Haiku 5.5max 35.4%

14 models · 2 drops · Artificial Analysis (2026-11-04)

Closed weights only

Agents' Last Exam v1

9 models compared.

Claude Opus 5.5max 63.2%

GPT-6.1 Terramax 60%

GPT-6 Astramax 59.3%

GPT-6.1 Solmax 58.6%

GPT-6 Solmax 56.4%

GPT-5.6 Solmax 52.8%

3 more

Claude Opus 5max 52.7%

GPT-6 Lunamax 50.9%

GPT-5.6 Terramax 50.7%

9 models · 2 drops · GPT-6.1 Terra, GPT-6 Sol & GPT-6 Luna

Closed weights only

APEX-Agents

8 models compared.

Claude Opus 5.5max 73.5%

Fable 5.1max 68.6%

GPT-6 Astramax 64.7%

Claude Opus 5 60.6%

Claude Fable 5max 59.2%

Grok 4.6high 57.5%

2 more

GPT-5.6 Solmax 56.7%

Grok 4.5high 47.1%

8 models · 2 drops · Kimi K3.1 Pro, Grok 4.6

Closed weights only

HLE-Verified

7 models compared.

Gemini 3.8 Flashmax 54.9%

GPT-5.6 Solmax 54.5%

Claude Opus 5max 54.4%

Gemini 3.7 Flashhigh 53.6%

Gemini 3.6 Flash 51.2%

GPT-5.6 Terramax 51.1%

1 more

Claude Sonnet 5max 31%

7 models · 2 drops · Gemini 3.8 Flash, Gemini 3.7 Flash

Closed weights only

CursorBench 4.0

Long coding tasks inside Cursor.

Claude Opus 5.5 57.8%

Fable 5.1max 51.8%

Claude Opus 5 46.6%

Grok 4.7xhigh 46.3%

GPT-5.6 Solmax 41.7%

Grok 4.6high 40.4%

6 models · 2 drops · Claude Opus 5.5, Grok 4.7

Closed weights only

AA-Briefcase

5 models compared.

Claude Opus 5 1715 Elo

Grok 4.6high 1577 Elo

Claude Fable 5max 1574 Elo

GPT-5.6 Solmax 1502 Elo

Grok 4.5high 1313 Elo

5 models · 2 drops · Grok 4.6

Closed weights only

Artificial Analysis Coding Agent Index

5 models compared.

Claude Opus 5.5 62

Gemini 4 Carbon 59

Grok 4.7 56

Gemini 4 Argon 53

Grok 4.6 47

5 models · 2 drops · Gemini 4 Carbon, Grok 4.7

Closed weights only

Chartography (with tools)

5 models compared.

GPT-6 Astramax 91%

Claude Opus 5.5max 89%

Fable 5.1max 88.4%

Claude Opus 5 84%

GPT-5.6 Sol 79.9%

5 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Closed weights only

ExploitBench

5 models compared.

GPT-6 Astramax 100%

Claude Opus 5.5max 91%

Fable 5.1max 83%

Claude Mythos 5 78%

GPT-5.6 Sol 76.5%

5 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

Closed weights only

FrontierSWE v2

Frontier software engineering tasks.

GPT-6 Astramax 65.5%

Claude Opus 5.5max 62.3%

Gemini 4 Carbonmax 61.2%

Fable 5.1max 56.3%

Gemini 4 Argonmax 55%

5 models · 2 drops · Gemini 4 Carbon

Closed weights only

SWE-Marathon

5 models compared.

Muse Wonder Fullxhigh 57.5%

Muse Wondermax 53.1%

Claude Opus 5.5max 46.3%

Fable 5.1max 45.6%

GPT-6 Astramax 42.5%

5 models · 2 drops · Muse Wonder, Kimi K3.1 Pro

Closed weights only

Agents' Last Exam (CLI)

4 models compared.

Claude Opus 5.5max 40.7%

GPT-6 Astramax 38.8%

GPT-5.6 Sol 28.6%

Claude Fable 5 23.8%

4 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

Closed weights only

CharXiv Reasoning

4 models compared.

GPT-5.6 Terra 85.9%

Gemini 3.6 Flash 85.2%

Gemini 3.7 Flashhigh 84.5%

Claude Sonnet 5 77%

4 models · 2 drops · Gemini 3.7 Flash

Closed weights only

OSWorld-Verified

Using a computer: apps, files and the web (2025 edition).

Claude Opus 5 83.4%

GPT-5.6 Sol 83%

Claude Opus 4.6max 72.7%

Muse Glimmer-30Bmax 65.9%

4 models · 2 drops · MiMo-V2.6-Pro, Qwen3.8

Closed weights only

Vals Index

4 models compared.

Gemini 4 Argonmax 68.9%

Claude Opus 5.5 67%

Fable 5.1 65.8%

GPT-6 Astra 63.1%

4 models · 2 drops · Gemini 4 Argon

Closed weights only

Toolathlon-Verified

3 models compared.

Claude Opus 5 80.6%

GPT-5.6 Sol 74.9%

Muse Glimmer-30Bmax 47.2%

3 models · 2 drops · MiMo-V2.6-Pro, Nanbeige4.3-33B model card

Closed weights only

CyberGym

2 models compared.

Claude Mythos 5 83.8%

GPT-5.6 Sol 83.6%

2 models · 2 drops · GLM-5.3, MiniMax M3.1 Flash

Closed weights only

MMLU-Pro

2 models compared.

Claude Sonnet 4.6max 87%

MAI-Thinking-1 85%

2 models · 2 drops · MAI-Thinking-1

Closed weights only

SWE-Atlas-QnA

2 models compared.

Fern 0.1 53.2%

Muse Glimmer-30Bmax 17.7%

2 models · 2 drops · Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

From a single launch

Closed weights only

Epoch Capabilities Index

18 models compared.

GPT-6 Astra 169.1

Claude Opus 5.5 168.4

GPT-6.1 Terra 168.1

GPT-6.1 Sol 167.8

Claude Sonnet 5.5 166.7

Fable 5.1 166.4

12 more

Gemini 4 Argon 166.1

GPT-6 Sol 163.8

Claude Opus 5 163

GPT-5.6 Sol 162

Muse Wonder 161.7

Claude Haiku 5.5 160.4

Gemini 3.7 Flash 158.2

Gemini 3.8 Flash 157.6

Muse Spark 1.3 157.4

Grok 4.6 156.9

GPT-6 Luna 156.8

Grok 4.7 154.6

18 models · 1 drop · Epoch Capabilities Index (2026-11-04), Muse Spark 1.3

Closed weights only

Artificial Analysis Intelligence Index v5.0

14 models compared.

Gemini 4 Carbonhigh 60

Claude Opus 5.5max 59.1

GPT-6 Astramax 56.9

GPT-6.1 Solmax 54.6

Claude Sonnet 5.5max 54.5

GPT-6.1 Terramax 51.3

8 more

Gemini 4 Argonhigh 50.4

Muse Wonder Fullmax 50.1

Fable 5.1max 49.2

Muse Wondermax 43.6

Claude Haiku 5.5max 36.5

Grok 4.7xhigh 35.5

Gemini 3.8 Flashhigh 30.8

GPT-6 Lunamax 27.9

14 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Claude Opus 5.5max 46.4%

GPT-6 Astramax 42.4%

GPT-6.1 Terramax 42.3%

Claude Sonnet 5.5max 41.7%

Gemini 4 Carbonhigh 40.6%

GPT-6.1 Solmax 40.6%

8 more

Muse Wonder Fullmax 37.8%

Claude Haiku 5.5max 34.9%

Fable 5.1max 31.6%

Grok 4.7xhigh 28.7%

Muse Wondermax 27.9%

Gemini 4 Argonhigh 25.7%

GPT-6 Lunamax 25.2%

Gemini 3.8 Flashhigh 18.7%

14 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

Vals Index v2.2

13 models compared.

Claude Sonnet 5.5 70.9%

Gemini 4 Carbon 70.5%

Claude Opus 5.5 70.2%

Gemini 4 Argon 69.2%

Muse Wonder Full 66.8%

GPT-6 Astra 65%

7 more

Muse Wonder 64.9%

GPT-6.1 Sol 63.9%

GPT-6.1 Terra 60.5%

Claude Haiku 5.5 58.7%

Grok 4.7 58.6%

Gemini 3.8 Flash 56%

GPT-6 Luna 52.3%

13 models · 1 drop · Vals Index v2.2 (2026-11-04)

Closed weights only

Artificial Analysis Cyber Index

6 models compared.

Grok 4.7xhigh 56.4

GPT-6 Lunamax 52.7

GPT-6 Astramax 33.4

Claude Opus 5.5max 28.7

Gemini 3.8 Flashhigh 25.1

Fable 5.1max 25

6 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

Artificial Analysis Coding Agent Index v2.0

5 models compared.

Claude Opus 5.5max 62

Claude Sonnet 5.5max 59

GPT-6.1 Solmax 54

GPT-6.1 Terramax 48

GPT-6 Lunamax 31

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

Factual error rate

Lower is better.

GPT-6 Astramax 4.2%

GPT-6.1 Terramax 4.3%

GPT-6.1 Solmax 4.4%

GPT-6 Lunamax 18.4%

GPT-5.6 Terramax 22.3%

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

MemoryBench

5 models compared.

Muse Wondermax 85.6%

Muse Wonder Fullmax 85.5%

Claude Opus 5.5max 81.5%

GPT-6 Astramax 81.4%

Fable 5.1max 79%

5 models · 1 drop · Muse Wonder

Closed weights only

MMMU-Pro Vision

5 models compared.

GPT-6 Astramax 86.7%

GPT-6.1 Solmax 86.3%

GPT-6.1 Terramax 85.5%

GPT-5.6 Terramax 81.7%

GPT-6 Lunamax 79.9%

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

Personal Superintelligence Index

5 models compared.

Muse Wonder Fullmax 59.1

Claude Opus 5.5max 55.2

GPT-6 Astramax 54.5

Muse Wondermax 54.3

Fable 5.1max 49.9

5 models · 1 drop · Muse Wonder

Closed weights only

SWE-sweep

5 models compared.

Gemini 4 Carbonmax 9.6%

GPT-6 Astramax 9.5%

Gemini 4 Argonmax 4.3%

Claude Opus 5.5max 3.6%

Fable 5.1max 2.9%

5 models · 1 drop · Gemini 4 Carbon

Closed weights only

Vals Finance Agent v2

5 models compared.

Gemini 3.8 Flashmax 61.4%

Claude Opus 5max 58.6%

GPT-5.6 Terramax 54.4%

Claude Sonnet 5max 53.9%

GPT-5.6 Solmax 53.8%

5 models · 1 drop · Gemini 3.8 Flash

Closed weights only

Agents' Last Exam v1.1

4 models compared.

Gemini 4 Carbonmax 77.4%

GPT-6 Astramax 73.1%

Claude Opus 5.5max 71.6%

Gemini 4 Argonmax 69%

4 models · 1 drop · Gemini 4 Carbon

Closed weights only

Chartography

4 models compared.

Claude Sonnet 5.5 61.6%

Claude Haiku 5.5max 46.4%

GPT-6 Luna 29.1%

Claude Haiku 4.5 6.4%

4 models · 1 drop · Claude Haiku 5.5

Closed weights only

CursorBench 3.2

4 models compared.

Claude Fable 5max 70.5%

Grok 4.6high 69.9%

GPT-5.6 Solmax 67.2%

Grok 4.5high 66.7%

4 models · 1 drop · Grok 4.6

Closed weights only

EEBench

4 models compared.

Grok 4.7xhigh 64%

Fable 5.1max 56.4%

Grok 4.6high 53%

GPT-5.6 Solmax 39.4%

4 models · 1 drop · Grok 4.7

Closed weights only

HealthBench Professional

4 models compared.

Fable 5.1max 62.1%

GPT-5.6 Solmax 60.5%

Grok 4.7xhigh 56.7%

Grok 4.6high 48.5%

4 models · 1 drop · Grok 4.7

Closed weights only

Terminal-Bench 2.1 (standard harness)

4 models compared.

Claude Opus 5 89.1%

GPT-5.6 Sol 88%

Gemini 3.8 Flashhigh 87.6%

Muse Spark 1.3xhigh 85.4%

4 models · 1 drop · Muse Spark 1.3

Closed weights only

AIME 2025

3 models compared.

Claude Opus 4.6 99.8%

MAI-Thinking-1 97%

Claude Sonnet 4.6max 95.6%

3 models · 1 drop · MAI-Thinking-1

Closed weights only

ARC-AGI-1

3 models compared.

GPT-5.6 Terramax 96.5%

Gemini 3.7 Flash 95.5%

Gemini 3.6 Flashhigh 91.2%

3 models · 1 drop · Gemini 3.7 Flash

Closed weights only

ARC-AGI-3

3 models compared.

GPT-6 Astra 99.9%

Claude Opus 5 30.2%

GPT-5.6 Sol 7.8%

3 models · 1 drop · GPT-6 Astra

Closed weights only

BenchCAD (with tools)

3 models compared.

Claude Opus 5.5max 96.2%

GPT-6 Astramax 95.9%

Fable 5.1max 92.6%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

DeepSearchQA

3 models compared.

GPT-5.6 Solmax 93.1%

Claude Opus 5max 90.4%

Muse Spark 1.3max 90.3%

3 models · 1 drop · Muse Spark 1.3

Closed weights only

Frontier Finance

3 models compared.

Fable 5.1max 60.8%

Claude Opus 5.5max 56.7%

GPT-6 Astramax 45%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

MMMU-Pro

3 models compared.

Claude Opus 5.5max 87.7%

GPT-6 Astramax 86.9%

Fable 5.1max 86.3%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

MRCR 512K-1M

3 models compared.

Muse Spark 1.3max 98.1%

GPT-5.6 Solmax 73.8%

Muse Spark 1.2xhigh 55.5%

3 models · 1 drop · Muse Spark 1.3

Closed weights only

OfficeQA Pro v2

3 models compared.

Claude Opus 5.5max 62.2%

Fable 5.1max 54.5%

GPT-6 Astramax 54.4%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

OSWorld

3 models compared.

Claude Opus 5.5max 81.8%

Fable 5.1max 80.7%

GPT-6 Astramax 75.8%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

Terminal-Bench 2.0

Hard tasks in a real terminal (2025 edition).

GPT-5.4 75.1%

Claude Sonnet 4.6max 59.1%

MAI-Thinking-1 46%

3 models · 1 drop · MAI-Thinking-1

Closed weights only

AA-Omniscience

2 models compared.

Gemini 4 Carbon 54

Claude Opus 5.5 48

2 models · 1 drop · Gemini 4 Carbon

Closed weights only

Apex Bench v1.1

2 models compared.

Claude Opus 5 65.8%

GPT-5.6 Sol 54.3%

2 models · 1 drop · DeepSeek V4.1 Flash 1017

Closed weights only

BankerToolBench

2 models compared.

Claude Opus 5 76.2

GPT-5.6 Sol 74.6

2 models · 1 drop · MiniMax M3.1 Flash

Closed weights only

FrontierMath Tier 4

2 models compared.

GPT-6 Astra 97.6%

Fable 5.1 87.8%

2 models · 1 drop · GPT-6 Astra

Closed weights only

SWE-bench Pro v2 Hard

2 models compared.

Claude Opus 5.5 100%

Fern 0.1 76.5%

2 models · 1 drop · Mirendil, "Introducing Fern"

Closed weights only

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

GPT-6 Astramax 70.5%

GPT-6.1 Solmax 69.5%

Gemini 4 Carbonhigh 69%

GPT-6.1 Terramax 68%

Claude Opus 5.5max 68%

Claude Sonnet 5.5max 59%

8 more

Muse Wonder Fullmax 56.5%

Gemini 4 Argonhigh 52.5%

Fable 5.1max 52.5%

Muse Wondermax 50.5%

Gemini 3.8 Flashhigh 46.5%

Claude Haiku 5.5max 43.5%

GPT-6 Lunamax 42.5%

Grok 4.7xhigh 33.5%

14 models · 0 drops · Artificial Analysis (2026-11-04)

Closed weights only

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Gemini 4 Carbonhigh 64.8%

GPT-6 Astramax 63.3%

Claude Opus 5.5max 59%

GPT-6.1 Solmax 58.1%

GPT-6.1 Terramax 57.6%

Claude Sonnet 5.5max 53.3%

8 more

Gemini 4 Argonhigh 52.9%

Fable 5.1max 43.3%

Muse Wonder Fullmax 37.1%

Muse Wondermax 25.7%

Claude Haiku 5.5max 20%

Grok 4.7xhigh 11.4%

Gemini 3.8 Flashhigh 10%

GPT-6 Lunamax 8.6%

14 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

3 Aug 2026

9 Sep 2026

7 Oct 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.