The benchmark board

Every score from our Model Drops from the last 6 months on one board, since Jun 2, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

100benchmarks

52models scored

803scores logged

48Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

Closed weights only

DeepSWE v1.1

Best score rose 42 points, from 37% (Gemini 3.5 Flash) to 79% (Muse Wonder Full).

Closed weights only

Artificial Analysis Intelligence Index

Best score rose 16.2, from 41.8 (Claude Opus 4.8) to 58 (Claude Opus 5.5).

Closed weights only

Terminal-Bench 2.1

Best score rose 13.2 points, from 76.2% (Gemini 3.5 Flash) to 89.4% (Gemini 3.8 Flash).

Closed weights only

Terminal-Bench 4.0

Best score rose 70.6 points, from 0% (Claude Haiku 4.5) to 70.6% (Claude Sonnet 5.5).

Closed weights only

GDPval-AA

Best score rose 517 Elo, from 1349 Elo (Gemini 3.5 Flash) to 1866 Elo (Claude Opus 5.5).

Closed weights only

AutomationBench

Best score rose 5.1 points, from 46.2% (Fable 5) to 51.3% (Gemini 4 Argon).

Closed weights only

GPQA Diamond

Best score rose 4.1 points, from 92% (Claude Opus 4.8) to 96.1% (GPT-6 Astra).

Closed weights only

Humanity's Last Exam (no tools)

Best score rose 18.7 points, from 45.7% (Claude Opus 4.8) to 64.4% (Claude Opus 5.5).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

Claude Sonnet 5Claude Sonnet 5.5

Terminal-Bench 4.0: 10.3% to 70.6%

+60.3

Claude Haiku 4.5Claude Haiku 5.5

OSWorld 2 (offline subset): 15.7% to 72.4%

+56.7

GPT-5.6 TerraGPT-6.1 Terra

AA-Omniscience hallucination rate: 88% to 38%

+50

Muse Spark 1.2Muse Spark 1.3

MRCR 512K-1M: 55.5% to 98.1%

+42.6

Claude Opus 5Claude Opus 5.5

Terminal-Bench Science: 29% to 58.7%

+29.7

GPT-6 SolGPT-6.1 Sol

Terminal-Bench Science: 27.6% to 57%

+29.4

Fable 5Fable 5.1

Terminal-Bench Science: 24.7% to 52.6%

+27.9

Gemini 3.6 FlashGemini 3.7 Flash

ARC-AGI-2: 60.4% to 84.6%

+24.2

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Closed weights only

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

Grok 4.6 87

Gemini 4 Carbon 85.8

Claude Opus 5.5 85.2

Grok 4.5 82.5

Composer 2.5 82.3

GPT-6.1 Sol 80.9

30 more

Gemini 3.7 Flash 77.6

Muse Spark 1.1 74

GPT-6 Astra 73.8

Muse Spark 1.3 73.2

Claude Haiku 5.5 71.4

Gemini Omni 70.1

Fable 5.1 69.9

Fable 5 69.9

Claude Opus 4.8 69.6

Mythos 5 69.5

GPT-6.1 Terra 69.2

GPT-6 Luna 69

GPT-5.6 Terra 66.5

GPT-5.6 Luna 66.2

MAI-Cyber-1-Flash 65.5

Claude Sonnet 5.5 65.4

Gemini 3.8 Flash 65.3

Claude Opus 5 63.9

Gemini 4 Argon 61.6

MAI-Code-1-Flash 61

Muse Spark 1.2 59.2

Qwen3.8-Max 56

MAI-Thinking-1 55.6

GPT-6 Sol 55.4

GPT-5.6 Sol 48.2

Gemini 3.5 Flash 43.4

Gemini 3.6 Flash 39.5

Muse Wonder 37

Grok 4.7 33.4

Claude Sonnet 5 25

36 models · 32 drops · Every model's sources, quotes and method

Closed weights only

DeepSWE v1.1

Fixing issues in real repositories.

Muse Wonder Fullmax 79%

Muse Wondermax 78.8%

Gemini 4 Argonmax 77.9%

Muse Spark 1.3max 75.4%

GPT-6.1 Solhigh 75.2%

Claude Opus 5.5max 74.2%

24 more

GPT-6 Astramax 74.1%

Claude Opus 5 74%

Gemini 3.8 Flash 73.8%

GPT-5.6 Sol 73%

Particle-1max 72.6%

Grok 4.7high 71%

Fable 5xhigh 69.9%

GPT-5.6 Terramax 69.6%

GPT-6 Solmax 68.8%

Fable 5.1max 67.4%

GPT-5.6 Lunamax 67%

GPT-5.5xhigh 67%

GPT-6 Lunamax 66.6%

Gemini 3.7 Flashhigh 65.3%

Grok 4.6high 65.2%

Claude Opus 4.8max 59%

Qwen3.8-Max 56.6%

Muse Spark 1.2xhigh 55%

Grok 4.5high 54%

Claude Sonnet 5max 53.8%

Gemini 3.6 Flash 48.6%

Fern 0.1 44.2%

Gemini 3.5 Flash 37%

Muse Glimmer-30Bmax 4.4%

30 models · 24 drops · Muse Wonder, Gemini 4 Argon, GPT-6 Astra, GPT-6.1 Sol, Kimi K3.1 Pro, MiniMax M3.1 Flash, Particle, "Introducing Particle-1", Grok 4.7, GPT-6 Sol & GPT-6 Luna, Gemini 3.8 Flash, Gemini 3.6 Flash, GPT-5.6 Sol, Terra, & Luna, Qwen3.8-Max, Muse Spark 1.3, Grok 4.6, Gemini 3.7 Flash, Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Closed weights only

Artificial Analysis Intelligence Index

28 models compared.

Claude Opus 5.5 58

Claude Sonnet 5.5max 56

Muse Wonder Fullmax 55.8

GPT-6 Astra 53

Fable 5.1 53

Gemini 4 Argonhigh 53

22 more

Muse Wondermax 52.4

GPT-6.1 Solmax 52

Claude Opus 5 50.8

Fable 5 49.6

Muse Spark 1.3 48.1

GPT-6.1 Terramax 48

GPT-5.6 Sol 47

Grok 4.7 46

Grok 4.6 44

Claude Haiku 5.5max 43

GPT-5.6 Terramax 42

Claude Opus 4.8 41.8

Gemini 3.8 Flash 40.9

Qwen3.8-Max 40.2

Muse Spark 1.2 39.6

Gemini 3.7 Flash 39.1

Grok 4.5high 38.8

Claude Sonnet 5max 38.2

GPT-6 Lunamax 38

GPT-5.6 Lunamax 37.3

Gemini 3.6 Flash 34

Muse Glimmer-30B 17.5

28 models · 20 drops · Kimi K3.1 Pro, GPT-6.1 Terra, Muse Wonder, DeepSeek V4.1 Flash 1017, Grok 4.6, Muse Spark 1.3, Grok 4.7, Qwen3.8-Max, Gemini 3.8 Flash, GLM-5.3, Muse Spark 1.2, Gemini 3.7 Flash, Gemini 3.6 Flash, Qwen3.8

Closed weights only

Terminal-Bench 2.1

22 models compared.

Gemini 3.8 Flashmax 89.4%

Claude Opus 5 89.1%

GPT-5.6 Solmax 88.8%

Muse Spark 1.3max 88.8%

Mythos 5 88%

GPT-5.6 Terramax 87.4%

16 more

Qwen3.8-Max 86.6%

Gemini 3.7 Flashhigh 85.8%

GPT-5.5xhigh 85.6%

GPT-5.6 Lunamax 84.7%

Claude Opus 4.8max 84.6%

Fable 5max 84.6%

Muse Spark 1.2xhigh 82.9%

Grok 4.5high 81.6%

Claude Sonnet 5max 80.4%

Particle-1max 79.9%

Claude Opus 4.6max 78.2%

Gemini 3.6 Flashmax 78%

Gemini 3.5 Flash 76.2%

Muse Spark 1.1xhigh 76.2%

Gemini 3.1 Pro 70.7%

Muse Glimmer-30Bmax 51.7%

22 models · 20 drops · Gemini 3.8 Flash, MiMo-V2.6-Pro, Muse Spark 1.3, Fable 5 / Mythos 5, Qwen3.8-Max, Gemini 3.7 Flash, GPT-5.6 Sol, Terra, & Luna, Gemini 3.6 Flash, Muse Spark 1.2, Particle, "Introducing Particle-1", Qwen3.8

Closed weights only

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Claude Sonnet 5.5max 70.6%

Claude Opus 5.5max 66.4%

Mythos 5.1 60.9%

GPT-6 Astramax 58.2%

Fable 5.1max 57.9%

Gemini 4 Argonmax 57.4%

16 more

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 55.9%

Muse Wondermax 52%

Claude Opus 5 51.8%

GPT-6.1 Terramax 50.3%

GPT-5.6 Sol 39.9%

Claude Haiku 5.5max 39.2%

Grok 4.7xhigh 37.6%

GPT-5.6 Terramax 21.5%

Grok 4.6high 20.3%

Gemini 3.8 Flashmax 19.1%

GPT-6 Luna 16.4%

Claude Sonnet 5 10.3%

Fern 0.1 6.1%

Muse Glimmer-30Bmax 1.6%

Claude Haiku 4.5 0%

22 models · 19 drops · GPT-6.1 Terra, Kimi K3.1 Pro, GPT-6 Astra, Gemini 4 Argon, Muse Wonder, MiniMax M3.1 Flash, Claude Haiku 5.5, Grok 4.7, Gemini 3.8 Flash, Claude Sonnet 5.5, Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Closed weights only

GDPval-AA

Professional work products, graded head to head (Elo).

Claude Opus 5.5max 1866 Elo

Muse Wonder Fullmax 1857 Elo

Claude Sonnet 5.5 1838 Elo

Muse Wondermax 1770 Elo

Fable 5.1max 1754 Elo

Muse Spark 1.3max 1754 Elo

19 more

Fable 5 1743 Elo

Claude Opus 5 1708 Elo

Grok 4.7xhigh 1695 Elo

Claude Haiku 5.5max 1620 Elo

Muse Spark 1.2xhigh 1615 Elo

Grok 4.6high 1605 Elo

GPT-5.6 Sol 1588 Elo

GPT-5.6 Lunamax 1584 Elo

GPT-6 Astramax 1573 Elo

Gemini 3.8 Flashmax 1545 Elo

GPT-5.6 Terramax 1528 Elo

Grok 4.5high 1526 Elo

Gemini 3.7 Flashhigh 1525 Elo

GPT-6 Sol 1487 Elo

Claude Sonnet 5 1449 Elo

GPT-6 Luna 1437 Elo

Gemini 3.6 Flash 1422 Elo

Gemini 3.5 Flash 1349 Elo

Claude Haiku 4.5 735 Elo

25 models · 16 drops · Kimi K3.1 Pro, Muse Wonder, Muse Spark 1.3, GLM-5.3, Claude Opus 5.5, Grok 4.7, Claude Haiku 5.5, MiMo-V2.6-Pro, Gemini 3.6 Flash, Gemini 3.8 Flash, Grok 4.6, Gemini 3.7 Flash, Claude Sonnet 5.5

Closed weights only

AutomationBench

Real business automations (Zapier).

Gemini 4 Argonmax 51.3%

Claude Opus 5 50.3%

Muse Spark 1.3max 49.6%

Fable 5 46.2%

GPT-5.6 Sol 45.8%

Claude Sonnet 5.5max 44.7%

11 more

Claude Opus 5.5 42.5%

GPT-6 Astramax 41.4%

GPT-6.1 Solmax 36.1%

GPT-6 Sol 33.2%

Fable 5.1max 31.4%

Gemini 3.7 Flashhigh 30.4%

GPT-5.6 Terra 23.6%

GPT-6 Lunamax 20.7%

Gemini 3.6 Flash 17%

Muse Glimmer-30Bmax 15.2%

Claude Sonnet 5 10.7%

17 models · 16 drops · Gemini 4 Argon, MiniMax M3.1 Flash, Muse Spark 1.3, GLM-5.3, Claude Sonnet 5.5, GPT-6.1 Sol, Gemini 3.7 Flash, GPT-6 Sol & GPT-6 Luna, Nanbeige4.3-33B model card

Closed weights only

GPQA Diamond

15 models compared.

GPT-6 Astramax 96.1%

GPT-5.6 Solmax 94.1%

Claude Opus 5.5max 93.9%

Fable 5.1max 93.7%

GPT-5.4 92.8%

Qwen3.8-Max 92.6%

9 more

Fable 5max 92.6%

Claude Opus 4.8max 92%

Claude Opus 4.6max 91.3%

Particle-1 90.4%

Claude Sonnet 4.6max 89.9%

MAI-Code-1-Flash 84.6%

MAI-Thinking-1 84.2%

Muse Glimmer-30Bmax 83.5%

Claude Haiku 4.5 73.2%

15 models · 14 drops · Kimi K3.1 Pro, Qwen3.8-Max, MAI-Thinking-1, Qwen3.8, Particle, "Introducing Particle-1", MAI-Code-1-Flash

Closed weights only

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Claude Opus 5.5 64.4%

Mythos 5 59%

Fable 5 57.8%

Fable 5.1max 57.6%

Claude Sonnet 5.5 56.9%

Claude Mythos Preview 56.8%

9 more

Claude Opus 5 56.3%

GPT-6 Astramax 53.6%

Claude Haiku 5.5max 45.9%

Claude Opus 4.8max 45.7%

GPT-5.6 Sol 44.5%

Gemini 3.1 Pro 44.4%

Qwen3.8-Max 43.6%

GPT-5.5 41.4%

Claude Haiku 4.5 10.2%

15 models · 12 drops · Claude Opus 5.5, Fable 5 / Mythos 5, Fable 5.1, Kimi K3.1 Pro, Claude Haiku 5.5, DeepSeek V4.1 Flash 1017, Qwen3.8, Qwen3.8-Max

Closed weights only

SWE-bench Pro

15 models compared.

Fable 5max 80%

Claude Opus 4.8max 69.2%

Qwen3.8-Max 67.7%

Grok 4.5max 64.7%

GPT-5.6 Solmax 64.6%

Claude Sonnet 5max 63.2%

9 more

GPT-5.6 Lunamax 62.7%

Gemini 3.6 Flashmax 58.7%

GPT-5.4 57.7%

Gemini 3.5 Flash 55.1%

Claude Opus 4.6max 53.4%

MAI-Thinking-1 52.8%

MAI-Code-1-Flash 51.2%

Muse Glimmer-30Bmax 51.2%

Claude Haiku 4.5 35.2%

15 models · 8 drops · Qwen3.8, Qwen3.8-Max, Gemini 3.6 Flash, MAI-Thinking-1, MAI-Code-1-Flash

Closed weights only

OSWorld 2

Using a computer: apps, files and the web.

Claude Sonnet 5.5max 83.9%

Claude Opus 5.5 81.8%

GPT-6.1 Solmax 78%

GPT-6.1 Terramax 74.2%

GPT-6 Astra 72.6%

Claude Opus 5 70.6%

6 more

Muse Spark 1.3max 66.9%

GPT-5.6 Sol 65.7%

Gemini 3.8 Flashmax 59%

GPT-5.6 Terramax 57.1%

Claude Sonnet 5 57%

GPT-6 Lunamax 55.5%

12 models · 8 drops · GPT-6.1 Terra, Claude Sonnet 5.5, GPT-6 Astra, MiniMax M3.1 Flash, Muse Spark 1.3, Gemini 3.8 Flash

Closed weights only

SWE-bench Verified

7 models compared.

GPT-6 Astra 86%

Claude Opus 4.6 80.8%

Claude Sonnet 4.6max 79.6%

MAI-Thinking-1 73.5%

Fern 0.1 73.4%

MAI-Code-1-Flash 71.6%

1 more

Claude Haiku 4.5 66.6%

7 models · 8 drops · Mirendil, "Introducing Fern", MAI-Thinking-1, MAI-Code-1-Flash

Closed weights only

Harvey Legal Agent Benchmark

Legal work end to end.

Grok 4.7xhigh 19.6%

Gemini 4 Argonmax 19.6%

Fable 5.1max 19.1%

Grok 4.6high 15.8%

Muse Wonder Fullmax 13.1%

Grok 4.5high 12.9%

10 more

Fable 5max 11.3%

Qwen3.8 Max 10.4%

Gemini 3.8 Flashmax 10%

Muse Wondermax 10%

GPT-6 Astramax 8.6%

Claude Opus 5max 6.7%

Claude Sonnet 5max 5%

Claude Opus 5.5max 4.2%

GPT-5.6 Solmax 2.5%

GPT-5.6 Terramax 0.8%

16 models · 7 drops · Grok 4.7, Gemini 4 Argon, Kimi K3.1 Pro, Muse Wonder, Grok 4.6, Mistral Large 4, Gemini 3.8 Flash

Closed weights only

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Claude Opus 5.5 67.7%

Fable 5.1max 65.6%

Claude Mythos Preview 64.7%

Mythos 5 64.5%

GPT-5.6 Sol 64.5%

Fable 5 63.9%

6 more

Claude Opus 5 63.6%

Claude Opus 4.8max 57.9%

GPT-6 Astramax 57.2%

Qwen3.8-Max 56.2%

GPT-5.5 52.2%

Gemini 3.1 Pro 51.4%

12 models · 7 drops · Claude Opus 5.5, Kimi K3.1 Pro, Fable 5 / Mythos 5, GLM-5.3, Qwen3.8-Max

Closed weights only

Terminal-Bench Science

Scientific computing tasks in a terminal.

GPT-6 Astramax 68.1%

Claude Opus 5.5max 63.3%

GPT-6.1 Terramax 58.3%

GPT-6.1 Solmax 57%

Fable 5.1max 40%

Claude Opus 5 29%

3 more

GPT-6 Sol 27.6%

Fable 5 24.7%

GPT-5.6 Sol 22.4%

9 models · 6 drops · GPT-6.1 Terra, Kimi K3.1 Pro, Claude Opus 5.5, GPT-6.1 Sol, Fable 5.1

Closed weights only

ProgramBench

7 models compared.

Claude Opus 5.5max 65%

Muse Wonder Fullmax 59%

Fable 5.1max 53.5%

Muse Wondermax 50%

GPT-6 Astramax 50%

Claude Opus 5 37%

1 more

GPT-5.6 Sol 23%

7 models · 5 drops · Kimi K3.1 Pro, Muse Wonder, DeepSeek V4.1 Flash 1017

Closed weights only

BrowseComp

6 models compared.

GPT-6 Astramax 91.5%

Claude Opus 5.5max 90.8%

GPT-5.6 Solmax 90.4%

GPT-5.6 Terramax 87.5%

GPT-5.5xhigh 84.4%

GPT-5.6 Lunaxhigh 84%

6 models · 5 drops · Kimi K3.1 Pro, GPT-5.6 Sol, Terra, & Luna

Closed weights only

IFBench

4 models compared.

Qwen3.8-Max 82.8%

GPT-5.6 Solmax 72.7%

Fable 5max 63.5%

Claude Opus 4.8max 62.2%

4 models · 5 drops · Qwen3.8-Max

Closed weights only

AA-LCR

16 models compared.

Fable 5.1max 85.3%

Claude Opus 5.5max 84.7%

Muse Wonder Fullmax 83.7%

Muse Glimmer-30Bmax 83.3%

GPT-6 Lunamax 83.3%

GPT-6.1 Solmax 83%

10 more

GPT-6.1 Terramax 82.7%

Claude Sonnet 5.5max 82.7%

Claude Haiku 5.5max 82.7%

Gemini 3.8 Flashhigh 81.3%

Muse Wondermax 80.7%

GPT-6 Astramax 80.7%

Qwen3.8-Max 80.3%

Gemini 4 Argonhigh 79.7%

Gemini 4 Carbonhigh 79.3%

Grok 4.7xhigh 76.7%

16 models · 4 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card

Closed weights only

OSWorld 2 (offline subset)

Using a computer, on the 82 OSWorld 2.1 tasks that need no internet.

Claude Opus 5.5max 87.2%

Claude Sonnet 5.5 83.9%

Gemini 4 Carbonmax 81.5%

GPT-6 Astramax 80.9%

Fable 5.1max 76.8%

Gemini 4 Argonmax 74.7%

7 more

Claude Haiku 5.5max 72.4%

GPT-6.1 Solmax 71.4%

Claude Opus 5max 70.2%

GPT-5.6 Sol 65.7%

GPT-6 Solmax 64.4%

GPT-6 Luna 48.9%

Claude Haiku 4.5 15.7%

13 models · 4 drops · Gemini 4 Carbon, Claude Haiku 5.5, GPT-6.1 Sol, GPT-6 Sol & GPT-6 Luna

Closed weights only

ARC-AGI-2

10 models compared.

GPT-5.6 Sol 92.5%

Claude Opus 5 90.4%

Fable 5 89.2%

Gemini 3.8 Flash 89.2%

Gemini 3.7 Flash 84.6%

GPT-5.6 Terramax 83.9%

4 more

Grok 4.6 65.1%

Gemini 3.6 Flash 60.4%

GPT-5.6 Lunamax 59.5%

Grok 4.5high 52.6%

10 models · 4 drops · Grok 4.6, Gemini 3.8 Flash, Gemini 3.7 Flash, Gemini 3.6 Flash

Closed weights only

Agents' Last Exam

4 models compared.

Claude Opus 5.5max 42.6%

GPT-6 Astramax 32.8%

Claude Opus 5 32.2%

GPT-5.6 Sol 30.6%

4 models · 4 drops · Kimi K3.1 Pro, MiniMax M3.1 Flash

Closed weights only

JobBench

3 models compared.

Claude Opus 5max 65.7%

Muse Spark 1.3max 64.9%

GPT-5.6 Solmax 45.4%

3 models · 4 drops · MiMo-V2.6-Pro, Muse Spark 1.3

Closed weights only

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Gemini 4 Carbonhigh 65.2%

Claude Sonnet 5.5max 63.6%

Claude Opus 5.5max 59.6%

GPT-6 Astramax 59.1%

Gemini 4 Argonhigh 57.1%

Muse Wonder Fullmax 57.1%

9 more

GPT-6.1 Solmax 56.1%

GPT-6.1 Terramax 55.6%

Fable 5.1max 52%

Muse Wondermax 52%

Qwen3.8-Max 38.9%

Claude Haiku 5.5max 32.8%

Grok 4.7xhigh 25.8%

Gemini 3.8 Flashhigh 19.7%

GPT-6 Lunamax 12.6%

15 models · 3 drops · Artificial Analysis (2026-11-04)

Closed weights only

AA-Omniscience hallucination rate

Lower is better.

Muse Wonder Fullmax 23%

Muse Wondermax 26.5%

Grok 4.7 29%

Grok 4.6 34%

GPT-6.1 Terra 38%

Claude Sonnet 5.5 47%

4 more

GPT-6 Astra 51.3%

Claude Opus 5.5 58.6%

Fable 5.1 72.6%

GPT-5.6 Terra 88%

10 models · 3 drops · Muse Wonder, Grok 4.7, GPT-6.1 Terra

Closed weights only

GDP.pdf

Work products built from PDFs (Surge AI).

GPT-6 Astramax 34.2%

Gemini 3.7 Flashhigh 34%

GPT-6.1 Solhigh 32%

Claude Opus 5.5max 30.6%

Claude Sonnet 5 28%

GPT-6 Sol 28%

4 more

Fable 5.1max 27.6%

GPT-5.6 Terra 24.7%

Gemini 3.6 Flash 22%

Muse Spark 1.2 16%

10 models · 3 drops · Kimi K3.1 Pro, Gemini 3.7 Flash, GPT-6.1 Sol

Closed weights only

FrontierCode v1.1

Hard, long coding tasks.

Claude Opus 5.5 54.4%

GPT-6 Astra 53.3%

Claude Sonnet 5.5xhigh 52.1%

Fable 5.1 50.3%

GPT-6 Sol 49.3%

Claude Opus 5 48%

3 more

Claude Haiku 5.5max 46.4%

Claude Sonnet 5 42.4%

GPT-6 Luna 42.4%

9 models · 3 drops · Claude Sonnet 5.5, Claude Opus 5.5, Claude Haiku 5.5

Closed weights only

Terminal-Bench 3.0

9 models compared.

Claude Opus 5 43.5%

GPT-5.6 Solmax 34.6%

Fable 5 33.7%

Grok 4.6high 26%

GPT-5.6 Terra 20.8%

Grok 4.5high 15.7%

3 more

Gemini 3.7 Flashhigh 14.9%

Claude Sonnet 5 14.6%

Gemini 3.6 Flash 5.4%

9 models · 3 drops · Grok 4.6, GLM-5.3, Gemini 3.7 Flash

Closed weights only

ExploitBench

8 models compared.

GPT-6 Astramax 100%

Claude Opus 5.5max 91%

Fable 5.1max 83%

Mythos 5 78%

GPT-5.6 Sol 76.5%

Claude Mythos Preview 69%

2 more

Claude Opus 4.8 40%

GPT-5.5 34%

8 models · 3 drops · Kimi K3.1 Pro, GLM-5.3, Fable 5 / Mythos 5

Closed weights only

OSWorld-Verified

Using a computer: apps, files and the web (2025 edition).

Claude Opus 5 83.4%

Gemini 3.6 Flashmax 83%

GPT-5.6 Sol 83%

Claude Sonnet 5max 81.2%

Gemini 3.5 Flash 78.4%

Claude Opus 4.6max 72.7%

2 more

GPT-5.6 Lunamax 72.6%

Muse Glimmer-30Bmax 65.9%

8 models · 3 drops · MiMo-V2.6-Pro, Gemini 3.6 Flash, Qwen3.8

Closed weights only

BabyVision (with tools)

6 models compared.

Claude Opus 5.5max 97.7%

GPT-6 Astramax 96.6%

Fable 5.1max 95.1%

Claude Opus 5 94.1%

Particle-1 89.2%

GPT-5.6 Sol 88.9%

6 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Particle, "Introducing Particle-1"

Closed weights only

CharXiv Reasoning

6 models compared.

GPT-5.6 Terra 85.9%

Gemini 3.6 Flashmax 85.2%

Gemini 3.7 Flashhigh 84.5%

GPT-5.6 Lunamax 82.7%

Grok 4.5max 81.6%

Claude Sonnet 5max 77%

6 models · 3 drops · Gemini 3.7 Flash, Gemini 3.6 Flash

Closed weights only

CyberGym

5 models compared.

MAI-Cyber-1-Flash 96%

GPT-5.5 Cyber 85.6%

Mythos 5 83.8%

GPT-5.6 Sol 83.6%

Gemini 3.5 Flash Cyber 83.2%

5 models · 3 drops · MAI-Cyber-1-Flash, GLM-5.3, MiniMax M3.1 Flash

Closed weights only

ZeroBench (with tools)

5 models compared.

Claude Opus 5.5max 61%

Fable 5.1max 59%

GPT-6 Astramax 58%

GPT-5.6 Sol 53%

Claude Opus 5 52%

5 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Closed weights only

MCP Atlas

4 models compared.

Muse Spark 1.2xhigh 90.3%

Claude Opus 5xhigh 85.8%

Fable 5 83.3%

GPT-5.6 Sol 81.8%

4 models · 3 drops · Muse Spark 1.2

Closed weights only

AIME 2026

3 models compared.

Muse Glimmer-30Bmax 94.7%

MAI-Code-1-Flash 92.5%

Claude Haiku 4.5 83.3%

3 models · 3 drops · Nanbeige4.3-33B model card, MAI-Code-1-Flash

Closed weights only

NL2Repo

3 models compared.

Claude Opus 5 75.3%

GPT-5.6 Sol 56.8%

Muse Glimmer-30Bmax 27.4%

3 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

Closed weights only

Epoch Capabilities Index

29 models compared.

GPT-6 Astra 169.1

Claude Opus 5.5 168.4

GPT-6.1 Terra 168.1

GPT-6.1 Sol 167.8

Claude Sonnet 5.5 166.7

Fable 5.1 166.4

23 more

Gemini 4 Argon 166.1

Claude Opus 5 164.5

GPT-6 Sol 163.8

Fable 5 163

GPT-5.6 Sol 162.6

Muse Wonder 161.7

Claude Haiku 5.5 160.4

GPT-5.6 Terra 160.1

Claude Opus 4.8 159.6

Gemini 3.7 Flash 158.2

Gemini 3.8 Flash 157.6

Muse Spark 1.3 157.4

Claude Sonnet 5 157

Grok 4.6 156.9

GPT-6 Luna 156.8

GPT-5.6 Luna 156.7

Qwen3.8-Max 156.2

Muse Spark 1.2 155.2

Gemini 3.5 Flash 155

Gemini 3.6 Flash 154.7

Grok 4.7 154.6

Grok 4.5 154.4

Muse Spark 1.1 154.2

29 models · 2 drops · Epoch Capabilities Index (2026-11-04)

Closed weights only

AA-Briefcase v1.1

17 models compared.

Claude Sonnet 5.5max 1813 Elo

Claude Opus 5.5max 1800 Elo

Muse Wonder Fullmax 1729 Elo

Fable 5.1max 1669 Elo

Muse Wondermax 1659 Elo

Grok 4.7xhigh 1637 Elo

11 more

Gemini 4 Carbonhigh 1610 Elo

Qwen3.8-Max 1607 Elo

Claude Haiku 5.5max 1574 Elo

GPT-6 Astramax 1569 Elo

GPT-6.1 Solmax 1555 Elo

Grok 4.6high 1546 Elo

GPT-5.6 Solmax 1487 Elo

Gemini 4 Argonhigh 1484 Elo

GPT-6.1 Terramax 1401 Elo

GPT-6 Lunamax 1337 Elo

Gemini 3.8 Flashhigh 1203 Elo

17 models · 2 drops · Artificial Analysis (2026-11-04), Grok 4.7

Closed weights only

AutomationBench-AA

Business automations, run by Artificial Analysis.

Gemini 4 Carbonhigh 77.8%

Gemini 4 Argonhigh 77.5%

Claude Sonnet 5.5max 71.8%

Muse Wonder Fullmax 71.3%

Claude Opus 5.5max 69.5%

GPT-6 Astramax 68.5%

9 more

Muse Wondermax 68.1%

Grok 4.7xhigh 65.6%

GPT-6.1 Solmax 64.9%

GPT-6.1 Terramax 60.2%

Gemini 3.8 Flashhigh 59.9%

Fable 5.1max 59.4%

Qwen3.8-Max 56.2%

GPT-6 Lunamax 53.2%

Claude Haiku 5.5max 35.4%

15 models · 2 drops · Artificial Analysis (2026-11-04)

Closed weights only

Agents' Last Exam v1

9 models compared.

Claude Opus 5.5max 63.2%

GPT-6.1 Terramax 60%

GPT-6 Astramax 59.3%

GPT-6.1 Solmax 58.6%

GPT-6 Solmax 56.4%

GPT-5.6 Solmax 52.8%

3 more

Claude Opus 5max 52.7%

GPT-6 Lunamax 50.9%

GPT-5.6 Terramax 50.7%

9 models · 2 drops · GPT-6.1 Terra, GPT-6 Sol & GPT-6 Luna

Closed weights only

APEX-Agents

8 models compared.

Claude Opus 5.5max 73.5%

Fable 5.1max 68.6%

GPT-6 Astramax 64.7%

Claude Opus 5 60.6%

Fable 5max 59.2%

Grok 4.6high 57.5%

2 more

GPT-5.6 Solmax 56.7%

Grok 4.5high 47.1%

8 models · 2 drops · Kimi K3.1 Pro, Grok 4.6

Closed weights only

HealthBench Professional

8 models compared.

Mythos 5 66%

Claude Mythos Preview 64.7%

Fable 5.1max 62.1%

GPT-5.6 Solmax 60.5%

Claude Opus 4.8 56.9%

Grok 4.7xhigh 56.7%

2 more

GPT-5.5 51.8%

Grok 4.6high 48.5%

8 models · 2 drops · Fable 5 / Mythos 5, Grok 4.7

Closed weights only

HLE-Verified

7 models compared.

Gemini 3.8 Flashmax 54.9%

GPT-5.6 Solmax 54.5%

Claude Opus 5max 54.4%

Gemini 3.7 Flashhigh 53.6%

Gemini 3.6 Flash 51.2%

GPT-5.6 Terramax 51.1%

1 more

Claude Sonnet 5max 31%

7 models · 2 drops · Gemini 3.8 Flash, Gemini 3.7 Flash

Closed weights only

Terminal-Bench 2.1 (standard harness)

7 models compared.

Claude Opus 5 89.1%

GPT-5.6 Terra 88%

GPT-5.6 Sol 88%

Gemini 3.8 Flashhigh 87.6%

Muse Spark 1.3xhigh 85.4%

Grok 4.5 81.6%

1 more

Muse Spark 1.2 80.1%

7 models · 2 drops · Muse Spark 1.3, Muse Spark 1.2

Closed weights only

CursorBench 4.0

Long coding tasks inside Cursor.

Claude Opus 5.5 57.8%

Fable 5.1max 51.8%

Claude Opus 5 46.6%

Grok 4.7xhigh 46.3%

GPT-5.6 Solmax 41.7%

Grok 4.6high 40.4%

6 models · 2 drops · Claude Opus 5.5, Grok 4.7

Closed weights only

AA-Briefcase

5 models compared.

Claude Opus 5 1715 Elo

Grok 4.6high 1577 Elo

Fable 5max 1574 Elo

GPT-5.6 Solmax 1502 Elo

Grok 4.5high 1313 Elo

5 models · 2 drops · Grok 4.6

Closed weights only

Artificial Analysis Coding Agent Index

5 models compared.

Claude Opus 5.5 62

Gemini 4 Carbon 59

Grok 4.7 56

Gemini 4 Argon 53

Grok 4.6 47

5 models · 2 drops · Gemini 4 Carbon, Grok 4.7

Closed weights only

Chartography (with tools)

5 models compared.

GPT-6 Astramax 91%

Claude Opus 5.5max 89%

Fable 5.1max 88.4%

Claude Opus 5 84%

GPT-5.6 Sol 79.9%

5 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Closed weights only

FrontierSWE v2

Frontier software engineering tasks.

GPT-6 Astramax 65.5%

Claude Opus 5.5max 62.3%

Gemini 4 Carbonmax 61.2%

Fable 5.1max 56.3%

Gemini 4 Argonmax 55%

5 models · 2 drops · Gemini 4 Carbon

Closed weights only

SWE-Marathon

5 models compared.

Muse Wonder Fullxhigh 57.5%

Muse Wondermax 53.1%

Claude Opus 5.5max 46.3%

Fable 5.1max 45.6%

GPT-6 Astramax 42.5%

5 models · 2 drops · Muse Wonder, Kimi K3.1 Pro

Closed weights only

Terminal-Bench 2.0

Hard tasks in a real terminal (2025 edition).

GPT-5.4 75.1%

Claude Sonnet 4.6max 59.1%

MAI-Code-1-Flash 54.8%

MAI-Thinking-1 46%

Claude Haiku 4.5 41.6%

5 models · 2 drops · MAI-Thinking-1, MAI-Code-1-Flash

Closed weights only

Agents' Last Exam (CLI)

4 models compared.

Claude Opus 5.5max 40.7%

GPT-6 Astramax 38.8%

GPT-5.6 Sol 28.6%

Fable 5 23.8%

4 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

Closed weights only

Vals Index

4 models compared.

Gemini 4 Argonmax 68.9%

Claude Opus 5.5 67%

Fable 5.1 65.8%

GPT-6 Astra 63.1%

4 models · 2 drops · Gemini 4 Argon

Closed weights only

Toolathlon-Verified

3 models compared.

Claude Opus 5 80.6%

GPT-5.6 Sol 74.9%

Muse Glimmer-30Bmax 47.2%

3 models · 2 drops · MiMo-V2.6-Pro, Nanbeige4.3-33B model card

Closed weights only

MMLU-Pro

2 models compared.

Claude Sonnet 4.6max 87%

MAI-Thinking-1 85%

2 models · 2 drops · MAI-Thinking-1

Closed weights only

SWE-Atlas-QnA

2 models compared.

Fern 0.1 53.2%

Muse Glimmer-30Bmax 17.7%

2 models · 2 drops · Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Closed weights only

SWE-Bench Multilingual

2 models compared.

MAI-Code-1-Flash 65.5%

Claude Haiku 4.5 62.7%

2 models · 2 drops · MAI-Code-1-Flash

Closed weights only

τ²-bench Telecom

2 models compared.

MAI-Code-1-Flash 71.7%

Claude Haiku 4.5 54.7%

2 models · 2 drops · MAI-Code-1-Flash

From a single launch

Closed weights only

Artificial Analysis Intelligence Index v5.0

15 models compared.

Gemini 4 Carbonhigh 60

Claude Opus 5.5max 59.1

GPT-6 Astramax 56.9

GPT-6.1 Solmax 54.6

Claude Sonnet 5.5max 54.5

GPT-6.1 Terramax 51.3

9 more

Gemini 4 Argonhigh 50.4

Muse Wonder Fullmax 50.1

Fable 5.1max 49.2

Muse Wondermax 43.6

Claude Haiku 5.5max 36.5

Grok 4.7xhigh 35.5

Qwen3.8-Max 33.7

Gemini 3.8 Flashhigh 30.8

GPT-6 Lunamax 27.9

15 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Claude Opus 5.5max 46.4%

GPT-6 Astramax 42.4%

GPT-6.1 Terramax 42.3%

Claude Sonnet 5.5max 41.7%

Gemini 4 Carbonhigh 40.6%

GPT-6.1 Solmax 40.6%

9 more

Muse Wonder Fullmax 37.8%

Claude Haiku 5.5max 34.9%

Fable 5.1max 31.6%

Grok 4.7xhigh 28.7%

Muse Wondermax 27.9%

Gemini 4 Argonhigh 25.7%

GPT-6 Lunamax 25.2%

Qwen3.8-Max 23.4%

Gemini 3.8 Flashhigh 18.7%

15 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

Vals Index v2.2

14 models compared.

Claude Sonnet 5.5 70.9%

Gemini 4 Carbon 70.5%

Claude Opus 5.5 70.2%

Gemini 4 Argon 69.2%

Muse Wonder Full 66.8%

GPT-6 Astra 65%

8 more

Muse Wonder 64.9%

GPT-6.1 Sol 63.9%

GPT-6.1 Terra 60.5%

Qwen3.8-Max 59.1%

Claude Haiku 5.5 58.7%

Grok 4.7 58.6%

Gemini 3.8 Flash 56%

GPT-6 Luna 52.3%

14 models · 1 drop · Vals Index v2.2 (2026-11-04)

Closed weights only

Artificial Analysis Cyber Index

6 models compared.

Grok 4.7xhigh 56.4

GPT-6 Lunamax 52.7

GPT-6 Astramax 33.4

Claude Opus 5.5max 28.7

Gemini 3.8 Flashhigh 25.1

Fable 5.1max 25

6 models · 1 drop · Artificial Analysis (2026-11-04)

Closed weights only

Artificial Analysis Coding Agent Index v2.0

5 models compared.

Claude Opus 5.5max 62

Claude Sonnet 5.5max 59

GPT-6.1 Solmax 54

GPT-6.1 Terramax 48

GPT-6 Lunamax 31

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

Factual error rate

Lower is better.

GPT-6 Astramax 4.2%

GPT-6.1 Terramax 4.3%

GPT-6.1 Solmax 4.4%

GPT-6 Lunamax 18.4%

GPT-5.6 Terramax 22.3%

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

MemoryBench

5 models compared.

Muse Wondermax 85.6%

Muse Wonder Fullmax 85.5%

Claude Opus 5.5max 81.5%

GPT-6 Astramax 81.4%

Fable 5.1max 79%

5 models · 1 drop · Muse Wonder

Closed weights only

MMMU-Pro Vision

5 models compared.

GPT-6 Astramax 86.7%

GPT-6.1 Solmax 86.3%

GPT-6.1 Terramax 85.5%

GPT-5.6 Terramax 81.7%

GPT-6 Lunamax 79.9%

5 models · 1 drop · GPT-6.1 Terra

Closed weights only

Personal Superintelligence Index

5 models compared.

Muse Wonder Fullmax 59.1

Claude Opus 5.5max 55.2

GPT-6 Astramax 54.5

Muse Wondermax 54.3

Fable 5.1max 49.9

5 models · 1 drop · Muse Wonder

Closed weights only

SWE-sweep

5 models compared.

Gemini 4 Carbonmax 9.6%

GPT-6 Astramax 9.5%

Gemini 4 Argonmax 4.3%

Claude Opus 5.5max 3.6%

Fable 5.1max 2.9%

5 models · 1 drop · Gemini 4 Carbon

Closed weights only

Vals Finance Agent v2

5 models compared.

Gemini 3.8 Flashmax 61.4%

Claude Opus 5max 58.6%

GPT-5.6 Terramax 54.4%

Claude Sonnet 5max 53.9%

GPT-5.6 Solmax 53.8%

5 models · 1 drop · Gemini 3.8 Flash

Closed weights only

Agents' Last Exam v1.1

4 models compared.

Gemini 4 Carbonmax 77.4%

GPT-6 Astramax 73.1%

Claude Opus 5.5max 71.6%

Gemini 4 Argonmax 69%

4 models · 1 drop · Gemini 4 Carbon

Closed weights only

Chartography

4 models compared.

Claude Sonnet 5.5 61.6%

Claude Haiku 5.5max 46.4%

GPT-6 Luna 29.1%

Claude Haiku 4.5 6.4%

4 models · 1 drop · Claude Haiku 5.5

Closed weights only

CursorBench 3.2

4 models compared.

Fable 5max 70.5%

Grok 4.6high 69.9%

GPT-5.6 Solmax 67.2%

Grok 4.5high 66.7%

4 models · 1 drop · Grok 4.6

Closed weights only

EEBench

4 models compared.

Grok 4.7xhigh 64%

Fable 5.1max 56.4%

Grok 4.6high 53%

GPT-5.6 Solmax 39.4%

4 models · 1 drop · Grok 4.7

Closed weights only

GDM-MRCR v2

4 models compared.

Gemini 3.6 Flashmax 91.8%

Grok 4.5max 81.4%

GPT-5.6 Lunamax 74.8%

Claude Sonnet 5max 71.6%

4 models · 1 drop · Gemini 3.6 Flash

Closed weights only

Meta Internal Coding Bench

4 models compared.

Claude Opus 5max 79.4%

Muse Spark 1.2xhigh 70.6%

Muse Spark 1.1xhigh 68.3%

GPT-5.6 Terramax 65.4%

4 models · 1 drop · Muse Spark 1.2

Closed weights only

MLE-Bench

4 models compared.

Claude Sonnet 5max 66.9%

Gemini 3.6 Flashmax 63.9%

GPT-5.6 Lunamax 47.6%

Grok 4.5max 43.2%

4 models · 1 drop · Gemini 3.6 Flash

Closed weights only

PaperBench

4 models compared.

Qwen3.8-Max 93%

GPT-5.6 Solmax 90.5%

Fable 5max 88.8%

Claude Opus 4.8max 80.3%

4 models · 1 drop · Qwen3.8-Max

Closed weights only

SEC-Bench Pro

4 models compared.

GPT-5.6 Solmax 71.2%

GPT-5.6 Terramax 57.7%

GPT-5.6 Lunamax 48.9%

GPT-5.5xhigh 45.8%

4 models · 1 drop · GPT-5.6 Sol, Terra, & Luna

Closed weights only

AIME 2025

3 models compared.

Claude Opus 4.6 99.8%

MAI-Thinking-1 97%

Claude Sonnet 4.6max 95.6%

3 models · 1 drop · MAI-Thinking-1

Closed weights only

ARC-AGI-1

3 models compared.

GPT-5.6 Terramax 96.5%

Gemini 3.7 Flash 95.5%

Gemini 3.6 Flashhigh 91.2%

3 models · 1 drop · Gemini 3.7 Flash

Closed weights only

ARC-AGI-3

3 models compared.

GPT-6 Astra 99.9%

Claude Opus 5 30.2%

GPT-5.6 Sol 7.8%

3 models · 1 drop · GPT-6 Astra

Closed weights only

BenchCAD (with tools)

3 models compared.

Claude Opus 5.5max 96.2%

GPT-6 Astramax 95.9%

Fable 5.1max 92.6%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

BioMysteryBench hard

3 models compared.

Mythos 5 46.1%

Claude Opus 4.8 40%

Claude Mythos Preview 29.6%

3 models · 1 drop · Fable 5 / Mythos 5

Closed weights only

BioMysteryBench human-solved

3 models compared.

Mythos 5 83.9%

Claude Mythos Preview 82.6%

Claude Opus 4.8 80.4%

3 models · 1 drop · Fable 5 / Mythos 5

Closed weights only

CyberGym Level 1 leaderboard

3 models compared.

Wiz Atlas 90.9%

MAI-Cyber-1-Flash 86.3%

Claude Mythos Preview 83.1%

3 models · 1 drop · MAI-Cyber-1-Flash

Closed weights only

DeepSearchQA

3 models compared.

GPT-5.6 Solmax 93.1%

Claude Opus 5max 90.4%

Muse Spark 1.3max 90.3%

3 models · 1 drop · Muse Spark 1.3

Closed weights only

Frontier Finance

3 models compared.

Fable 5.1max 60.8%

Claude Opus 5.5max 56.7%

GPT-6 Astramax 45%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

FrontierMath Tier 4

3 models compared.

GPT-6 Astra 97.6%

Fable 5.1 87.8%

GPT-5.6 Sol 83%

3 models · 1 drop · GPT-6 Astra

Closed weights only

MMMU-Pro

3 models compared.

Claude Opus 5.5max 87.7%

GPT-6 Astramax 86.9%

Fable 5.1max 86.3%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

MRCR 512K-1M

3 models compared.

Muse Spark 1.3max 98.1%

GPT-5.6 Solmax 73.8%

Muse Spark 1.2xhigh 55.5%

3 models · 1 drop · Muse Spark 1.3

Closed weights only

OfficeQA Pro v2

3 models compared.

Claude Opus 5.5max 62.2%

Fable 5.1max 54.5%

GPT-6 Astramax 54.4%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

OSWorld

3 models compared.

Claude Opus 5.5max 81.8%

Fable 5.1max 80.7%

GPT-6 Astramax 75.8%

3 models · 1 drop · Kimi K3.1 Pro

Closed weights only

AA-Omniscience

2 models compared.

Gemini 4 Carbon 54

Claude Opus 5.5 48

2 models · 1 drop · Gemini 4 Carbon

Closed weights only

Apex Bench v1.1

2 models compared.

Claude Opus 5 65.8%

GPT-5.6 Sol 54.3%

2 models · 1 drop · DeepSeek V4.1 Flash 1017

Closed weights only

Artifacts Bench

2 models compared.

Claude Haiku 4.5 36.6%

MAI-Code-1-Flash 36.4%

2 models · 1 drop · MAI-Code-1-Flash

Closed weights only

BankerToolBench

2 models compared.

Claude Opus 5 76.2

GPT-5.6 Sol 74.6

2 models · 1 drop · MiniMax M3.1 Flash

Closed weights only

SWE-bench Pro v2 Hard

2 models compared.

Claude Opus 5.5 100%

Fern 0.1 76.5%

2 models · 1 drop · Mirendil, "Introducing Fern"

Closed weights only

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

GPT-6 Astramax 70.5%

GPT-6.1 Solmax 69.5%

Gemini 4 Carbonhigh 69%

GPT-6.1 Terramax 68%

Claude Opus 5.5max 68%

Claude Sonnet 5.5max 59%

9 more

Muse Wonder Fullmax 56.5%

Gemini 4 Argonhigh 52.5%

Fable 5.1max 52.5%

Muse Wondermax 50.5%

Gemini 3.8 Flashhigh 46.5%

Claude Haiku 5.5max 43.5%

GPT-6 Lunamax 42.5%

Grok 4.7xhigh 33.5%

Qwen3.8-Max 29.5%

15 models · 0 drops · Artificial Analysis (2026-11-04)

Closed weights only

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Gemini 4 Carbonhigh 64.8%

GPT-6 Astramax 63.3%

Claude Opus 5.5max 59%

GPT-6.1 Solmax 58.1%

GPT-6.1 Terramax 57.6%

Claude Sonnet 5.5max 53.3%

9 more

Gemini 4 Argonhigh 52.9%

Fable 5.1max 43.3%

Muse Wonder Fullmax 37.1%

Muse Wondermax 25.7%

Claude Haiku 5.5max 20%

Qwen3.8-Max 11.9%

Grok 4.7xhigh 11.4%

Gemini 3.8 Flashhigh 10%

GPT-6 Lunamax 8.6%

15 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

5 May 2026

4 Jun 2026

6 Jul 2026

4 Aug 2026

9 Sep 2026

7 Oct 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.