The benchmark board

Every score from our Model Drops from the last 90 days on one board, since Aug 11, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

105benchmarks

78models scored

1132scores logged

27Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

DeepSWE v1.1

Best score rose 5 points, from 74% (Claude Opus 5) to 79% (Muse Wonder Full).

Terminal-Bench 4.0

Best score rose 18.8 points, from 51.8% (Claude Opus 5) to 70.6% (Claude Sonnet 5.5).

AutomationBench

Best score rose 11.9 points, from 50.3% (Claude Opus 5) to 62.2% (MiniMax M3.1 Flash).

Artificial Analysis Intelligence Index

Best score rose 39.8, from 18.2 (Qwen3.6 35B A3B) to 58 (Claude Opus 5.5).

GDPval-AA

Best score rose 123 Elo, from 1743 Elo (Claude Fable 5) to 1866 Elo (Claude Opus 5.5).

Terminal-Bench 2.1

Best score rose 45.5 points, from 44.4% (Qwen3.6 35B A3B) to 89.9% (MiMo-V2.6-Pro).

GPQA Diamond

Best score rose 12.7 points, from 83.4% (Qwen3.6 35B A3B) to 96.1% (GPT-6 Astra).

OSWorld 2

Best score rose 13.3 points, from 70.6% (Claude Opus 5) to 83.9% (Claude Sonnet 5.5).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

Claude Sonnet 5Claude Sonnet 5.5

Terminal-Bench 4.0: 10.3% to 70.6%

+60.3

Claude Haiku 4.5Claude Haiku 5.5

OSWorld 2 (offline subset): 15.7% to 72.4%

+56.7

GPT-5.6 TerraGPT-6.1 Terra

AA-Omniscience hallucination rate: 88% to 38%

+50

Muse Spark 1.2Muse Spark 1.3

MRCR 512K-1M: 55.5% to 98.1%

+42.6

Claude Opus 5Claude Opus 5.5

Terminal-Bench Science: 29% to 58.7%

+29.7

GPT-6 SolGPT-6.1 Sol

Terminal-Bench Science: 27.6% to 57%

+29.4

Fable 5Fable 5.1

Terminal-Bench Science: 24.7% to 52.6%

+27.9

Gemini 3.6 FlashGemini 3.7 Flash

ARC-AGI-2: 60.4% to 84.6%

+24.2

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

Grok 4.6 87

Gemini 4 Carbon 85.8

Claude Opus 5.5 85.2

DeepSeek V4.1 Flash 1017 83.9

Qwen3.8 83.6

GPT-6.1 Sol 80.9

21 more

GLM-5.3 78.4

Gemini 3.7 Flash 77.6

Nemotron 3.5 Lightning 77.3

GPT-6 Astra 73.8

Muse Spark 1.3 73.2

Claude Haiku 5.5 71.4

MiMo-V2.6-Pro 71.3

Fable 5.1 69.9

GPT-6.1 Terra 69.2

GPT-6 Luna 69

Nemotron 3.5 Super VL 68.2

Kimi K3.1 Pro 67.5

Claude Sonnet 5.5 65.4

Gemini 3.8 Flash 65.3

Gemini 4 Argon 61.6

MiniMax M3.1 Flash 61.1

GPT-6 Sol 55.4

Muse Spark Open 52.7

Mistral Large 4 49.4

Muse Wonder 37

Grok 4.7 33.4

27 models · 26 drops · Every model's sources, quotes and method

DeepSWE v1.1

Fixing issues in real repositories.

Muse Wonder Fullmax 79%

Muse Wondermax 78.8%

Gemini 4 Argonmax 77.9%

DeepSeek V4.1 Flash 1017max 77%

Kimi K3.1 Promax 75.5%

Muse Spark 1.3max 75.4%

35 more

GPT-6.1 Solhigh 75.2%

Claude Opus 5.5max 74.2%

DeepSeek V4.1 Flash 74.2%

GPT-6 Astramax 74.1%

Claude Opus 5 74%

Gemini 3.8 Flash 73.8%

MiniMax M3.1 Flash 73.7%

GPT-5.6 Sol 73%

Particle-1max 72.6%

MiMo-V2.6-Pro 71.9%

Grok 4.7high 71%

Fable 5xhigh 69.9%

Claude Fable 5 69.7%

GPT-5.6 Terramax 69.6%

GPT-6 Solmax 68.8%

Kimi K3 67.5%

Fable 5.1max 67.4%

GLM-5.3max 66.9%

GPT-6 Lunamax 66.6%

Nanbeige4.3-33Bmax 65.5%

Gemini 3.7 Flashhigh 65.3%

Grok 4.6high 65.2%

Mistral Large 4 62%

Muse Spark Openxhigh 60%

DeepSeek V4 Pro 0813 57%

Qwen3.8-2.4T-A95Bxhigh 57%

Muse Spark 1.2xhigh 55%

Grok 4.5high 54%

Claude Sonnet 5max 53.8%

Gemini 3.6 Flash 48.6%

Fern 0.1 44.2%

Qwen3.8max 42.5%

Muse Glimmer-30Bmax 4.4%

Nemotron 3 Ultra 3.5%

Gemma 4max 2.7%

41 models · 20 drops · Muse Wonder, Gemini 4 Argon, Kimi K3.1 Pro, GPT-6 Astra, GPT-6.1 Sol, MiniMax M3.1 Flash, Particle, "Introducing Particle-1", MiMo-V2.6-Pro, Grok 4.7, GPT-6 Sol & GPT-6 Luna, GLM-5.3, Gemini 3.8 Flash, Nanbeige4.3-33B model card, Muse Spark Open, Mistral Large 4, Muse Spark 1.3, Grok 4.6, Gemini 3.7 Flash, Mirendil, "Introducing Fern"

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Claude Sonnet 5.5max 70.6%

Claude Opus 5.5max 66.4%

Kimi K3.1 Promax 65.7%

Mythos 5.1 60.9%

GPT-6 Astramax 58.2%

Fable 5.1max 57.9%

31 more

Gemini 4 Argonmax 57.4%

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 55.9%

Muse Wondermax 52%

Claude Opus 5 51.8%

GPT-6.1 Terramax 50.3%

Hy4 44.4%

DeepSeek V4.1 Flash 1017max 42.3%

GLM-5.3max 41.8%

GPT-5.6 Sol 39.9%

Claude Haiku 5.5max 39.2%

LongCat-2.5 38.5%

MiniMax M3.1 Flash 38.1%

Grok 4.7xhigh 37.6%

MiMo-V2.6-Pro 34.9%

DeepSeek V4.1 Flash 31.2%

Mistral Large 4 28.3%

Nanbeige4.3-33Bmax 23.8%

GPT-5.6 Terramax 21.5%

Grok 4.6high 20.3%

Gemini 3.8 Flashmax 19.1%

GPT-6 Luna 16.4%

Kimi K3 12.6%

Claude Sonnet 5 10.3%

DeepSeek V4 Pro 0813 10%

Qwen3.8max 6.3%

Fern 0.1 6.1%

Muse Glimmer-30Bmax 1.6%

Claude Haiku 4.5 0%

Gemma 4max 0%

Nemotron 3 Ultra 0%

37 models · 19 drops · GPT-6.1 Terra, Kimi K3.1 Pro, GPT-6 Astra, Gemini 4 Argon, Muse Wonder, MiniMax M3.1 Flash, Tencent Hunyuan Hy4 launch post, Claude Haiku 5.5, Meituan LongCat-2.5 launch post, Grok 4.7, MiMo-V2.6-Pro, Mistral Large 4, Nanbeige4.3-33B model card, Gemini 3.8 Flash, Claude Sonnet 5.5, Mirendil, "Introducing Fern"

AutomationBench

Real business automations (Zapier).

MiniMax M3.1 Flash 62.2%

DeepSeek V4.1 Flash 1017 60.5%

Mistral Large 4 59.9%

DeepSeek V4 Pro 0813 56.7%

Hy4 56.2%

DeepSeek V4.1 Flash 54.8%

25 more

Nanbeige4.3-33Bmax 54.2%

MiMo-V2.6-Pro 53.1%

LongCat-2.5 51.8%

Gemini 4 Argonmax 51.3%

Claude Opus 5 50.3%

Muse Spark 1.3max 49.6%

GLM-5.3 48.8%

Kimi K3 46.7%

Claude Fable 5 46.2%

GPT-5.6 Sol 45.8%

Claude Sonnet 5.5max 44.7%

Claude Opus 5.5 42.5%

GPT-6 Astramax 41.4%

Qwen3.8max 38.3%

GPT-6.1 Solmax 36.1%

GPT-6 Sol 33.2%

Fable 5.1max 31.4%

Gemini 3.7 Flashhigh 30.4%

GPT-5.6 Terra 23.6%

GPT-6 Lunamax 20.7%

Gemini 3.6 Flash 17%

Muse Glimmer-30Bmax 15.2%

SenseNova-Loop-9B-Preview 13.7%

Claude Sonnet 5 10.7%

Gemma 4max 9.7%

31 models · 16 drops · MiniMax M3.1 Flash, Mistral Large 4, Tencent Hunyuan Hy4 launch post, Nanbeige4.3-33B model card, MiMo-V2.6-Pro, Meituan LongCat-2.5 launch post, Gemini 4 Argon, Muse Spark 1.3, GLM-5.3, Claude Sonnet 5.5, GPT-6.1 Sol, Gemini 3.7 Flash, GPT-6 Sol & GPT-6 Luna, SenseNova-Loop-9B-Preview model card

Artificial Analysis Intelligence Index

45 models compared.

Claude Opus 5.5 58

Claude Sonnet 5.5max 56

Muse Wonder Fullmax 55.8

Kimi K3.1 Pro 55

GPT-6 Astra 53

Fable 5.1 53

39 more

Gemini 4 Argonhigh 53

Muse Wondermax 52.4

GPT-6.1 Solmax 52

Claude Opus 5 50.8

Claude Fable 5 49.6

Muse Spark 1.3 48.1

GPT-6.1 Terramax 48

GPT-5.6 Sol 47

MiMo-V2.6-Pro 46.3

Grok 4.7 46

DeepSeek V4.1 Flash 1017 45.1

GLM-5.3 44.8

Grok 4.6 44

Kimi K3 44

Claude Haiku 5.5max 43

MiniMax M3.1 Flash 42.7

GPT-5.6 Terramax 42

Gemini 3.8 Flash 40.9

Qwen3.8-Max 40.2

Qwen3.8-2.4T-A95B 39.9

Muse Spark 1.2xhigh 39.6

DeepSeek V4.1 Flash 39.5

Gemini 3.7 Flash 39.1

Muse Spark Open 38.9

Grok 4.5 38.8

Mistral Large 4 38.4

Claude Sonnet 5max 38.2

GPT-6 Lunamax 38

DeepSeek V4 Pro 0813 36

Qwen3.8 33.7

GLM-5.2 33.7

DeepSeek V4 Pro 30.4

Qwen3.6-27B 21.4

Qwen3.6 35B A3B 18.2

Muse Glimmer-30B 17.5

Gemma 4 26B A4B 16.7

Nemotron 3.5 Lightning 12.9

gpt-oss-20bhigh 9

Nemotron 3 Nano 8.9

45 models · 15 drops · Kimi K3.1 Pro, GPT-6.1 Terra, Muse Wonder, DeepSeek V4.1 Flash 1017, Grok 4.6, Muse Spark 1.3, Grok 4.7, Muse Spark Open, Gemini 3.8 Flash, GLM-5.3, Gemini 3.7 Flash, Mistral Large 4, Qwen3.8, Nemotron 3.5 Lightning

GDPval-AA

Professional work products, graded head to head (Elo).

Claude Opus 5.5max 1866 Elo

Muse Wonder Fullmax 1857 Elo

Kimi K3.1 Promax 1846 Elo

Claude Sonnet 5.5 1838 Elo

Muse Wondermax 1770 Elo

GLM-5.3 1769 Elo

25 more

Fable 5.1max 1754 Elo

Muse Spark 1.3max 1754 Elo

DeepSeek V4.1 Flash 1017max 1746 Elo

Claude Fable 5 1743 Elo

Claude Opus 5 1708 Elo

Grok 4.7xhigh 1695 Elo

MiMo-V2.6-Pro 1673 Elo

Claude Haiku 5.5max 1620 Elo

Muse Spark 1.2xhigh 1615 Elo

Qwen3.8-2.4T-A95Bxhigh 1613 Elo

Grok 4.6high 1605 Elo

GPT-5.6 Sol 1588 Elo

GPT-6 Astramax 1573 Elo

Gemini 3.8 Flashmax 1545 Elo

Kimi K3max 1537 Elo

GPT-5.6 Terramax 1528 Elo

Grok 4.5high 1526 Elo

Gemini 3.7 Flashhigh 1525 Elo

GPT-6 Sol 1487 Elo

Claude Sonnet 5 1449 Elo

GPT-6 Luna 1437 Elo

Mistral Large 4 1424 Elo

Gemini 3.6 Flash 1422 Elo

Muse Spark Openxhigh 1401 Elo

Claude Haiku 4.5 735 Elo

31 models · 14 drops · Kimi K3.1 Pro, Muse Wonder, GLM-5.3, Muse Spark 1.3, Claude Opus 5.5, Grok 4.7, MiMo-V2.6-Pro, Claude Haiku 5.5, Muse Spark Open, Gemini 3.8 Flash, Grok 4.6, Gemini 3.7 Flash, Claude Sonnet 5.5

Terminal-Bench 2.1

31 models compared.

MiMo-V2.6-Pro 89.9%

Gemini 3.8 Flashmax 89.4%

Claude Opus 5 89.1%

GPT-5.6 Solmax 88.8%

Muse Spark 1.3max 88.8%

LongCat-2.5 88.4%

25 more

GPT-5.6 Terramax 87.4%

Gemini 3.7 Flashhigh 85.8%

Kimi K3max 85%

GLM-5.3max 83.9%

Muse Spark 1.2xhigh 82.9%

Qwen3.8-2.4T-A95Bxhigh 82%

Nanbeige4.3-33Bmax 80.9%

Claude Sonnet 5max 80.4%

Particle-1max 79.9%

Claude Opus 4.6max 78.2%

Gemini 3.6 Flash 78%

Muse Spark Openxhigh 76.4%

Qwen3.8max 73%

Qwen3.7-Plusmax 64%

Qwen3.6-27Bmax 63.4%

Muse Glimmer-30Bmax 51.7%

Clover-35B-A3B-Preview 51.7%

Gemma 4max 47.2%

Qwen3.6 35B A3B 44.4%

SenseNova-Loop-9B-Preview 40.5%

Gemma 4 26B A4B 37.2%

Nemotron 3.5 Lightning 24.6%

gpt-oss-20b 15.2%

LFM3-1.7B 12.9%

Nemotron 3 Nano 8.3%

31 models · 13 drops · MiMo-V2.6-Pro, Gemini 3.8 Flash, Muse Spark 1.3, Meituan LongCat-2.5 launch post, Gemini 3.7 Flash, Muse Spark Open, Nanbeige4.3-33B model card, Particle, "Introducing Particle-1", Qwen3.8, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, SenseNova-Loop-9B-Preview model card, Liquid AI, "Introducing LFM3"

GPQA Diamond

32 models compared.

GPT-6 Astramax 96.1%

Kimi K3.1 Promax 94.2%

Claude Opus 5.5max 93.9%

Fable 5.1max 93.7%

Qwen3.8-2.4T-A95Bxhigh 93.5%

Kimi K3max 93.5%

26 more

GPT-5.4 92.8%

Qwen3.8-Flash-Next 92.7%

DeepSeek V4.1 Flash 1017max 92.2%

GLM-5.3max 91.7%

Claude Opus 4.6max 91.3%

Gemma 4max 91.3%

Particle-1 90.4%

Qwen3.7-Plusmax 90.3%

Claude Sonnet 4.6max 89.9%

Nemotron 3.5 Super VL 89.5%

Nanbeige4.3-33Bmax 89.5%

Qwen3.8max 89.2%

Muse Spark Openxhigh 89%

Qwen3.6-27Bmax 87.8%

Nemotron 3 Ultra 87%

Qwen3.5-122B-A10B 86.7%

MAI-Thinking-1 84.2%

Clover-35B-A3B-Preview 83.8%

Muse Glimmer-30Bmax 83.5%

Qwen3.6 35B A3B 83.4%

DeepSeek V3.2 82.4%

Gemma 4 26B A4B 79.6%

Nemotron 3.5 Lightning 75.4%

Nemotron 3 Nano 74.1%

gpt-oss-20b 71.5%

LFM3-1.7B 63.4%

32 models · 10 drops · Kimi K3.1 Pro, Muse Spark Open, MAI-Thinking-1, Nemotron 3.5 Super VL, Qwen3.8, Nanbeige4.3-33B model card, Particle, "Introducing Particle-1", DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Claude Opus 5.5 64.4%

Fable 5 57.8%

Fable 5.1max 57.6%

Claude Sonnet 5.5 56.9%

Claude Opus 5 56.3%

GPT-6 Astramax 53.6%

14 more

Kimi K3.1 Promax 51.1%

Claude Haiku 5.5max 45.9%

Claude Opus 4.8max 45.7%

GPT-5.6 Sol 44.5%

Qwen3.8max 43.6%

Kimi K3 43.5%

DeepSeek V4.1 Flash 1017 42.6%

Qwen3.8-Flash-Next 39.6%

DeepSeek V4.1 Flash 36.8%

Nemotron 3.5 Super VL 31.8%

Nemotron 3 Ultra 29.2%

Qwen3.5-122B-A10B 24.2%

Claude Haiku 4.5 10.2%

LFM3-1.7B 7.2%

20 models · 8 drops · Claude Opus 5.5, Fable 5.1, Kimi K3.1 Pro, Claude Haiku 5.5, DeepSeek V4.1 Flash 1017, Qwen3.8, Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

OSWorld 2

Using a computer: apps, files and the web.

Claude Sonnet 5.5max 83.9%

Claude Opus 5.5 81.8%

Hy4 78.9%

GPT-6.1 Solmax 78%

GPT-6.1 Terramax 74.2%

GPT-6 Astra 72.6%

10 more

Claude Opus 5 70.6%

Muse Spark 1.3max 66.9%

GPT-5.6 Sol 65.7%

MiniMax M3.1 Flash 61.7%

Gemini 3.8 Flashmax 59%

Kimi K3 58.3%

GPT-5.6 Terramax 57.1%

Claude Sonnet 5 57%

GPT-6 Lunamax 55.5%

DeepSeek V4.1 Flash 54.3%

16 models · 8 drops · GPT-6.1 Terra, Claude Sonnet 5.5, Tencent Hunyuan Hy4 launch post, GPT-6 Astra, MiniMax M3.1 Flash, Muse Spark 1.3, Gemini 3.8 Flash

Harvey Legal Agent Benchmark

Legal work end to end.

Kimi K3.1 Promax 23.7%

DeepSeek V4.1 Flash 1017max 21%

Grok 4.7xhigh 19.6%

Gemini 4 Argonmax 19.6%

Fable 5.1max 19.1%

Grok 4.6high 15.8%

15 more

Mistral Large 4 15.8%

Muse Wonder Fullmax 13.1%

Grok 4.5high 12.9%

Kimi K3 12.9%

Claude Fable 5max 11.3%

Qwen3.8 Max 10.4%

Gemini 3.8 Flashmax 10%

Muse Wondermax 10%

GPT-6 Astramax 8.6%

GLM-5.3 8.3%

Claude Opus 5max 6.7%

Claude Sonnet 5max 5%

Claude Opus 5.5max 4.2%

GPT-5.6 Solmax 2.5%

GPT-5.6 Terramax 0.8%

21 models · 7 drops · Kimi K3.1 Pro, Grok 4.7, Gemini 4 Argon, Mistral Large 4, Muse Wonder, Grok 4.6, Gemini 3.8 Flash

SWE-bench Verified

17 models compared.

GPT-6 Astra 86%

Claude Opus 4.6 80.8%

Claude Sonnet 4.6max 79.6%

GLM-5.3-Flash 79.1%

Nemotron 3 Ultra 73.9%

Clover-35B-A3B-Preview 73.6%

11 more

MAI-Thinking-1 73.5%

Fern 0.1 73.4%

DeepSeek V3.2 73.1%

Qwen3.5-122B-A10B 71.9%

Nemotron 3.5 Super VL 71.1%

Qwen3.6 35B A3B 70.1%

Gemma 4 26B A4B 57.4%

gpt-oss-20b 52.4%

Nemotron 3.5 Lightning 51.6%

LFM3-1.7B 43.4%

Nemotron 3 Nano 34.1%

17 models · 6 drops · Mirendil, "Introducing Fern", MAI-Thinking-1, Nemotron 3.5 Super VL, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

Terminal-Bench Science

Scientific computing tasks in a terminal.

GPT-6 Astramax 68.1%

Claude Opus 5.5max 63.3%

GPT-6.1 Terramax 58.3%

GPT-6.1 Solmax 57%

Fable 5.1max 40%

Kimi K3.1 Promax 38.1%

7 more

Claude Opus 5 29%

GPT-6 Sol 27.6%

Fable 5 24.7%

GPT-5.6 Sol 22.4%

Hy4 19.8%

DeepSeek V4.1 Flashmax 15.7%

GLM-5.3max 8.1%

13 models · 6 drops · GPT-6.1 Terra, Kimi K3.1 Pro, Claude Opus 5.5, GPT-6.1 Sol, Fable 5.1, Tencent Hunyuan Hy4 launch post

ProgramBench

14 models compared.

Claude Opus 5.5max 65%

Muse Wonder Fullmax 59%

Fable 5.1max 53.5%

Muse Wondermax 50%

GPT-6 Astramax 50%

Claude Opus 5 37%

8 more

Kimi K3.1 Promax 31.5%

Hy4 30%

DeepSeek V4.1 Flash 1017 29.1%

LongCat-2.5 25.5%

GPT-5.6 Sol 23%

DeepSeek V4.1 Flash 20.3%

GLM-5.3max 19%

Kimi K3 17.5%

14 models · 5 drops · Kimi K3.1 Pro, Muse Wonder, DeepSeek V4.1 Flash 1017, Tencent Hunyuan Hy4 launch post, Meituan LongCat-2.5 launch post

AA-LCR

33 models compared.

MiMo-V2.6-Pro 86.3%

Kimi K3.1 Pro 86.3%

Fable 5.1max 85.3%

Claude Opus 5.5max 84.7%

Nanbeige4.3-33Bmax 84%

Muse Wonder Fullmax 83.7%

27 more

Muse Glimmer-30Bmax 83.3%

GPT-6 Lunamax 83.3%

GPT-6.1 Solmax 83%

GPT-6.1 Terramax 82.7%

DeepSeek V4.1 Flash 1017max 82.7%

Claude Sonnet 5.5max 82.7%

Claude Haiku 5.5max 82.7%

Ling-3.1-flash-1019 82.3%

Qwen3.8xhigh 82%

Gemini 3.8 Flashhigh 81.3%

Muse Wondermax 80.7%

GPT-6 Astramax 80.7%

MiniMax M3.1 Flash 79.7%

Gemini 4 Argonhigh 79.7%

GLM-5.3max 79.7%

Gemini 4 Carbonhigh 79.3%

Muse Spark Openxhigh 78.3%

Grok 4.7xhigh 76.7%

Gemma 4max 72%

Clover-35B-A3B-Preview 72%

Nemotron 3.5 Super VL 69%

Qwen3.6 35B A3B 61.1%

Gemma 4 26B A4B 57.6%

LFM3-1.7B 52.8%

Nemotron 3.5 Lightning 52%

gpt-oss-20b 32.9%

Nemotron 3 Nano 32.8%

33 models · 4 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

SWE-bench Pro

17 models compared.

Fable 5max 80%

Claude Opus 4.8max 69.2%

GPT-5.6 Solmax 64.6%

Qwen3.8max 61.7%

Qwen3.8-Flash-Next 60.4%

Nanbeige4.3-33Bmax 60.3%

11 more

GLM-5.3-Flash 59.7%

Kimi K2.6 58.6%

GPT-5.4 57.7%

Qwen3.7-Plusmax 57.6%

Qwen3.6-27Bmax 53.5%

Claude Opus 4.6max 53.4%

MAI-Thinking-1 52.8%

Nemotron 3.5 Super VL 51.8%

Muse Glimmer-30Bmax 51.2%

Gemma 4max 51.2%

Nemotron 3 Ultra 49.7%

17 models · 4 drops · Qwen3.8, Nemotron 3.5 Super VL, Nanbeige4.3-33B model card, MAI-Thinking-1

OSWorld 2 (offline subset)

Using a computer, on the 82 OSWorld 2.1 tasks that need no internet.

Claude Opus 5.5max 87.2%

Claude Sonnet 5.5 83.9%

Gemini 4 Carbonmax 81.5%

GPT-6 Astramax 80.9%

Fable 5.1max 76.8%

Gemini 4 Argonmax 74.7%

7 more

Claude Haiku 5.5max 72.4%

GPT-6.1 Solmax 71.4%

Claude Opus 5max 70.2%

GPT-5.6 Sol 65.7%

GPT-6 Solmax 64.4%

GPT-6 Luna 48.9%

Claude Haiku 4.5 15.7%

13 models · 4 drops · Gemini 4 Carbon, Claude Haiku 5.5, GPT-6.1 Sol, GPT-6 Sol & GPT-6 Luna

Agents' Last Exam

11 models compared.

Kimi K3.1 Promax 43.2%

Claude Opus 5.5max 42.6%

Hy4 41%

DeepSeek V4.1 Flash 1017 35.4%

GPT-6 Astramax 32.8%

Claude Opus 5 32.2%

5 more

DeepSeek V4.1 Flash 31.8%

GPT-5.6 Sol 30.6%

MiniMax M3.1 Flash 29.6%

Kimi K3 28.3%

GLM-5.3max 26.2%

11 models · 4 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Kimi K3.1 Promax 70%

Claude Opus 5.5 67.7%

Fable 5.1max 65.6%

GPT-5.6 Sol 64.5%

Claude Fable 5 63.9%

Claude Opus 5 63.6%

5 more

GLM-5.3 62.5%

Kimi K3 59.8%

DeepSeek V4.1 Flash 1017max 58.8%

GPT-6 Astramax 57.2%

LFM3-1.7B 13.9%

11 models · 4 drops · Kimi K3.1 Pro, Claude Opus 5.5, GLM-5.3, Liquid AI, "Introducing LFM3"

JobBench

11 models compared.

Claude Opus 5max 65.7%

Muse Spark 1.3max 64.9%

MiMo-V2.6-Pro 62%

Muse Spark Openxhigh 61.8%

GLM-5.3max 61.4%

Kimi K3max 54.3%

5 more

Qwen3.8-2.4T-A95Bxhigh 52.7%

GPT-5.6 Solmax 45.4%

Nanbeige4.3-33Bmax 44.8%

Qwen3.8max 34.5%

Gemma 4max 9%

11 models · 4 drops · MiMo-V2.6-Pro, Muse Spark 1.3, Muse Spark Open, Nanbeige4.3-33B model card

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Kimi K3.1 Pro 67.2%

Gemini 4 Carbonhigh 65.2%

Claude Sonnet 5.5max 63.6%

Claude Opus 5.5max 59.6%

GPT-6 Astramax 59.1%

Gemini 4 Argonhigh 57.1%

21 more

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 56.1%

GPT-6.1 Terramax 55.6%

Fable 5.1max 52%

Muse Wondermax 52%

GLM-5.3max 41.9%

MiMo-V2.6-Pro 34.8%

DeepSeek V4.1 Flash 1017max 33.8%

Ling-3.1-flash-1019 32.8%

Claude Haiku 5.5max 32.8%

DeepSeek V4.1 Flash 27%

Grok 4.7xhigh 25.8%

MiniMax M3.1 Flash 25.8%

Mistral Large 4high 24.7%

Gemini 3.8 Flashhigh 19.7%

Kimi K3 17.2%

DeepSeek V4 Pro 0813 14.1%

GPT-6 Lunamax 12.6%

Muse Spark Openxhigh 8.1%

Qwen3.8xhigh 5.6%

Nemotron 3.5 Super VL 0%

27 models · 3 drops · Artificial Analysis (2026-11-04), Grok 4.7, Mistral Large 4

GDP.pdf

Work products built from PDFs (Surge AI).

Kimi K3.1 Promax 34.6%

GPT-6 Astramax 34.2%

Gemini 3.7 Flashhigh 34%

GPT-6.1 Solhigh 32%

Claude Opus 5.5max 30.6%

Claude Sonnet 5 28%

7 more

GPT-6 Sol 28%

Fable 5.1max 27.6%

GPT-5.6 Terra 24.7%

Gemini 3.6 Flash 22%

DeepSeek V4.1 Flash 1017max 17.2%

Muse Spark 1.2 16%

GLM-5.3max 11.2%

13 models · 3 drops · Kimi K3.1 Pro, Gemini 3.7 Flash, GPT-6.1 Sol

Terminal-Bench 3.0

11 models compared.

Claude Opus 5 43.5%

GPT-5.6 Solmax 34.6%

Claude Fable 5 33.7%

GLM-5.3 28.3%

Grok 4.6high 26%

GPT-5.6 Terra 20.8%

5 more

Kimi K3 17.4%

Grok 4.5high 15.7%

Gemini 3.7 Flashhigh 14.9%

Claude Sonnet 5 14.6%

Gemini 3.6 Flash 5.4%

11 models · 3 drops · Grok 4.6, GLM-5.3, Gemini 3.7 Flash

AA-Omniscience hallucination rate

Lower is better.

Muse Wonder Fullmax 23%

Muse Wondermax 26.5%

Grok 4.7 29%

Grok 4.6 34%

GPT-6.1 Terra 38%

Claude Sonnet 5.5 47%

4 more

GPT-6 Astra 51.3%

Claude Opus 5.5 58.6%

Fable 5.1 72.6%

GPT-5.6 Terra 88%

10 models · 3 drops · Muse Wonder, Grok 4.7, GPT-6.1 Terra

BabyVision (with tools)

10 models compared.

Claude Opus 5.5max 97.7%

GPT-6 Astramax 96.6%

Kimi K3.1 Promax 95.4%

Fable 5.1max 95.1%

Claude Opus 5 94.1%

DeepSeek V4.1 Flash 1017 92.5%

4 more

DeepSeek V4.1 Flash 89.6%

Particle-1 89.2%

GPT-5.6 Sol 88.9%

Kimi K3 85.7%

10 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Particle, "Introducing Particle-1"

NL2Repo

10 models compared.

Claude Opus 5 75.3%

DeepSeek V4.1 Flash 1017 68.2%

DeepSeek V4.1 Flash 65.4%

MiniMax M3.1 Flash 61.2%

Kimi K3 58%

GLM-5.3 58%

4 more

GPT-5.6 Sol 56.8%

Nanbeige4.3-33Bmax 53%

Qwen3.8max 48.3%

Muse Glimmer-30Bmax 27.4%

10 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

ZeroBench (with tools)

10 models compared.

Kimi K3.1 Promax 63%

Claude Opus 5.5max 61%

Fable 5.1max 59%

GPT-6 Astramax 58%

GPT-5.6 Sol 53%

Claude Opus 5 52%

4 more

DeepSeek V4.1 Flash 1017 51%

Muse Spark Openxhigh 50%

DeepSeek V4.1 Flash 49%

Kimi K3max 41%

10 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open

ARC-AGI-2

9 models compared.

GPT-5.6 Sol 92.5%

Claude Opus 5 90.4%

Claude Fable 5 89.2%

Gemini 3.8 Flash 89.2%

Gemini 3.7 Flash 84.6%

GPT-5.6 Terramax 83.9%

3 more

Grok 4.6 65.1%

Gemini 3.6 Flashhigh 60.4%

Grok 4.5 52.6%

9 models · 3 drops · Grok 4.6, Gemini 3.8 Flash, Gemini 3.7 Flash

FrontierCode v1.1

Hard, long coding tasks.

Claude Opus 5.5 54.4%

GPT-6 Astra 53.3%

Claude Sonnet 5.5xhigh 52.1%

Fable 5.1 50.3%

GPT-6 Sol 49.3%

Claude Opus 5 48%

3 more

Claude Haiku 5.5max 46.4%

Claude Sonnet 5 42.4%

GPT-6 Luna 42.4%

9 models · 3 drops · Claude Sonnet 5.5, Claude Opus 5.5, Claude Haiku 5.5

BrowseComp

8 models compared.

Kimi K3.1 Promax 92.1%

LongCat-2.5 91.9%

GPT-6 Astramax 91.5%

Claude Opus 5.5max 90.8%

Qwen3.6 35B A3B 48.7%

Nemotron 3.5 Lightning 37%

2 more

Gemma 4 26B A4B 26.3%

Nemotron 3 Nano 13.7%

8 models · 3 drops · Kimi K3.1 Pro, Meituan LongCat-2.5 launch post, Nemotron 3.5 Lightning

SciCode

6 models compared.

Ling-3.1-flash-1019 57%

Nanbeige4.3-33Bmax 52.6%

Qwen3.8max 46.7%

Gemma 4max 45.5%

Muse Glimmer-30Bmax 44.9%

LFM3-1.7B 28.5%

6 models · 3 drops · Ling-3.1-flash-1019 model card, Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Tau3-Bench

6 models compared.

LFM3-1.7B 68%

Clover-35B-A3B-Preview 65.3%

Nanbeige4.3-33Bmax 48.8%

Qwen3.8max 48.5%

Muse Glimmer-30Bmax 33.7%

Gemma 4max 18.6%

6 models · 3 drops · Liquid AI, "Introducing LFM3", DiffuSpace, "Clover-35B-A3B-Preview", Nanbeige4.3-33B model card

AA-Briefcase v1.1

26 models compared.

Claude Sonnet 5.5max 1813 Elo

Claude Opus 5.5max 1800 Elo

Muse Wonder Fullmax 1729 Elo

Kimi K3.1 Pro 1675 Elo

Fable 5.1max 1669 Elo

Muse Wondermax 1659 Elo

20 more

Grok 4.7xhigh 1637 Elo

Gemini 4 Carbonhigh 1610 Elo

Claude Haiku 5.5max 1574 Elo

DeepSeek V4.1 Flash 1017max 1570 Elo

GPT-6 Astramax 1569 Elo

GPT-6.1 Solmax 1555 Elo

Grok 4.6high 1546 Elo

Ling-3.1-flash-1019 1522 Elo

MiMo-V2.6-Pro 1512 Elo

GLM-5.3max 1503 Elo

GPT-5.6 Solmax 1487 Elo

Gemini 4 Argonhigh 1484 Elo

MiniMax M3.1 Flash 1475 Elo

GPT-6.1 Terramax 1401 Elo

Qwen3.8xhigh 1393 Elo

Mistral Large 4high 1348 Elo

GPT-6 Lunamax 1337 Elo

Muse Spark Openxhigh 1278 Elo

Gemini 3.8 Flashhigh 1203 Elo

Nemotron 3.5 Super VL 999 Elo

26 models · 2 drops · Artificial Analysis (2026-11-04), Grok 4.7

AutomationBench-AA

Business automations, run by Artificial Analysis.

Gemini 4 Carbonhigh 77.8%

Gemini 4 Argonhigh 77.5%

Kimi K3.1 Pro 73.3%

MiniMax M3.1 Flash 72.5%

Claude Sonnet 5.5max 71.8%

Muse Wonder Fullmax 71.3%

18 more

Claude Opus 5.5max 69.5%

GPT-6 Astramax 68.5%

Muse Wondermax 68.1%

Ling-3.1-flash-1019 67.5%

DeepSeek V4.1 Flash 1017max 66.6%

Grok 4.7xhigh 65.6%

GPT-6.1 Solmax 64.9%

GLM-5.3max 62.2%

GPT-6.1 Terramax 60.2%

Gemini 3.8 Flashhigh 59.9%

Fable 5.1max 59.4%

MiMo-V2.6-Pro 58.6%

Mistral Large 4high 57.8%

GPT-6 Lunamax 53.2%

Muse Spark Openxhigh 49.7%

Qwen3.8xhigh 48.2%

Claude Haiku 5.5max 35.4%

Nemotron 3.5 Super VL 14.8%

24 models · 2 drops · Artificial Analysis (2026-11-04)

APEX-Agents

11 models compared.

Claude Opus 5.5max 73.5%

Fable 5.1max 68.6%

Kimi K3.1 Promax 67.2%

GPT-6 Astramax 64.7%

DeepSeek V4.1 Flash 1017max 63.4%

Claude Opus 5 60.6%

5 more

Claude Fable 5max 59.2%

Grok 4.6high 57.5%

GPT-5.6 Solmax 56.7%

GLM-5.3max 56.6%

Grok 4.5high 47.1%

11 models · 2 drops · Kimi K3.1 Pro, Grok 4.6

Agents' Last Exam v1

9 models compared.

Claude Opus 5.5max 63.2%

GPT-6.1 Terramax 60%

GPT-6 Astramax 59.3%

GPT-6.1 Solmax 58.6%

GPT-6 Solmax 56.4%

GPT-5.6 Solmax 52.8%

3 more

Claude Opus 5max 52.7%

GPT-6 Lunamax 50.9%

GPT-5.6 Terramax 50.7%

9 models · 2 drops · GPT-6.1 Terra, GPT-6 Sol & GPT-6 Luna

Chartography (with tools)

9 models compared.

GPT-6 Astramax 91%

Kimi K3.1 Promax 90.2%

Claude Opus 5.5max 89%

Fable 5.1max 88.4%

Claude Opus 5 84%

DeepSeek V4.1 Flash 1017 83%

3 more

GPT-5.6 Sol 79.9%

DeepSeek V4.1 Flash 78.9%

Kimi K3 68.1%

9 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

OSWorld-Verified

Using a computer: apps, files and the web (2025 edition).

Kimi K3 84.8%

Qwen3.8max 84.3%

Claude Opus 5 83.4%

GPT-5.6 Sol 83%

MiMo-V2.6-Pro 82%

Qwen3.7-Plusmax 73.3%

3 more

Claude Opus 4.6max 72.7%

Muse Glimmer-30Bmax 65.9%

Qwen3.6-27Bmax 63.9%

9 models · 2 drops · MiMo-V2.6-Pro, Qwen3.8

Agents' Last Exam (CLI)

8 models compared.

Kimi K3.1 Promax 44.2%

Claude Opus 5.5max 40.7%

GPT-6 Astramax 38.8%

DeepSeek V4.1 Flash 1017max 36%

GPT-5.6 Sol 28.6%

GLM-5.3 28.5%

2 more

Kimi K3 27.6%

Claude Fable 5 23.8%

8 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

CharXiv Reasoning

8 models compared.

GPT-5.6 Terra 85.9%

Gemini 3.6 Flash 85.2%

Gemini 3.7 Flashhigh 84.5%

Qwen3.5-122B-A10B 83.5%

GLM-5.3-Flash 81.9%

Nemotron 3.5 Super VL 80.8%

2 more

Inkling Small 77.8%

Claude Sonnet 5 77%

8 models · 2 drops · Gemini 3.7 Flash, Nemotron 3.5 Super VL

ExploitBench

8 models compared.

GPT-6 Astramax 100%

Claude Opus 5.5max 91%

Fable 5.1max 83%

Claude Mythos 5 78%

GPT-5.6 Sol 76.5%

Kimi K3.1 Promax 74.7%

2 more

GLM-5.3 54.4%

Kimi K3 32.2%

8 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

SWE-Marathon

8 models compared.

Muse Wonder Fullxhigh 57.5%

Muse Wondermax 53.1%

Kimi K3.1 Promax 51.7%

Claude Opus 5.5max 46.3%

Fable 5.1max 45.6%

GPT-6 Astramax 42.5%

2 more

GLM-5.3max 42.5%

DeepSeek V4.1 Flash 1017max 40%

8 models · 2 drops · Muse Wonder, Kimi K3.1 Pro

Toolathlon-Verified

8 models compared.

Claude Opus 5 80.6%

MiMo-V2.6-Pro 76.9%

Kimi K3 76.5%

GPT-5.6 Sol 74.9%

Nanbeige4.3-33Bmax 70.4%

Qwen3.8max 68.5%

2 more

Muse Glimmer-30Bmax 47.2%

Gemma 4max 27.8%

8 models · 2 drops · MiMo-V2.6-Pro, Nanbeige4.3-33B model card

Vals Index

8 models compared.

Gemini 4 Argonmax 68.9%

Claude Opus 5.5 67%

Fable 5.1 65.8%

GPT-6 Astra 63.1%

GLM-5.3 53.5%

Kimi K3 50.3%

2 more

Mistral Large 4 48.1%

DeepSeek V4 Pro 0813 47.6%

8 models · 2 drops · Gemini 4 Argon, Mistral Large 4

HLE-Verified

7 models compared.

Gemini 3.8 Flashmax 54.9%

GPT-5.6 Solmax 54.5%

Claude Opus 5max 54.4%

Gemini 3.7 Flashhigh 53.6%

Gemini 3.6 Flash 51.2%

GPT-5.6 Terramax 51.1%

1 more

Claude Sonnet 5max 31%

7 models · 2 drops · Gemini 3.8 Flash, Gemini 3.7 Flash

AA-Briefcase

6 models compared.

Claude Opus 5 1715 Elo

Grok 4.6high 1577 Elo

Claude Fable 5max 1574 Elo

Ling-3.1-flash-1019 1524 Elo

GPT-5.6 Solmax 1502 Elo

Grok 4.5high 1313 Elo

6 models · 2 drops · Grok 4.6, Ling-3.1-flash-1019 model card

CursorBench 4.0

Long coding tasks inside Cursor.

Claude Opus 5.5 57.8%

Fable 5.1max 51.8%

Claude Opus 5 46.6%

Grok 4.7xhigh 46.3%

GPT-5.6 Solmax 41.7%

Grok 4.6high 40.4%

6 models · 2 drops · Claude Opus 5.5, Grok 4.7

SWE-Atlas-QnA

6 models compared.

Fern 0.1 53.2%

Nanbeige4.3-33Bmax 50.8%

Qwen3.8max 41.9%

Muse Glimmer-30Bmax 17.7%

Nemotron 3 Ultra 16.1%

Gemma 4max 3.3%

6 models · 2 drops · Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Artificial Analysis Coding Agent Index

5 models compared.

Claude Opus 5.5 62

Gemini 4 Carbon 59

Grok 4.7 56

Gemini 4 Argon 53

Grok 4.6 47

5 models · 2 drops · Gemini 4 Carbon, Grok 4.7

CyberGym

5 models compared.

GLM-5.3 84.5%

Claude Mythos 5 83.8%

GPT-5.6 Sol 83.6%

MiniMax M3.1 Flash 82.2%

Kimi K3 80%

5 models · 2 drops · MiniMax M3.1 Flash, GLM-5.3

EnterpriseOps-Gym

5 models compared.

Nanbeige4.3-33Bmax 41%

Qwen3.8max 40.2%

Muse Glimmer-30Bmax 30.5%

LFM3-1.7B 28.2%

Gemma 4max 27.3%

5 models · 2 drops · Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

FrontierSWE v2

Frontier software engineering tasks.

GPT-6 Astramax 65.5%

Claude Opus 5.5max 62.3%

Gemini 4 Carbonmax 61.2%

Fable 5.1max 56.3%

Gemini 4 Argonmax 55%

5 models · 2 drops · Gemini 4 Carbon

IFBench

5 models compared.

Nemotron 3 Ultra 82.9%

LFM3-1.7B 73%

Nemotron 3.5 Super VL 70.9%

Qwen3.5-122B-A10B 67.6%

GLM-5.3-Flash 57.7%

5 models · 2 drops · Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

LiveCodeBench

5 models compared.

DeepSeek V4 93.5%

Kimi K2.6 89.6%

MAI-Thinking-1 87.7%

DeepSeek V3.2 83.3%

LFM3-1.7B 73.5%

5 models · 2 drops · MAI-Thinking-1, Liquid AI, "Introducing LFM3"

MCP Atlas

5 models compared.

Muse Spark Openxhigh 89.2%

Qwen3.8-2.4T-A95Bxhigh 84.5%

GLM-5.3max 84.2%

Kimi K3max 82.3%

LFM3-1.7B 32.6%

5 models · 2 drops · Muse Spark Open, Liquid AI, "Introducing LFM3"

MMLU-Pro

3 models compared.

Claude Sonnet 4.6max 87%

MAI-Thinking-1 85%

Clover-35B-A3B-Preview 84.8%

3 models · 2 drops · MAI-Thinking-1, DiffuSpace, "Clover-35B-A3B-Preview"

From a single launch

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Claude Opus 5.5max 46.4%

GPT-6 Astramax 42.4%

GPT-6.1 Terramax 42.3%

Claude Sonnet 5.5max 41.7%

Gemini 4 Carbonhigh 40.6%

GPT-6.1 Solmax 40.6%

19 more

Muse Wonder Fullmax 37.8%

Claude Haiku 5.5max 34.9%

Fable 5.1max 31.6%

Hy4 31%

Grok 4.7xhigh 28.7%

DeepSeek V4.1 Flash 1017max 28.5%

Muse Wondermax 27.9%

Gemini 4 Argonhigh 25.7%

Kimi K3.1 Pro 25.5%

GPT-6 Lunamax 25.2%

MiMo-V2.6-Pro 24%

GLM-5.3max 21.6%

MiniMax M3.1 Flash 20.8%

Gemini 3.8 Flashhigh 18.7%

Ling-3.1-flash-1019 17%

Mistral Large 4high 15%

Qwen3.8xhigh 14.9%

Muse Spark Openxhigh 7.6%

Nemotron 3.5 Super VL 6.1%

25 models · 1 drop · Artificial Analysis (2026-11-04), Tencent Hunyuan Hy4 launch post

Artificial Analysis Intelligence Index v5.0

24 models compared.

Gemini 4 Carbonhigh 60

Claude Opus 5.5max 59.1

GPT-6 Astramax 56.9

GPT-6.1 Solmax 54.6

Claude Sonnet 5.5max 54.5

GPT-6.1 Terramax 51.3

18 more

Gemini 4 Argonhigh 50.4

Muse Wonder Fullmax 50.1

Fable 5.1max 49.2

Kimi K3.1 Pro 46.5

Muse Wondermax 43.6

Claude Haiku 5.5max 36.5

Grok 4.7xhigh 35.5

DeepSeek V4.1 Flash 1017max 32.6

GLM-5.3max 31.7

Gemini 3.8 Flashhigh 30.8

MiMo-V2.6-Pro 29.9

Ling-3.1-flash-1019 29.6

MiniMax M3.1 Flash 29.1

GPT-6 Lunamax 27.9

Mistral Large 4high 26.1

Muse Spark Openxhigh 24.9

Qwen3.8xhigh 20.1

Nemotron 3.5 Super VL 13.6

24 models · 1 drop · Artificial Analysis (2026-11-04)

Epoch Capabilities Index

23 models compared.

GPT-6 Astra 169.1

Claude Opus 5.5 168.4

GPT-6.1 Terra 168.1

GPT-6.1 Sol 167.8

Claude Sonnet 5.5 166.7

Fable 5.1 166.4

17 more

Gemini 4 Argon 166.1

GPT-6 Sol 163.8

Claude Opus 5 163

GPT-5.6 Sol 162

Muse Wonder 161.7

Claude Haiku 5.5 160.4

DeepSeek V4.1 Flash 1017 158.8

Gemini 3.7 Flash 158.2

Gemini 3.8 Flash 157.6

Muse Spark 1.3 157.4

Grok 4.6 156.9

GPT-6 Luna 156.8

GLM-5.3 156.2

Muse Spark Open 155.1

Grok 4.7 154.6

Qwen3.8 151.8

Mistral Large 4 150.6

23 models · 1 drop · Epoch Capabilities Index (2026-11-04), Muse Spark 1.3

Vals Index v2.2

21 models compared.

Claude Sonnet 5.5 70.9%

Gemini 4 Carbon 70.5%

Claude Opus 5.5 70.2%

Gemini 4 Argon 69.2%

Muse Wonder Full 66.8%

GPT-6 Astra 65%

15 more

Muse Wonder 64.9%

GPT-6.1 Sol 63.9%

Kimi K3.1 Pro 62.5%

DeepSeek V4.1 Flash 1017 61.3%

GPT-6.1 Terra 60.5%

GLM-5.3 59.7%

Claude Haiku 5.5 58.7%

Grok 4.7 58.6%

MiMo-V2.6-Pro 57.8%

Mistral Large 4 56.5%

Gemini 3.8 Flash 56%

MiniMax M3.1 Flash 53.8%

GPT-6 Luna 52.3%

Muse Spark Open 48.6%

Nemotron 3.5 Super VL 29.8%

21 models · 1 drop · Vals Index v2.2 (2026-11-04)

Artificial Analysis Cyber Index

14 models compared.

Kimi K3.1 Pro 64.1

DeepSeek V4.1 Flash 1017max 56.8

Grok 4.7xhigh 56.4

MiMo-V2.6-Pro 56.1

GPT-6 Lunamax 52.7

Mistral Large 4high 50.9

8 more

GLM-5.3-Flash 50

Kimi K3 41

GLM-5.3max 36.4

GPT-6 Astramax 33.4

Claude Opus 5.5max 28.7

Gemini 3.8 Flashhigh 25.1

Fable 5.1max 25

Qwen3.8xhigh 12.7

14 models · 1 drop · Artificial Analysis (2026-11-04), Mistral Large 4

Apex Bench v1.1

6 models compared.

DeepSeek V4.1 Flash 1017 72.1%

Claude Opus 5 65.8%

DeepSeek V4.1 Flash 64.6%

GLM-5.3 56.6%

GPT-5.6 Sol 54.3%

Kimi K3 47.8%

6 models · 1 drop · DeepSeek V4.1 Flash 1017

BankerToolBench

6 models compared.

MiniMax M3.1 Flash 76.2

Claude Opus 5 76.2

GPT-5.6 Sol 74.6

GLM-5.3 74.5

DeepSeek V4.1 Flash 73.7

Kimi K3 69.1

6 models · 1 drop · MiniMax M3.1 Flash

Frontier Finance

6 models compared.

Fable 5.1max 60.8%

Kimi K3.1 Promax 58.6%

GLM-5.3max 57.5%

Claude Opus 5.5max 56.7%

DeepSeek V4.1 Flash 1017max 54.5%

GPT-6 Astramax 45%

6 models · 1 drop · Kimi K3.1 Pro

OfficeQA Pro v2

6 models compared.

Kimi K3.1 Promax 64.4%

Claude Opus 5.5max 62.2%

Fable 5.1max 54.5%

GPT-6 Astramax 54.4%

DeepSeek V4.1 Flash 1017max 40.4%

GLM-5.3max 31.1%

6 models · 1 drop · Kimi K3.1 Pro

Artificial Analysis Coding Agent Index v2.0

5 models compared.

Claude Opus 5.5max 62

Claude Sonnet 5.5max 59

GPT-6.1 Solmax 54

GPT-6.1 Terramax 48

GPT-6 Lunamax 31

5 models · 1 drop · GPT-6.1 Terra

BenchCAD (with tools)

5 models compared.

Claude Opus 5.5max 96.2%

GPT-6 Astramax 95.9%

Kimi K3.1 Promax 92.7%

Fable 5.1max 92.6%

DeepSeek V4.1 Flash 1017max 81.6%

5 models · 1 drop · Kimi K3.1 Pro

CyberGym-E2E

5 models compared.

Mistral Large 4 82%

MiMo-V2.6-Pro 79%

Grok 4.7 74%

Kimi K3 58%

GLM-5.3 29%

5 models · 1 drop · Mistral Large 4

Factual error rate

Lower is better.

GPT-6 Astramax 4.2%

GPT-6.1 Terramax 4.3%

GPT-6.1 Solmax 4.4%

GPT-6 Lunamax 18.4%

GPT-5.6 Terramax 22.3%

5 models · 1 drop · GPT-6.1 Terra

IFBench (loose)

5 models compared.

Gemma 4 26B A4B 77.3%

Nemotron 3 Nano 72.2%

Nemotron 3.5 Lightning 71.9%

gpt-oss-20b 68.5%

Qwen3.6 35B A3B 63.7%

5 models · 1 drop · Nemotron 3.5 Lightning

MemoryBench

5 models compared.

Muse Wondermax 85.6%

Muse Wonder Fullmax 85.5%

Claude Opus 5.5max 81.5%

GPT-6 Astramax 81.4%

Fable 5.1max 79%

5 models · 1 drop · Muse Wonder

MMMU-Pro

5 models compared.

Claude Opus 5.5max 87.7%

GPT-6 Astramax 86.9%

Fable 5.1max 86.3%

Kimi K3.1 Promax 84.1%

DeepSeek V4.1 Flash 1017max 80.6%

5 models · 1 drop · Kimi K3.1 Pro

MMMU-Pro Vision

5 models compared.

GPT-6 Astramax 86.7%

GPT-6.1 Solmax 86.3%

GPT-6.1 Terramax 85.5%

GPT-5.6 Terramax 81.7%

GPT-6 Lunamax 79.9%

5 models · 1 drop · GPT-6.1 Terra

OSWorld

5 models compared.

Claude Opus 5.5max 81.8%

Fable 5.1max 80.7%

Kimi K3.1 Promax 79.6%

GPT-6 Astramax 75.8%

DeepSeek V4.1 Flash 1017max 69.3%

5 models · 1 drop · Kimi K3.1 Pro

Personal Superintelligence Index

5 models compared.

Muse Wonder Fullmax 59.1

Claude Opus 5.5max 55.2

GPT-6 Astramax 54.5

Muse Wondermax 54.3

Fable 5.1max 49.9

5 models · 1 drop · Muse Wonder

PinchBench

5 models compared.

Qwen3.6 35B A3B 88.1%

Nemotron 3.5 Lightning 85.4%

Gemma 4 26B A4B 74.7%

Nemotron 3 Nano 66.1%

gpt-oss-20b 57.2%

5 models · 1 drop · Nemotron 3.5 Lightning

SWE-sweep

5 models compared.

Gemini 4 Carbonmax 9.6%

GPT-6 Astramax 9.5%

Gemini 4 Argonmax 4.3%

Claude Opus 5.5max 3.6%

Fable 5.1max 2.9%

5 models · 1 drop · Gemini 4 Carbon

Vals Finance Agent v2

5 models compared.

Gemini 3.8 Flashmax 61.4%

Claude Opus 5max 58.6%

GPT-5.6 Terramax 54.4%

Claude Sonnet 5max 53.9%

GPT-5.6 Solmax 53.8%

5 models · 1 drop · Gemini 3.8 Flash

Agents' Last Exam v1.1

4 models compared.

Gemini 4 Carbonmax 77.4%

GPT-6 Astramax 73.1%

Claude Opus 5.5max 71.6%

Gemini 4 Argonmax 69%

4 models · 1 drop · Gemini 4 Carbon

AIME 2025

4 models compared.

Claude Opus 4.6 99.8%

MAI-Thinking-1 97%

Claude Sonnet 4.6max 95.6%

DeepSeek V3.2 93.1%

4 models · 1 drop · MAI-Thinking-1

AIME 2026

4 models compared.

Nanbeige4.3-33Bmax 95.2%

Muse Glimmer-30Bmax 94.7%

Qwen3.8max 94.5%

Gemma 4max 89.2%

4 models · 1 drop · Nanbeige4.3-33B model card

Chartography

4 models compared.

Claude Sonnet 5.5 61.6%

Claude Haiku 5.5max 46.4%

GPT-6 Luna 29.1%

Claude Haiku 4.5 6.4%

4 models · 1 drop · Claude Haiku 5.5

Claw-Eval pass^3

4 models compared.

Nanbeige4.3-33Bmax 78.3%

Qwen3.8max 75.2%

Muse Glimmer-30Bmax 57.3%

Gemma 4max 44.2%

4 models · 1 drop · Nanbeige4.3-33B model card

CursorBench 3.2

4 models compared.

Claude Fable 5max 70.5%

Grok 4.6high 69.9%

GPT-5.6 Solmax 67.2%

Grok 4.5high 66.7%

4 models · 1 drop · Grok 4.6

DeepPlanning

4 models compared.

Nanbeige4.3-33Bmax 63.3%

Qwen3.8max 49.2%

Muse Glimmer-30Bmax 21.4%

Gemma 4max 19.4%

4 models · 1 drop · Nanbeige4.3-33B model card

EEBench

4 models compared.

Grok 4.7xhigh 64%

Fable 5.1max 56.4%

Grok 4.6high 53%

GPT-5.6 Solmax 39.4%

4 models · 1 drop · Grok 4.7

Finance Agent v2

4 models compared.

GLM-5.3 55.8%

Mistral Large 4 54.7%

GPT-6 Astra 53.5%

Kimi K3 53.1%

4 models · 1 drop · Mistral Large 4

GDPval rubrics

4 models compared.

Qwen3.8max 86.4%

Nanbeige4.3-33Bmax 84.8%

Muse Glimmer-30Bmax 75.8%

Gemma 4max 71.4%

4 models · 1 drop · Nanbeige4.3-33B model card

HealthBench Professional

4 models compared.

Fable 5.1max 62.1%

GPT-5.6 Solmax 60.5%

Grok 4.7xhigh 56.7%

Grok 4.6high 48.5%

4 models · 1 drop · Grok 4.7

HLE-Diamond (no tools)

4 models compared.

Muse Spark Openxhigh 26.1%

Kimi K3max 22.2%

Qwen3.8-2.4T-A95Bxhigh 17.3%

GLM-5.3max 16.4%

4 models · 1 drop · Muse Spark Open

SkillsBench

4 models compared.

Nanbeige4.3-33Bmax 61.1%

Qwen3.8max 56.4%

Muse Glimmer-30Bmax 39.7%

Gemma 4max 28.9%

4 models · 1 drop · Nanbeige4.3-33B model card

Terminal-Bench 2.0

Hard tasks in a real terminal (2025 edition).

GPT-5.4 75.1%

Claude Sonnet 4.6max 59.1%

DeepSeek V3.2 46.4%

MAI-Thinking-1 46%

4 models · 1 drop · MAI-Thinking-1

Terminal-Bench 2.1 (standard harness)

4 models compared.

Claude Opus 5 89.1%

GPT-5.6 Sol 88%

Gemini 3.8 Flashhigh 87.6%

Muse Spark 1.3xhigh 85.4%

4 models · 1 drop · Muse Spark 1.3

τ²-bench Telecom

4 models compared.

GLM-5.3-Flash 98.5%

Qwen3.5-122B-A10B 87.2%

Nemotron 3 Ultra 83%

Nemotron 3.5 Super VL 73.2%

4 models · 1 drop · Nemotron 3.5 Super VL

ARC-AGI-1

3 models compared.

GPT-5.6 Terramax 96.5%

Gemini 3.7 Flash 95.5%

Gemini 3.6 Flashhigh 91.2%

3 models · 1 drop · Gemini 3.7 Flash

ARC-AGI-3

3 models compared.

GPT-6 Astra 99.9%

Claude Opus 5 30.2%

GPT-5.6 Sol 7.8%

3 models · 1 drop · GPT-6 Astra

DeepSearchQA

3 models compared.

GPT-5.6 Solmax 93.1%

Claude Opus 5max 90.4%

Muse Spark 1.3max 90.3%

3 models · 1 drop · Muse Spark 1.3

Dense200

3 models compared.

Mistral Large 4 42%

GPT-6 Astra 41.5%

Kimi K3 28.9%

3 models · 1 drop · Mistral Large 4

MRCR 512K-1M

3 models compared.

Muse Spark 1.3max 98.1%

GPT-5.6 Solmax 73.8%

Muse Spark 1.2xhigh 55.5%

3 models · 1 drop · Muse Spark 1.3

SWE-bench Pro v2 Hard

3 models compared.

Claude Opus 5.5 100%

Fern 0.1 76.5%

Nemotron 3 Ultra 31.4%

3 models · 1 drop · Mirendil, "Introducing Fern"

AA-Omniscience

2 models compared.

Gemini 4 Carbon 54

Claude Opus 5.5 48

2 models · 1 drop · Gemini 4 Carbon

FrontierMath Tier 4

2 models compared.

GPT-6 Astra 97.6%

Fable 5.1 87.8%

2 models · 1 drop · GPT-6 Astra

Hermes Bench

2 models compared.

Nemotron 3.5 Super VL 63.4%

Nemotron 3 Ultra 56.3%

2 models · 1 drop · Nemotron 3.5 Super VL

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

GPT-6 Astramax 70.5%

GPT-6.1 Solmax 69.5%

Gemini 4 Carbonhigh 69%

GPT-6.1 Terramax 68%

Claude Opus 5.5max 68%

Claude Sonnet 5.5max 59%

18 more

Muse Wonder Fullmax 56.5%

Gemini 4 Argonhigh 52.5%

Fable 5.1max 52.5%

Muse Wondermax 50.5%

Kimi K3.1 Pro 49.5%

Gemini 3.8 Flashhigh 46.5%

Claude Haiku 5.5max 43.5%

GPT-6 Lunamax 42.5%

Ling-3.1-flash-1019 38.5%

MiMo-V2.6-Pro 34%

GLM-5.3max 33.5%

Grok 4.7xhigh 33.5%

MiniMax M3.1 Flash 32.5%

Muse Spark Openxhigh 29.5%

Mistral Large 4high 27%

DeepSeek V4.1 Flash 1017max 25%

Nemotron 3.5 Super VL 13.5%

Qwen3.8xhigh 4%

24 models · 0 drops · Artificial Analysis (2026-11-04)

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Gemini 4 Carbonhigh 64.8%

GPT-6 Astramax 63.3%

Claude Opus 5.5max 59%

GPT-6.1 Solmax 58.1%

GPT-6.1 Terramax 57.6%

Claude Sonnet 5.5max 53.3%

18 more

Gemini 4 Argonhigh 52.9%

Fable 5.1max 43.3%

Muse Wonder Fullmax 37.1%

Kimi K3.1 Pro 34.3%

Muse Wondermax 25.7%

Claude Haiku 5.5max 20%

DeepSeek V4.1 Flash 1017max 12.9%

Grok 4.7xhigh 11.4%

Gemini 3.8 Flashhigh 10%

GLM-5.3max 9.5%

GPT-6 Lunamax 8.6%

MiMo-V2.6-Pro 5.7%

Mistral Large 4high 4.3%

Ling-3.1-flash-1019 4.3%

MiniMax M3.1 Flash 3.3%

Muse Spark Openxhigh 1.9%

Qwen3.8xhigh 0.5%

Nemotron 3.5 Super VL 0%

24 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

6 Aug 2026

10 Sep 2026

18 Oct 2026

2 Nov 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.