The benchmark board

Every score from our Model Drops from the last 6 months on one board, since Jun 2, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

116benchmarks

96models scored

1369scores logged

48Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

DeepSWE v1.1

Best score rose 42 points, from 37% (Gemini 3.5 Flash) to 79% (Muse Wonder Full).

Artificial Analysis Intelligence Index

Best score rose 16.2, from 41.8 (Claude Opus 4.8) to 58 (Claude Opus 5.5).

Terminal-Bench 2.1

Best score rose 13.7 points, from 76.2% (Gemini 3.5 Flash) to 89.9% (MiMo-V2.6-Pro).

Terminal-Bench 4.0

Best score rose 70.6 points, from 0% (Claude Haiku 4.5) to 70.6% (Claude Sonnet 5.5).

GDPval-AA

Best score rose 517 Elo, from 1349 Elo (Gemini 3.5 Flash) to 1866 Elo (Claude Opus 5.5).

AutomationBench

Best score rose 16 points, from 46.2% (Fable 5) to 62.2% (MiniMax M3.1 Flash).

GPQA Diamond

Best score rose 4.1 points, from 92% (Claude Opus 4.8) to 96.1% (GPT-6 Astra).

Humanity's Last Exam (no tools)

Best score rose 18.7 points, from 45.7% (Claude Opus 4.8) to 64.4% (Claude Opus 5.5).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

Claude Sonnet 5Claude Sonnet 5.5

Terminal-Bench 4.0: 10.3% to 70.6%

+60.3

Claude Haiku 4.5Claude Haiku 5.5

OSWorld 2 (offline subset): 15.7% to 72.4%

+56.7

GPT-5.6 TerraGPT-6.1 Terra

AA-Omniscience hallucination rate: 88% to 38%

+50

Muse Spark 1.2Muse Spark 1.3

MRCR 512K-1M: 55.5% to 98.1%

+42.6

Claude Opus 5Claude Opus 5.5

Terminal-Bench Science: 29% to 58.7%

+29.7

GPT-6 SolGPT-6.1 Sol

Terminal-Bench Science: 27.6% to 57%

+29.4

Fable 5Fable 5.1

Terminal-Bench Science: 24.7% to 52.6%

+27.9

Gemini 3.6 FlashGemini 3.7 Flash

ARC-AGI-2: 60.4% to 84.6%

+24.2

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

GLM 5.2 88

Grok 4.6 87

Gemini 4 Carbon 85.8

Claude Opus 5.5 85.2

DeepSeek V4.1 Flash 1017 83.9

Qwen3.8 83.6

45 more

Grok 4.5 82.5

Kimi K2.7 Code 82.5

Composer 2.5 82.3

GPT-6.1 Sol 80.9

Kimi K3 80.3

GLM-5.3 78.4

Gemini 3.7 Flash 77.6

Nemotron 3.5 Lightning 77.3

Muse Spark 1.1 74

GPT-6 Astra 73.8

Muse Spark 1.3 73.2

Claude Haiku 5.5 71.4

MiMo-V2.6-Pro 71.3

Nemotron 3 Ultra 70.7

Gemini Omni 70.1

Fable 5.1 69.9

Fable 5 69.9

Claude Opus 4.8 69.6

Mythos 5 69.5

GPT-6.1 Terra 69.2

GPT-6 Luna 69

Nemotron 3.5 Super VL 68.2

Kimi K3.1 Pro 67.5

GPT-5.6 Terra 66.5

GPT-5.6 Luna 66.2

MAI-Cyber-1-Flash 65.5

Claude Sonnet 5.5 65.4

Gemini 3.8 Flash 65.3

Claude Opus 5 63.9

Gemini 4 Argon 61.6

MiniMax M3.1 Flash 61.1

MAI-Code-1-Flash 61

Muse Spark 1.2 59.2

Qwen3.8-Max 56

MAI-Thinking-1 55.6

GPT-6 Sol 55.4

Muse Spark Open 52.7

Mistral Large 4 49.4

GPT-5.6 Sol 48.2

Inkling 48.1

Gemini 3.5 Flash 43.4

Gemini 3.6 Flash 39.5

Muse Wonder 37

Grok 4.7 33.4

Claude Sonnet 5 25

51 models · 47 drops · Every model's sources, quotes and method

DeepSWE v1.1

Fixing issues in real repositories.

Muse Wonder Fullmax 79%

Muse Wondermax 78.8%

Gemini 4 Argonmax 77.9%

DeepSeek V4.1 Flash 1017max 77%

Kimi K3.1 Promax 75.5%

Muse Spark 1.3max 75.4%

39 more

GPT-6.1 Solhigh 75.2%

Claude Opus 5.5max 74.2%

DeepSeek V4.1 Flash 74.2%

GPT-6 Astramax 74.1%

Claude Opus 5 74%

Gemini 3.8 Flash 73.8%

MiniMax M3.1 Flash 73.7%

GPT-5.6 Sol 73%

Particle-1max 72.6%

MiMo-V2.6-Pro 71.9%

Grok 4.7high 71%

Fable 5xhigh 69.9%

GPT-5.6 Terramax 69.6%

GPT-6 Solmax 68.8%

Kimi K3 67.5%

Fable 5.1max 67.4%

GPT-5.6 Lunamax 67%

GPT-5.5xhigh 67%

GLM-5.3max 66.9%

GPT-6 Lunamax 66.6%

Nanbeige4.3-33Bmax 65.5%

Gemini 3.7 Flashhigh 65.3%

Grok 4.6high 65.2%

Mistral Large 4 62%

Muse Spark Openxhigh 60%

Claude Opus 4.8max 59%

DeepSeek V4 Pro 0813 57%

Qwen3.8-2.4T-A95Bxhigh 57%

Qwen3.8-Max 56.6%

Muse Spark 1.2xhigh 55%

Grok 4.5high 54%

Claude Sonnet 5max 53.8%

Gemini 3.6 Flash 48.6%

Fern 0.1 44.2%

Qwen3.8max 42.5%

Gemini 3.5 Flash 37%

Muse Glimmer-30Bmax 4.4%

Nemotron 3 Ultra 3.5%

Gemma 4max 2.7%

45 models · 24 drops · Muse Wonder, Gemini 4 Argon, Kimi K3.1 Pro, GPT-6 Astra, GPT-6.1 Sol, MiniMax M3.1 Flash, Particle, "Introducing Particle-1", MiMo-V2.6-Pro, Grok 4.7, GPT-6 Sol & GPT-6 Luna, Gemini 3.8 Flash, Gemini 3.6 Flash, GPT-5.6 Sol, Terra, & Luna, Nanbeige4.3-33B model card, Muse Spark Open, Qwen3.8-Max, Mistral Large 4, Muse Spark 1.3, Grok 4.6, Gemini 3.7 Flash, Mirendil, "Introducing Fern"

Artificial Analysis Intelligence Index

54 models compared.

Claude Opus 5.5 58

Claude Sonnet 5.5max 56

Muse Wonder Fullmax 55.8

Kimi K3.1 Pro 55

GPT-6 Astra 53

Fable 5.1 53

48 more

Gemini 4 Argonhigh 53

Muse Wondermax 52.4

GPT-6.1 Solmax 52

Claude Opus 5 50.8

Fable 5 49.6

Muse Spark 1.3 48.1

GPT-6.1 Terramax 48

GPT-5.6 Sol 47

MiMo-V2.6-Pro 46.3

Grok 4.7 46

DeepSeek V4.1 Flash 1017 45.1

GLM-5.3 44.8

Kimi K3 44

Grok 4.6 44

Claude Haiku 5.5max 43

MiniMax M3.1 Flash 42.7

GPT-5.6 Terramax 42

Claude Opus 4.8 41.8

Gemini 3.8 Flash 40.9

Qwen3.8-Max 40.2

Qwen3.8-2.4T-A95B 39.9

Muse Spark 1.2 39.6

DeepSeek V4.1 Flash 39.5

Gemini 3.7 Flash 39.1

Muse Spark Open 38.9

Grok 4.5high 38.8

Mistral Large 4 38.4

Claude Sonnet 5max 38.2

GPT-6 Lunamax 38

GPT-5.6 Lunamax 37.3

DeepSeek V4 Pro 0813 36

Gemini 3.6 Flash 34

GLM-5.2 33.7

Qwen3.8 33.7

DeepSeek V4 Pro 30.4

Kimi K2.6 27

GLM-5.1 26.1

Inkling 25

Nemotron 3 Ultra 22.9

MiniMax M2.7 22.8

Qwen3.6-27B 21.4

Qwen3.5 397B 18.4

Qwen3.6 35B A3B 18.2

Muse Glimmer-30B 17.5

Gemma 4 26B A4B 16.7

Nemotron 3.5 Lightning 12.9

gpt-oss-20bhigh 9

Nemotron 3 Nano 8.9

54 models · 20 drops · Kimi K3.1 Pro, GPT-6.1 Terra, Muse Wonder, DeepSeek V4.1 Flash 1017, Grok 4.6, Muse Spark 1.3, Grok 4.7, Muse Spark Open, Qwen3.8-Max, Gemini 3.8 Flash, GLM-5.3, Muse Spark 1.2, Gemini 3.7 Flash, Gemini 3.6 Flash, Mistral Large 4, Qwen3.8, Inkling, Nemotron 3 Ultra, Nemotron 3.5 Lightning

Terminal-Bench 2.1

47 models compared.

MiMo-V2.6-Pro 89.9%

Gemini 3.8 Flashmax 89.4%

Claude Opus 5 89.1%

GPT-5.6 Solmax 88.8%

Muse Spark 1.3max 88.8%

LongCat-2.5 88.4%

41 more

Mythos 5 88%

GPT-5.6 Terramax 87.4%

Qwen3.8-Max 86.6%

Gemini 3.7 Flashhigh 85.8%

GPT-5.5xhigh 85.6%

Kimi K3max 85%

GPT-5.6 Lunamax 84.7%

Claude Opus 4.8max 84.6%

Fable 5max 84.6%

GLM-5.3max 83.9%

Muse Spark 1.2xhigh 82.9%

GLM-5.2 82.7%

Qwen3.8-2.4T-A95Bxhigh 82%

Grok 4.5high 81.6%

Nanbeige4.3-33Bmax 80.9%

Claude Sonnet 5max 80.4%

Particle-1max 79.9%

Claude Opus 4.6max 78.2%

Gemini 3.6 Flashmax 78%

Muse Spark Openxhigh 76.4%

Gemini 3.5 Flash 76.2%

Muse Spark 1.1xhigh 76.2%

Qwen3.8max 73%

Kimi K2.6 71.3%

Gemini 3.1 Pro 70.7%

Qwen3.7-Plusmax 64%

Inkling 63.8%

Qwen3.6-27Bmax 63.4%

GLM-5.1 59.3%

Nemotron 3 Ultra 56.4%

Muse Glimmer-30Bmax 51.7%

Clover-35B-A3B-Preview 51.7%

Qwen3.5 397B 49.9%

Gemma 4max 47.2%

Qwen3.6 35B A3B 44.4%

SenseNova-Loop-9B-Preview 40.5%

Gemma 4 26B A4B 37.2%

Nemotron 3.5 Lightning 24.6%

gpt-oss-20b 15.2%

LFM3-1.7B 12.9%

Nemotron 3 Nano 8.3%

47 models · 20 drops · MiMo-V2.6-Pro, Gemini 3.8 Flash, Muse Spark 1.3, Meituan LongCat-2.5 launch post, Fable 5 / Mythos 5, Qwen3.8-Max, Gemini 3.7 Flash, GPT-5.6 Sol, Terra, & Luna, Muse Spark Open, Gemini 3.6 Flash, Inkling, Muse Spark 1.2, Nanbeige4.3-33B model card, Particle, "Introducing Particle-1", Qwen3.8, Nemotron 3 Ultra, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, SenseNova-Loop-9B-Preview model card, Liquid AI, "Introducing LFM3"

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Claude Sonnet 5.5max 70.6%

Claude Opus 5.5max 66.4%

Kimi K3.1 Promax 65.7%

Mythos 5.1 60.9%

GPT-6 Astramax 58.2%

Fable 5.1max 57.9%

31 more

Gemini 4 Argonmax 57.4%

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 55.9%

Muse Wondermax 52%

Claude Opus 5 51.8%

GPT-6.1 Terramax 50.3%

Hy4 44.4%

DeepSeek V4.1 Flash 1017max 42.3%

GLM-5.3max 41.8%

GPT-5.6 Sol 39.9%

Claude Haiku 5.5max 39.2%

LongCat-2.5 38.5%

MiniMax M3.1 Flash 38.1%

Grok 4.7xhigh 37.6%

MiMo-V2.6-Pro 34.9%

DeepSeek V4.1 Flash 31.2%

Mistral Large 4 28.3%

Nanbeige4.3-33Bmax 23.8%

GPT-5.6 Terramax 21.5%

Grok 4.6high 20.3%

Gemini 3.8 Flashmax 19.1%

GPT-6 Luna 16.4%

Kimi K3 12.6%

Claude Sonnet 5 10.3%

DeepSeek V4 Pro 0813 10%

Qwen3.8max 6.3%

Fern 0.1 6.1%

Muse Glimmer-30Bmax 1.6%

Claude Haiku 4.5 0%

Gemma 4max 0%

Nemotron 3 Ultra 0%

37 models · 19 drops · GPT-6.1 Terra, Kimi K3.1 Pro, GPT-6 Astra, Gemini 4 Argon, Muse Wonder, MiniMax M3.1 Flash, Tencent Hunyuan Hy4 launch post, Claude Haiku 5.5, Meituan LongCat-2.5 launch post, Grok 4.7, MiMo-V2.6-Pro, Mistral Large 4, Nanbeige4.3-33B model card, Gemini 3.8 Flash, Claude Sonnet 5.5, Mirendil, "Introducing Fern"

GDPval-AA

Professional work products, graded head to head (Elo).

Claude Opus 5.5max 1866 Elo

Muse Wonder Fullmax 1857 Elo

Kimi K3.1 Promax 1846 Elo

Claude Sonnet 5.5 1838 Elo

Muse Wondermax 1770 Elo

GLM-5.3 1769 Elo

27 more

Fable 5.1max 1754 Elo

Muse Spark 1.3max 1754 Elo

DeepSeek V4.1 Flash 1017max 1746 Elo

Fable 5 1743 Elo

Claude Opus 5 1708 Elo

Grok 4.7xhigh 1695 Elo

MiMo-V2.6-Pro 1673 Elo

Claude Haiku 5.5max 1620 Elo

Muse Spark 1.2xhigh 1615 Elo

Qwen3.8-2.4T-A95Bxhigh 1613 Elo

Grok 4.6high 1605 Elo

GPT-5.6 Sol 1588 Elo

GPT-5.6 Lunamax 1584 Elo

GPT-6 Astramax 1573 Elo

Gemini 3.8 Flashmax 1545 Elo

Kimi K3max 1537 Elo

GPT-5.6 Terramax 1528 Elo

Grok 4.5high 1526 Elo

Gemini 3.7 Flashhigh 1525 Elo

GPT-6 Sol 1487 Elo

Claude Sonnet 5 1449 Elo

GPT-6 Luna 1437 Elo

Mistral Large 4 1424 Elo

Gemini 3.6 Flash 1422 Elo

Muse Spark Openxhigh 1401 Elo

Gemini 3.5 Flash 1349 Elo

Claude Haiku 4.5 735 Elo

33 models · 16 drops · Kimi K3.1 Pro, Muse Wonder, GLM-5.3, Muse Spark 1.3, Claude Opus 5.5, Grok 4.7, MiMo-V2.6-Pro, Claude Haiku 5.5, Muse Spark Open, Gemini 3.6 Flash, Gemini 3.8 Flash, Grok 4.6, Gemini 3.7 Flash, Claude Sonnet 5.5

AutomationBench

Real business automations (Zapier).

MiniMax M3.1 Flash 62.2%

DeepSeek V4.1 Flash 1017 60.5%

Mistral Large 4 59.9%

DeepSeek V4 Pro 0813 56.7%

Hy4 56.2%

DeepSeek V4.1 Flash 54.8%

25 more

Nanbeige4.3-33Bmax 54.2%

MiMo-V2.6-Pro 53.1%

LongCat-2.5 51.8%

Gemini 4 Argonmax 51.3%

Claude Opus 5 50.3%

Muse Spark 1.3max 49.6%

GLM-5.3 48.8%

Kimi K3 46.7%

Fable 5 46.2%

GPT-5.6 Sol 45.8%

Claude Sonnet 5.5max 44.7%

Claude Opus 5.5 42.5%

GPT-6 Astramax 41.4%

Qwen3.8max 38.3%

GPT-6.1 Solmax 36.1%

GPT-6 Sol 33.2%

Fable 5.1max 31.4%

Gemini 3.7 Flashhigh 30.4%

GPT-5.6 Terra 23.6%

GPT-6 Lunamax 20.7%

Gemini 3.6 Flash 17%

Muse Glimmer-30Bmax 15.2%

SenseNova-Loop-9B-Preview 13.7%

Claude Sonnet 5 10.7%

Gemma 4max 9.7%

31 models · 16 drops · MiniMax M3.1 Flash, Mistral Large 4, Tencent Hunyuan Hy4 launch post, Nanbeige4.3-33B model card, MiMo-V2.6-Pro, Meituan LongCat-2.5 launch post, Gemini 4 Argon, Muse Spark 1.3, GLM-5.3, Claude Sonnet 5.5, GPT-6.1 Sol, Gemini 3.7 Flash, GPT-6 Sol & GPT-6 Luna, SenseNova-Loop-9B-Preview model card

GPQA Diamond

43 models compared.

GPT-6 Astramax 96.1%

Kimi K3.1 Promax 94.2%

GPT-5.6 Solmax 94.1%

Claude Opus 5.5max 93.9%

Fable 5.1max 93.7%

Qwen3.8-2.4T-A95Bxhigh 93.5%

37 more

Kimi K3max 93.5%

GPT-5.4 92.8%

Qwen3.8-Flash-Next 92.7%

Qwen3.8-Max 92.6%

Fable 5max 92.6%

DeepSeek V4.1 Flash 1017max 92.2%

Claude Opus 4.8max 92%

GLM-5.3max 91.7%

Claude Opus 4.6max 91.3%

Gemma 4max 91.3%

Kimi K2.6 91.1%

Particle-1 90.4%

Qwen3.7-Plusmax 90.3%

Claude Sonnet 4.6max 89.9%

Nemotron 3.5 Super VL 89.5%

GLM-5.2 89.5%

Nanbeige4.3-33Bmax 89.5%

Qwen3.8max 89.2%

Muse Spark Openxhigh 89%

Qwen3.6-27Bmax 87.8%

Inkling 87.2%

Qwen3.5 397B 87.1%

Nemotron 3 Ultra 87%

Qwen3.5-122B-A10B 86.7%

GLM-5.1 86.1%

MAI-Code-1-Flash 84.6%

MAI-Thinking-1 84.2%

Clover-35B-A3B-Preview 83.8%

Muse Glimmer-30Bmax 83.5%

Qwen3.6 35B A3B 83.4%

DeepSeek V3.2 82.4%

Gemma 4 26B A4B 79.6%

Nemotron 3.5 Lightning 75.4%

Nemotron 3 Nano 74.1%

Claude Haiku 4.5 73.2%

gpt-oss-20b 71.5%

LFM3-1.7B 63.4%

43 models · 14 drops · Kimi K3.1 Pro, Qwen3.8-Max, Muse Spark Open, MAI-Thinking-1, Nemotron 3.5 Super VL, Qwen3.8, Nanbeige4.3-33B model card, Inkling, Particle, "Introducing Particle-1", Nemotron 3 Ultra, MAI-Code-1-Flash, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Claude Opus 5.5 64.4%

Mythos 5 59%

Fable 5 57.8%

Fable 5.1max 57.6%

Claude Sonnet 5.5 56.9%

Claude Mythos Preview 56.8%

24 more

Claude Opus 5 56.3%

GPT-6 Astramax 53.6%

Kimi K3.1 Promax 51.1%

Claude Haiku 5.5max 45.9%

Claude Opus 4.8max 45.7%

GPT-5.6 Sol 44.5%

Gemini 3.1 Pro 44.4%

Qwen3.8-Max 43.6%

Qwen3.8max 43.6%

Kimi K3 43.5%

DeepSeek V4.1 Flash 1017 42.6%

GPT-5.5 41.4%

GLM-5.2 40.1%

Qwen3.8-Flash-Next 39.6%

DeepSeek V4.1 Flash 36.8%

Kimi K2.6 35.9%

Nemotron 3.5 Super VL 31.8%

Inkling 29.7%

Nemotron 3 Ultra 29.2%

Qwen3.5 397B 28.5%

GLM-5.1 27.2%

Qwen3.5-122B-A10B 24.2%

Claude Haiku 4.5 10.2%

LFM3-1.7B 7.2%

30 models · 12 drops · Claude Opus 5.5, Fable 5 / Mythos 5, Fable 5.1, Kimi K3.1 Pro, Claude Haiku 5.5, DeepSeek V4.1 Flash 1017, Qwen3.8, Qwen3.8-Max, Inkling, Nemotron 3.5 Super VL, Nemotron 3 Ultra, Liquid AI, "Introducing LFM3"

SWE-bench Pro

27 models compared.

Fable 5max 80%

Claude Opus 4.8max 69.2%

Qwen3.8-Max 67.7%

Grok 4.5max 64.7%

GPT-5.6 Solmax 64.6%

Claude Sonnet 5max 63.2%

21 more

GPT-5.6 Lunamax 62.7%

GLM-5.2 62.1%

Qwen3.8max 61.7%

Qwen3.8-Flash-Next 60.4%

Nanbeige4.3-33Bmax 60.3%

GLM-5.3-Flash 59.7%

Gemini 3.6 Flashmax 58.7%

Kimi K2.6 58.6%

GPT-5.4 57.7%

Qwen3.7-Plusmax 57.6%

Gemini 3.5 Flash 55.1%

Inkling 54.3%

Qwen3.6-27Bmax 53.5%

Claude Opus 4.6max 53.4%

MAI-Thinking-1 52.8%

Nemotron 3.5 Super VL 51.8%

MAI-Code-1-Flash 51.2%

Muse Glimmer-30Bmax 51.2%

Gemma 4max 51.2%

Nemotron 3 Ultra 49.7%

Claude Haiku 4.5 35.2%

27 models · 8 drops · Qwen3.8, Qwen3.8-Max, Gemini 3.6 Flash, Inkling, Nemotron 3.5 Super VL, Nanbeige4.3-33B model card, MAI-Thinking-1, MAI-Code-1-Flash

SWE-bench Verified

22 models compared.

GPT-6 Astra 86%

Claude Opus 4.6 80.8%

DeepSeek V4 Pro 80.6%

Kimi K2.6 80.2%

Claude Sonnet 4.6max 79.6%

GLM-5.3-Flash 79.1%

16 more

Inkling 77.6%

Nemotron 3 Ultra 73.9%

Clover-35B-A3B-Preview 73.6%

MAI-Thinking-1 73.5%

Fern 0.1 73.4%

DeepSeek V3.2 73.1%

Qwen3.5-122B-A10B 71.9%

MAI-Code-1-Flash 71.6%

Nemotron 3.5 Super VL 71.1%

Qwen3.6 35B A3B 70.1%

Claude Haiku 4.5 66.6%

Gemma 4 26B A4B 57.4%

gpt-oss-20b 52.4%

Nemotron 3.5 Lightning 51.6%

LFM3-1.7B 43.4%

Nemotron 3 Nano 34.1%

22 models · 8 drops · Mirendil, "Introducing Fern", MAI-Thinking-1, Inkling, Nemotron 3.5 Super VL, DiffuSpace, "Clover-35B-A3B-Preview", MAI-Code-1-Flash, Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

OSWorld 2

Using a computer: apps, files and the web.

Claude Sonnet 5.5max 83.9%

Claude Opus 5.5 81.8%

Hy4 78.9%

GPT-6.1 Solmax 78%

GPT-6.1 Terramax 74.2%

GPT-6 Astra 72.6%

10 more

Claude Opus 5 70.6%

Muse Spark 1.3max 66.9%

GPT-5.6 Sol 65.7%

MiniMax M3.1 Flash 61.7%

Gemini 3.8 Flashmax 59%

Kimi K3 58.3%

GPT-5.6 Terramax 57.1%

Claude Sonnet 5 57%

GPT-6 Lunamax 55.5%

DeepSeek V4.1 Flash 54.3%

16 models · 8 drops · GPT-6.1 Terra, Claude Sonnet 5.5, Tencent Hunyuan Hy4 launch post, GPT-6 Astra, MiniMax M3.1 Flash, Muse Spark 1.3, Gemini 3.8 Flash

Harvey Legal Agent Benchmark

Legal work end to end.

Kimi K3.1 Promax 23.7%

DeepSeek V4.1 Flash 1017max 21%

Grok 4.7xhigh 19.6%

Gemini 4 Argonmax 19.6%

Fable 5.1max 19.1%

Grok 4.6high 15.8%

15 more

Mistral Large 4 15.8%

Muse Wonder Fullmax 13.1%

Grok 4.5high 12.9%

Kimi K3 12.9%

Fable 5max 11.3%

Qwen3.8 Max 10.4%

Gemini 3.8 Flashmax 10%

Muse Wondermax 10%

GPT-6 Astramax 8.6%

GLM-5.3 8.3%

Claude Opus 5max 6.7%

Claude Sonnet 5max 5%

Claude Opus 5.5max 4.2%

GPT-5.6 Solmax 2.5%

GPT-5.6 Terramax 0.8%

21 models · 7 drops · Kimi K3.1 Pro, Grok 4.7, Gemini 4 Argon, Mistral Large 4, Muse Wonder, Grok 4.6, Gemini 3.8 Flash

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Kimi K3.1 Promax 70%

Claude Opus 5.5 67.7%

Fable 5.1max 65.6%

Claude Mythos Preview 64.7%

Mythos 5 64.5%

GPT-5.6 Sol 64.5%

15 more

Fable 5 63.9%

Claude Opus 5 63.6%

GLM-5.3 62.5%

Kimi K3 59.8%

DeepSeek V4.1 Flash 1017max 58.8%

Claude Opus 4.8max 57.9%

GPT-6 Astramax 57.2%

Qwen3.8-Max 56.2%

GLM-5.2 54.7%

Kimi K2.6 54%

GPT-5.5 52.2%

Gemini 3.1 Pro 51.4%

Inkling 46%

Nemotron 3 Ultra 37.4%

LFM3-1.7B 13.9%

21 models · 7 drops · Kimi K3.1 Pro, Claude Opus 5.5, Fable 5 / Mythos 5, GLM-5.3, Qwen3.8-Max, Inkling, Liquid AI, "Introducing LFM3"

Terminal-Bench Science

Scientific computing tasks in a terminal.

GPT-6 Astramax 68.1%

Claude Opus 5.5max 63.3%

GPT-6.1 Terramax 58.3%

GPT-6.1 Solmax 57%

Fable 5.1max 40%

Kimi K3.1 Promax 38.1%

7 more

Claude Opus 5 29%

GPT-6 Sol 27.6%

Fable 5 24.7%

GPT-5.6 Sol 22.4%

Hy4 19.8%

DeepSeek V4.1 Flashmax 15.7%

GLM-5.3max 8.1%

13 models · 6 drops · GPT-6.1 Terra, Kimi K3.1 Pro, Claude Opus 5.5, GPT-6.1 Sol, Fable 5.1, Tencent Hunyuan Hy4 launch post

BrowseComp

16 models compared.

Kimi K3.1 Promax 92.1%

LongCat-2.5 91.9%

GPT-6 Astramax 91.5%

Claude Opus 5.5max 90.8%

GPT-5.6 Solmax 90.4%

GPT-5.6 Terramax 87.5%

10 more

GPT-5.5xhigh 84.4%

GPT-5.6 Lunaxhigh 84%

Kimi K2.6 61.3%

GLM-5.1 59.4%

Qwen3.6 35B A3B 48.7%

Nemotron 3 Ultra 44.4%

Qwen3.5 397B 40.5%

Nemotron 3.5 Lightning 37%

Gemma 4 26B A4B 26.3%

Nemotron 3 Nano 13.7%

16 models · 5 drops · Kimi K3.1 Pro, Meituan LongCat-2.5 launch post, GPT-5.6 Sol, Terra, & Luna, Nemotron 3 Ultra, Nemotron 3.5 Lightning

IFBench

14 models compared.

Nemotron 3 Ultra 82.9%

Qwen3.8-Max 82.8%

Inkling 79.8%

Qwen3.5 397B 78.2%

GLM-5.1 76.6%

Kimi K2.6 76%

8 more

GLM-5.2 73.3%

LFM3-1.7B 73%

GPT-5.6 Solmax 72.7%

Nemotron 3.5 Super VL 70.9%

Qwen3.5-122B-A10B 67.6%

Fable 5max 63.5%

Claude Opus 4.8max 62.2%

GLM-5.3-Flash 57.7%

14 models · 5 drops · Nemotron 3.5 Super VL, Qwen3.8-Max, Inkling, Nemotron 3 Ultra, Liquid AI, "Introducing LFM3"

ProgramBench

14 models compared.

Claude Opus 5.5max 65%

Muse Wonder Fullmax 59%

Fable 5.1max 53.5%

Muse Wondermax 50%

GPT-6 Astramax 50%

Claude Opus 5 37%

8 more

Kimi K3.1 Promax 31.5%

Hy4 30%

DeepSeek V4.1 Flash 1017 29.1%

LongCat-2.5 25.5%

GPT-5.6 Sol 23%

DeepSeek V4.1 Flash 20.3%

GLM-5.3max 19%

Kimi K3 17.5%

14 models · 5 drops · Kimi K3.1 Pro, Muse Wonder, DeepSeek V4.1 Flash 1017, Tencent Hunyuan Hy4 launch post, Meituan LongCat-2.5 launch post

AA-LCR

36 models compared.

Kimi K3max 88.7%

MiMo-V2.6-Pro 86.3%

Kimi K3.1 Pro 86.3%

Fable 5.1max 85.3%

Claude Opus 5.5max 84.7%

Nanbeige4.3-33Bmax 84%

30 more

Muse Wonder Fullmax 83.7%

Muse Glimmer-30Bmax 83.3%

GPT-6 Lunamax 83.3%

GPT-6.1 Solmax 83%

GPT-6.1 Terramax 82.7%

DeepSeek V4.1 Flash 1017max 82.7%

Claude Sonnet 5.5max 82.7%

Claude Haiku 5.5max 82.7%

Ling-3.1-flash-1019 82.3%

Qwen3.8xhigh 82%

Gemini 3.8 Flashhigh 81.3%

Muse Wondermax 80.7%

GPT-6 Astramax 80.7%

Qwen3.8-Max 80.3%

MiniMax M3.1 Flash 79.7%

Gemini 4 Argonhigh 79.7%

GLM-5.3max 79.7%

Gemini 4 Carbonhigh 79.3%

Muse Spark Openxhigh 78.3%

Inklingxhigh 77.3%

Grok 4.7xhigh 76.7%

Gemma 4max 72%

Clover-35B-A3B-Preview 72%

Nemotron 3.5 Super VL 69%

Qwen3.6 35B A3B 61.1%

Gemma 4 26B A4B 57.6%

LFM3-1.7B 52.8%

Nemotron 3.5 Lightning 52%

gpt-oss-20b 32.9%

Nemotron 3 Nano 32.8%

36 models · 4 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

OSWorld 2 (offline subset)

Using a computer, on the 82 OSWorld 2.1 tasks that need no internet.

Claude Opus 5.5max 87.2%

Claude Sonnet 5.5 83.9%

Gemini 4 Carbonmax 81.5%

GPT-6 Astramax 80.9%

Fable 5.1max 76.8%

Gemini 4 Argonmax 74.7%

7 more

Claude Haiku 5.5max 72.4%

GPT-6.1 Solmax 71.4%

Claude Opus 5max 70.2%

GPT-5.6 Sol 65.7%

GPT-6 Solmax 64.4%

GPT-6 Luna 48.9%

Claude Haiku 4.5 15.7%

13 models · 4 drops · Gemini 4 Carbon, Claude Haiku 5.5, GPT-6.1 Sol, GPT-6 Sol & GPT-6 Luna

Agents' Last Exam

11 models compared.

Kimi K3.1 Promax 43.2%

Claude Opus 5.5max 42.6%

Hy4 41%

DeepSeek V4.1 Flash 1017 35.4%

GPT-6 Astramax 32.8%

Claude Opus 5 32.2%

5 more

DeepSeek V4.1 Flash 31.8%

GPT-5.6 Sol 30.6%

MiniMax M3.1 Flash 29.6%

Kimi K3 28.3%

GLM-5.3max 26.2%

11 models · 4 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash

JobBench

11 models compared.

Claude Opus 5max 65.7%

Muse Spark 1.3max 64.9%

MiMo-V2.6-Pro 62%

Muse Spark Openxhigh 61.8%

GLM-5.3max 61.4%

Kimi K3max 54.3%

5 more

Qwen3.8-2.4T-A95Bxhigh 52.7%

GPT-5.6 Solmax 45.4%

Nanbeige4.3-33Bmax 44.8%

Qwen3.8max 34.5%

Gemma 4max 9%

11 models · 4 drops · MiMo-V2.6-Pro, Muse Spark 1.3, Muse Spark Open, Nanbeige4.3-33B model card

ARC-AGI-2

10 models compared.

GPT-5.6 Sol 92.5%

Claude Opus 5 90.4%

Fable 5 89.2%

Gemini 3.8 Flash 89.2%

Gemini 3.7 Flash 84.6%

GPT-5.6 Terramax 83.9%

4 more

Grok 4.6 65.1%

Gemini 3.6 Flash 60.4%

GPT-5.6 Lunamax 59.5%

Grok 4.5high 52.6%

10 models · 4 drops · Grok 4.6, Gemini 3.8 Flash, Gemini 3.7 Flash, Gemini 3.6 Flash

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Kimi K3.1 Pro 67.2%

Gemini 4 Carbonhigh 65.2%

Claude Sonnet 5.5max 63.6%

Claude Opus 5.5max 59.6%

GPT-6 Astramax 59.1%

Gemini 4 Argonhigh 57.1%

23 more

Muse Wonder Fullmax 57.1%

GPT-6.1 Solmax 56.1%

GPT-6.1 Terramax 55.6%

Fable 5.1max 52%

Muse Wondermax 52%

GLM-5.3max 41.9%

Qwen3.8-Max 38.9%

MiMo-V2.6-Pro 34.8%

DeepSeek V4.1 Flash 1017max 33.8%

Ling-3.1-flash-1019 32.8%

Claude Haiku 5.5max 32.8%

DeepSeek V4.1 Flash 27%

Grok 4.7xhigh 25.8%

MiniMax M3.1 Flash 25.8%

Mistral Large 4high 24.7%

Gemini 3.8 Flashhigh 19.7%

DeepSeek V4 Pro 0813 14.1%

Kimi K3max 12.6%

GPT-6 Lunamax 12.6%

Muse Spark Openxhigh 8.1%

Qwen3.8xhigh 5.6%

Inklingxhigh 1%

Nemotron 3.5 Super VL 0%

29 models · 3 drops · Artificial Analysis (2026-11-04), Grok 4.7, Mistral Large 4

GDP.pdf

Work products built from PDFs (Surge AI).

Kimi K3.1 Promax 34.6%

GPT-6 Astramax 34.2%

Gemini 3.7 Flashhigh 34%

GPT-6.1 Solhigh 32%

Claude Opus 5.5max 30.6%

Claude Sonnet 5 28%

7 more

GPT-6 Sol 28%

Fable 5.1max 27.6%

GPT-5.6 Terra 24.7%

Gemini 3.6 Flash 22%

DeepSeek V4.1 Flash 1017max 17.2%

Muse Spark 1.2 16%

GLM-5.3max 11.2%

13 models · 3 drops · Kimi K3.1 Pro, Gemini 3.7 Flash, GPT-6.1 Sol

OSWorld-Verified

Using a computer: apps, files and the web (2025 edition).

Kimi K3 84.8%

Qwen3.8max 84.3%

Claude Opus 5 83.4%

Gemini 3.6 Flashmax 83%

GPT-5.6 Sol 83%

MiMo-V2.6-Pro 82%

7 more

Claude Sonnet 5max 81.2%

Gemini 3.5 Flash 78.4%

Qwen3.7-Plusmax 73.3%

Claude Opus 4.6max 72.7%

GPT-5.6 Lunamax 72.6%

Muse Glimmer-30Bmax 65.9%

Qwen3.6-27Bmax 63.9%

13 models · 3 drops · MiMo-V2.6-Pro, Qwen3.8, Gemini 3.6 Flash

ExploitBench

11 models compared.

GPT-6 Astramax 100%

Claude Opus 5.5max 91%

Fable 5.1max 83%

Mythos 5 78%

GPT-5.6 Sol 76.5%

Kimi K3.1 Promax 74.7%

5 more

Claude Mythos Preview 69%

GLM-5.3 54.4%

Claude Opus 4.8 40%

GPT-5.5 34%

Kimi K3 32.2%

11 models · 3 drops · Kimi K3.1 Pro, GLM-5.3, Fable 5 / Mythos 5

Terminal-Bench 3.0

11 models compared.

Claude Opus 5 43.5%

GPT-5.6 Solmax 34.6%

Fable 5 33.7%

GLM-5.3 28.3%

Grok 4.6high 26%

GPT-5.6 Terra 20.8%

5 more

Kimi K3 17.4%

Grok 4.5high 15.7%

Gemini 3.7 Flashhigh 14.9%

Claude Sonnet 5 14.6%

Gemini 3.6 Flash 5.4%

11 models · 3 drops · Grok 4.6, GLM-5.3, Gemini 3.7 Flash

ZeroBench (with tools)

11 models compared.

Kimi K3.1 Promax 63%

Claude Opus 5.5max 61%

Fable 5.1max 59%

GPT-6 Astramax 58%

GPT-5.6 Sol 53%

Claude Opus 5 52%

5 more

DeepSeek V4.1 Flash 1017 51%

Muse Spark Openxhigh 50%

DeepSeek V4.1 Flash 49%

Kimi K3max 41%

Inkling 14%

11 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open

AA-Omniscience hallucination rate

Lower is better.

Muse Wonder Fullmax 23%

Muse Wondermax 26.5%

Grok 4.7 29%

Grok 4.6 34%

GPT-6.1 Terra 38%

Claude Sonnet 5.5 47%

4 more

GPT-6 Astra 51.3%

Claude Opus 5.5 58.6%

Fable 5.1 72.6%

GPT-5.6 Terra 88%

10 models · 3 drops · Muse Wonder, Grok 4.7, GPT-6.1 Terra

AIME 2026

10 models compared.

GLM-5.2 99.2%

Inkling 97.1%

Kimi K2.6 96.4%

Nanbeige4.3-33Bmax 95.2%

Muse Glimmer-30Bmax 94.7%

Qwen3.8max 94.5%

4 more

Nemotron 3 Ultra 94.2%

MAI-Code-1-Flash 92.5%

Gemma 4max 89.2%

Claude Haiku 4.5 83.3%

10 models · 3 drops · Inkling, Nanbeige4.3-33B model card, MAI-Code-1-Flash

BabyVision (with tools)

10 models compared.

Claude Opus 5.5max 97.7%

GPT-6 Astramax 96.6%

Kimi K3.1 Promax 95.4%

Fable 5.1max 95.1%

Claude Opus 5 94.1%

DeepSeek V4.1 Flash 1017 92.5%

4 more

DeepSeek V4.1 Flash 89.6%

Particle-1 89.2%

GPT-5.6 Sol 88.9%

Kimi K3 85.7%

10 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Particle, "Introducing Particle-1"

CharXiv Reasoning

10 models compared.

GPT-5.6 Terra 85.9%

Gemini 3.6 Flashmax 85.2%

Gemini 3.7 Flashhigh 84.5%

Qwen3.5-122B-A10B 83.5%

GPT-5.6 Lunamax 82.7%

GLM-5.3-Flash 81.9%

4 more

Grok 4.5max 81.6%

Nemotron 3.5 Super VL 80.8%

Inkling Small 77.8%

Claude Sonnet 5max 77%

10 models · 3 drops · Gemini 3.7 Flash, Nemotron 3.5 Super VL, Gemini 3.6 Flash

NL2Repo

10 models compared.

Claude Opus 5 75.3%

DeepSeek V4.1 Flash 1017 68.2%

DeepSeek V4.1 Flash 65.4%

MiniMax M3.1 Flash 61.2%

Kimi K3 58%

GLM-5.3 58%

4 more

GPT-5.6 Sol 56.8%

Nanbeige4.3-33Bmax 53%

Qwen3.8max 48.3%

Muse Glimmer-30Bmax 27.4%

10 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

FrontierCode v1.1

Hard, long coding tasks.

Claude Opus 5.5 54.4%

GPT-6 Astra 53.3%

Claude Sonnet 5.5xhigh 52.1%

Fable 5.1 50.3%

GPT-6 Sol 49.3%

Claude Opus 5 48%

3 more

Claude Haiku 5.5max 46.4%

Claude Sonnet 5 42.4%

GPT-6 Luna 42.4%

9 models · 3 drops · Claude Sonnet 5.5, Claude Opus 5.5, Claude Haiku 5.5

MCP Atlas

9 models compared.

Muse Spark 1.2xhigh 90.3%

Muse Spark Openxhigh 89.2%

Claude Opus 5xhigh 85.8%

Qwen3.8-2.4T-A95Bxhigh 84.5%

GLM-5.3max 84.2%

Fable 5 83.3%

3 more

Kimi K3max 82.3%

GPT-5.6 Sol 81.8%

LFM3-1.7B 32.6%

9 models · 3 drops · Muse Spark 1.2, Muse Spark Open, Liquid AI, "Introducing LFM3"

CyberGym

8 models compared.

MAI-Cyber-1-Flash 96%

GPT-5.5 Cyber 85.6%

GLM-5.3 84.5%

Mythos 5 83.8%

GPT-5.6 Sol 83.6%

Gemini 3.5 Flash Cyber 83.2%

2 more

MiniMax M3.1 Flash 82.2%

Kimi K3 80%

8 models · 3 drops · MAI-Cyber-1-Flash, MiniMax M3.1 Flash, GLM-5.3

LiveCodeBench

8 models compared.

DeepSeek V4 93.5%

Kimi K2.6 89.6%

Nemotron 3 Ultra 89%

MAI-Thinking-1 87.7%

GLM-5.1 85.7%

DeepSeek V3.2 83.3%

2 more

Qwen3.5 397B 79.3%

LFM3-1.7B 73.5%

8 models · 3 drops · MAI-Thinking-1, Nemotron 3 Ultra, Liquid AI, "Introducing LFM3"

SciCode

6 models compared.

Ling-3.1-flash-1019 57%

Nanbeige4.3-33Bmax 52.6%

Qwen3.8max 46.7%

Gemma 4max 45.5%

Muse Glimmer-30Bmax 44.9%

LFM3-1.7B 28.5%

6 models · 3 drops · Ling-3.1-flash-1019 model card, Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Tau3-Bench

6 models compared.

LFM3-1.7B 68%

Clover-35B-A3B-Preview 65.3%

Nanbeige4.3-33Bmax 48.8%

Qwen3.8max 48.5%

Muse Glimmer-30Bmax 33.7%

Gemma 4max 18.6%

6 models · 3 drops · Liquid AI, "Introducing LFM3", DiffuSpace, "Clover-35B-A3B-Preview", Nanbeige4.3-33B model card

Epoch Capabilities Index

39 models compared.

GPT-6 Astra 169.1

Claude Opus 5.5 168.4

GPT-6.1 Terra 168.1

GPT-6.1 Sol 167.8

Claude Sonnet 5.5 166.7

Fable 5.1 166.4

33 more

Gemini 4 Argon 166.1

Claude Opus 5 164.5

GPT-6 Sol 163.8

Fable 5 163

GPT-5.6 Sol 162.6

Muse Wonder 161.7

Claude Haiku 5.5 160.4

GPT-5.6 Terra 160.1

Claude Opus 4.8 159.6

DeepSeek V4.1 Flash 1017 158.8

Kimi K3 158.3

Gemini 3.7 Flash 158.2

Gemini 3.8 Flash 157.6

Muse Spark 1.3 157.4

Claude Sonnet 5 157

Grok 4.6 156.9

GPT-6 Luna 156.8

GPT-5.6 Luna 156.7

Qwen3.8-Max 156.2

GLM-5.3 156.2

Muse Spark 1.2 155.2

Muse Spark Open 155.1

Gemini 3.5 Flash 155

Gemini 3.6 Flash 154.7

Grok 4.7 154.6

Grok 4.5 154.4

Muse Spark 1.1 154.2

GLM 5.2 152.1

Qwen3.8 151.8

Mistral Large 4 150.6

Kimi K2.7 Code 150.2

Inkling 148.5

Nemotron 3 Ultra 146

39 models · 2 drops · Epoch Capabilities Index (2026-11-04)

AA-Briefcase v1.1

29 models compared.

Claude Sonnet 5.5max 1813 Elo

Claude Opus 5.5max 1800 Elo

Muse Wonder Fullmax 1729 Elo

Kimi K3.1 Pro 1675 Elo

Fable 5.1max 1669 Elo

Muse Wondermax 1659 Elo

23 more

Grok 4.7xhigh 1637 Elo

Gemini 4 Carbonhigh 1610 Elo

Qwen3.8-Max 1607 Elo

Claude Haiku 5.5max 1574 Elo

DeepSeek V4.1 Flash 1017max 1570 Elo

GPT-6 Astramax 1569 Elo

GPT-6.1 Solmax 1555 Elo

Grok 4.6high 1546 Elo

Ling-3.1-flash-1019 1522 Elo

MiMo-V2.6-Pro 1512 Elo

GLM-5.3max 1503 Elo

Kimi K3max 1497 Elo

GPT-5.6 Solmax 1487 Elo

Gemini 4 Argonhigh 1484 Elo

MiniMax M3.1 Flash 1475 Elo

GPT-6.1 Terramax 1401 Elo

Qwen3.8xhigh 1393 Elo

Mistral Large 4high 1348 Elo

GPT-6 Lunamax 1337 Elo

Muse Spark Openxhigh 1278 Elo

Gemini 3.8 Flashhigh 1203 Elo

Nemotron 3.5 Super VL 999 Elo

Inklingxhigh 833 Elo

29 models · 2 drops · Artificial Analysis (2026-11-04), Grok 4.7

AutomationBench-AA

Business automations, run by Artificial Analysis.

Gemini 4 Carbonhigh 77.8%

Gemini 4 Argonhigh 77.5%

Kimi K3.1 Pro 73.3%

MiniMax M3.1 Flash 72.5%

Claude Sonnet 5.5max 71.8%

Muse Wonder Fullmax 71.3%

21 more

Claude Opus 5.5max 69.5%

GPT-6 Astramax 68.5%

Muse Wondermax 68.1%

Ling-3.1-flash-1019 67.5%

DeepSeek V4.1 Flash 1017max 66.6%

Grok 4.7xhigh 65.6%

GPT-6.1 Solmax 64.9%

GLM-5.3max 62.2%

GPT-6.1 Terramax 60.2%

Gemini 3.8 Flashhigh 59.9%

Fable 5.1max 59.4%

MiMo-V2.6-Pro 58.6%

Kimi K3max 58.3%

Mistral Large 4high 57.8%

Qwen3.8-Max 56.2%

GPT-6 Lunamax 53.2%

Muse Spark Openxhigh 49.7%

Qwen3.8xhigh 48.2%

Claude Haiku 5.5max 35.4%

Nemotron 3.5 Super VL 14.8%

Inklingxhigh 5%

27 models · 2 drops · Artificial Analysis (2026-11-04)

APEX-Agents

11 models compared.

Claude Opus 5.5max 73.5%

Fable 5.1max 68.6%

Kimi K3.1 Promax 67.2%

GPT-6 Astramax 64.7%

DeepSeek V4.1 Flash 1017max 63.4%

Claude Opus 5 60.6%

5 more

Fable 5max 59.2%

Grok 4.6high 57.5%

GPT-5.6 Solmax 56.7%

GLM-5.3max 56.6%

Grok 4.5high 47.1%

11 models · 2 drops · Kimi K3.1 Pro, Grok 4.6

Agents' Last Exam v1

9 models compared.

Claude Opus 5.5max 63.2%

GPT-6.1 Terramax 60%

GPT-6 Astramax 59.3%

GPT-6.1 Solmax 58.6%

GPT-6 Solmax 56.4%

GPT-5.6 Solmax 52.8%

3 more

Claude Opus 5max 52.7%

GPT-6 Lunamax 50.9%

GPT-5.6 Terramax 50.7%

9 models · 2 drops · GPT-6.1 Terra, GPT-6 Sol & GPT-6 Luna

Chartography (with tools)

9 models compared.

GPT-6 Astramax 91%

Kimi K3.1 Promax 90.2%

Claude Opus 5.5max 89%

Fable 5.1max 88.4%

Claude Opus 5 84%

DeepSeek V4.1 Flash 1017 83%

3 more

GPT-5.6 Sol 79.9%

DeepSeek V4.1 Flash 78.9%

Kimi K3 68.1%

9 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

PinchBench

9 models compared.

Kimi K2.6 90.2%

Nemotron 3 Ultra 90%

Qwen3.6 35B A3B 88.1%

Qwen3.5 397B 86.6%

Nemotron 3.5 Lightning 85.4%

GLM-5.1 81.2%

3 more

Gemma 4 26B A4B 74.7%

Nemotron 3 Nano 66.1%

gpt-oss-20b 57.2%

9 models · 2 drops · Nemotron 3 Ultra, Nemotron 3.5 Lightning

Agents' Last Exam (CLI)

8 models compared.

Kimi K3.1 Promax 44.2%

Claude Opus 5.5max 40.7%

GPT-6 Astramax 38.8%

DeepSeek V4.1 Flash 1017max 36%

GPT-5.6 Sol 28.6%

GLM-5.3 28.5%

2 more

Kimi K3 27.6%

Fable 5 23.8%

8 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

HealthBench Professional

8 models compared.

Mythos 5 66%

Claude Mythos Preview 64.7%

Fable 5.1max 62.1%

GPT-5.6 Solmax 60.5%

Claude Opus 4.8 56.9%

Grok 4.7xhigh 56.7%

2 more

GPT-5.5 51.8%

Grok 4.6high 48.5%

8 models · 2 drops · Fable 5 / Mythos 5, Grok 4.7

SWE-Marathon

8 models compared.

Muse Wonder Fullxhigh 57.5%

Muse Wondermax 53.1%

Kimi K3.1 Promax 51.7%

Claude Opus 5.5max 46.3%

Fable 5.1max 45.6%

GPT-6 Astramax 42.5%

2 more

GLM-5.3max 42.5%

DeepSeek V4.1 Flash 1017max 40%

8 models · 2 drops · Muse Wonder, Kimi K3.1 Pro

Toolathlon-Verified

8 models compared.

Claude Opus 5 80.6%

MiMo-V2.6-Pro 76.9%

Kimi K3 76.5%

GPT-5.6 Sol 74.9%

Nanbeige4.3-33Bmax 70.4%

Qwen3.8max 68.5%

2 more

Muse Glimmer-30Bmax 47.2%

Gemma 4max 27.8%

8 models · 2 drops · MiMo-V2.6-Pro, Nanbeige4.3-33B model card

Vals Index

8 models compared.

Gemini 4 Argonmax 68.9%

Claude Opus 5.5 67%

Fable 5.1 65.8%

GPT-6 Astra 63.1%

GLM-5.3 53.5%

Kimi K3 50.3%

2 more

Mistral Large 4 48.1%

DeepSeek V4 Pro 0813 47.6%

8 models · 2 drops · Gemini 4 Argon, Mistral Large 4

HLE-Verified

7 models compared.

Gemini 3.8 Flashmax 54.9%

GPT-5.6 Solmax 54.5%

Claude Opus 5max 54.4%

Gemini 3.7 Flashhigh 53.6%

Gemini 3.6 Flash 51.2%

GPT-5.6 Terramax 51.1%

1 more

Claude Sonnet 5max 31%

7 models · 2 drops · Gemini 3.8 Flash, Gemini 3.7 Flash

Terminal-Bench 2.1 (standard harness)

7 models compared.

Claude Opus 5 89.1%

GPT-5.6 Terra 88%

GPT-5.6 Sol 88%

Gemini 3.8 Flashhigh 87.6%

Muse Spark 1.3xhigh 85.4%

Grok 4.5 81.6%

1 more

Muse Spark 1.2 80.1%

7 models · 2 drops · Muse Spark 1.3, Muse Spark 1.2

AA-Briefcase

6 models compared.

Claude Opus 5 1715 Elo

Grok 4.6high 1577 Elo

Fable 5max 1574 Elo

Ling-3.1-flash-1019 1524 Elo

GPT-5.6 Solmax 1502 Elo

Grok 4.5high 1313 Elo

6 models · 2 drops · Grok 4.6, Ling-3.1-flash-1019 model card

CursorBench 4.0

Long coding tasks inside Cursor.

Claude Opus 5.5 57.8%

Fable 5.1max 51.8%

Claude Opus 5 46.6%

Grok 4.7xhigh 46.3%

GPT-5.6 Solmax 41.7%

Grok 4.6high 40.4%

6 models · 2 drops · Claude Opus 5.5, Grok 4.7

SWE-Atlas-QnA

6 models compared.

Fern 0.1 53.2%

Nanbeige4.3-33Bmax 50.8%

Qwen3.8max 41.9%

Muse Glimmer-30Bmax 17.7%

Nemotron 3 Ultra 16.1%

Gemma 4max 3.3%

6 models · 2 drops · Mirendil, "Introducing Fern", Nanbeige4.3-33B model card

Terminal-Bench 2.0

Hard tasks in a real terminal (2025 edition).

GPT-5.4 75.1%

Claude Sonnet 4.6max 59.1%

MAI-Code-1-Flash 54.8%

DeepSeek V3.2 46.4%

MAI-Thinking-1 46%

Claude Haiku 4.5 41.6%

6 models · 2 drops · MAI-Thinking-1, MAI-Code-1-Flash

τ²-bench Telecom

6 models compared.

GLM-5.3-Flash 98.5%

Qwen3.5-122B-A10B 87.2%

Nemotron 3 Ultra 83%

Nemotron 3.5 Super VL 73.2%

MAI-Code-1-Flash 71.7%

Claude Haiku 4.5 54.7%

6 models · 2 drops · Nemotron 3.5 Super VL, MAI-Code-1-Flash

Artificial Analysis Coding Agent Index

5 models compared.

Claude Opus 5.5 62

Gemini 4 Carbon 59

Grok 4.7 56

Gemini 4 Argon 53

Grok 4.6 47

5 models · 2 drops · Gemini 4 Carbon, Grok 4.7

EnterpriseOps-Gym

5 models compared.

Nanbeige4.3-33Bmax 41%

Qwen3.8max 40.2%

Muse Glimmer-30Bmax 30.5%

LFM3-1.7B 28.2%

Gemma 4max 27.3%

5 models · 2 drops · Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

FrontierSWE v2

Frontier software engineering tasks.

GPT-6 Astramax 65.5%

Claude Opus 5.5max 62.3%

Gemini 4 Carbonmax 61.2%

Fable 5.1max 56.3%

Gemini 4 Argonmax 55%

5 models · 2 drops · Gemini 4 Carbon

MMLU-Pro

3 models compared.

Claude Sonnet 4.6max 87%

MAI-Thinking-1 85%

Clover-35B-A3B-Preview 84.8%

3 models · 2 drops · MAI-Thinking-1, DiffuSpace, "Clover-35B-A3B-Preview"

SWE-Bench Multilingual

3 models compared.

MAI-Code-1-Flash 65.5%

Claude Haiku 4.5 62.7%

LFM3-1.7B 23%

3 models · 2 drops · MAI-Code-1-Flash, Liquid AI, "Introducing LFM3"

From a single launch

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Claude Opus 5.5max 46.4%

GPT-6 Astramax 42.4%

GPT-6.1 Terramax 42.3%

Claude Sonnet 5.5max 41.7%

Gemini 4 Carbonhigh 40.6%

GPT-6.1 Solmax 40.6%

21 more

Muse Wonder Fullmax 37.8%

Claude Haiku 5.5max 34.9%

Fable 5.1max 31.6%

Hy4 31%

Grok 4.7xhigh 28.7%

DeepSeek V4.1 Flash 1017max 28.5%

Muse Wondermax 27.9%

Gemini 4 Argonhigh 25.7%

Kimi K3.1 Pro 25.5%

GPT-6 Lunamax 25.2%

MiMo-V2.6-Pro 24%

Qwen3.8-Max 23.4%

GLM-5.3max 21.6%

MiniMax M3.1 Flash 20.8%

Gemini 3.8 Flashhigh 18.7%

Ling-3.1-flash-1019 17%

Mistral Large 4high 15%

Qwen3.8xhigh 14.9%

Muse Spark Openxhigh 7.6%

Nemotron 3.5 Super VL 6.1%

Inklingxhigh 3.9%

27 models · 1 drop · Artificial Analysis (2026-11-04), Tencent Hunyuan Hy4 launch post

Artificial Analysis Intelligence Index v5.0

26 models compared.

Gemini 4 Carbonhigh 60

Claude Opus 5.5max 59.1

GPT-6 Astramax 56.9

GPT-6.1 Solmax 54.6

Claude Sonnet 5.5max 54.5

GPT-6.1 Terramax 51.3

20 more

Gemini 4 Argonhigh 50.4

Muse Wonder Fullmax 50.1

Fable 5.1max 49.2

Kimi K3.1 Pro 46.5

Muse Wondermax 43.6

Claude Haiku 5.5max 36.5

Grok 4.7xhigh 35.5

Qwen3.8-Max 33.7

DeepSeek V4.1 Flash 1017max 32.6

GLM-5.3max 31.7

Gemini 3.8 Flashhigh 30.8

MiMo-V2.6-Pro 29.9

Ling-3.1-flash-1019 29.6

MiniMax M3.1 Flash 29.1

GPT-6 Lunamax 27.9

Mistral Large 4high 26.1

Muse Spark Openxhigh 24.9

Qwen3.8xhigh 20.1

Nemotron 3.5 Super VL 13.6

Inklingxhigh 12.5

26 models · 1 drop · Artificial Analysis (2026-11-04)

Vals Index v2.2

24 models compared.

Claude Sonnet 5.5 70.9%

Gemini 4 Carbon 70.5%

Claude Opus 5.5 70.2%

Gemini 4 Argon 69.2%

Muse Wonder Full 66.8%

GPT-6 Astra 65%

18 more

Muse Wonder 64.9%

GPT-6.1 Sol 63.9%

Kimi K3.1 Pro 62.5%

DeepSeek V4.1 Flash 1017 61.3%

GPT-6.1 Terra 60.5%

GLM-5.3 59.7%

Qwen3.8-Max 59.1%

Claude Haiku 5.5 58.7%

Grok 4.7 58.6%

MiMo-V2.6-Pro 57.8%

Mistral Large 4 56.5%

Gemini 3.8 Flash 56%

MiniMax M3.1 Flash 53.8%

Kimi K3 53%

GPT-6 Luna 52.3%

Muse Spark Open 48.6%

Nemotron 3.5 Super VL 29.8%

Inkling 29%

24 models · 1 drop · Vals Index v2.2 (2026-11-04)

Artificial Analysis Cyber Index

14 models compared.

Kimi K3.1 Pro 64.1

DeepSeek V4.1 Flash 1017max 56.8

Grok 4.7xhigh 56.4

MiMo-V2.6-Pro 56.1

GPT-6 Lunamax 52.7

Mistral Large 4high 50.9

8 more

GLM-5.3-Flash 50

Kimi K3max 41.3

GLM-5.3max 36.4

GPT-6 Astramax 33.4

Claude Opus 5.5max 28.7

Gemini 3.8 Flashhigh 25.1

Fable 5.1max 25

Qwen3.8xhigh 12.7

14 models · 1 drop · Artificial Analysis (2026-11-04), Mistral Large 4

Apex Bench v1.1

6 models compared.

DeepSeek V4.1 Flash 1017 72.1%

Claude Opus 5 65.8%

DeepSeek V4.1 Flash 64.6%

GLM-5.3 56.6%

GPT-5.6 Sol 54.3%

Kimi K3 47.8%

6 models · 1 drop · DeepSeek V4.1 Flash 1017

BankerToolBench

6 models compared.

MiniMax M3.1 Flash 76.2

Claude Opus 5 76.2

GPT-5.6 Sol 74.6

GLM-5.3 74.5

DeepSeek V4.1 Flash 73.7

Kimi K3 69.1

6 models · 1 drop · MiniMax M3.1 Flash

Frontier Finance

6 models compared.

Fable 5.1max 60.8%

Kimi K3.1 Promax 58.6%

GLM-5.3max 57.5%

Claude Opus 5.5max 56.7%

DeepSeek V4.1 Flash 1017max 54.5%

GPT-6 Astramax 45%

6 models · 1 drop · Kimi K3.1 Pro

OfficeQA Pro v2

6 models compared.

Kimi K3.1 Promax 64.4%

Claude Opus 5.5max 62.2%

Fable 5.1max 54.5%

GPT-6 Astramax 54.4%

DeepSeek V4.1 Flash 1017max 40.4%

GLM-5.3max 31.1%

6 models · 1 drop · Kimi K3.1 Pro

Artificial Analysis Coding Agent Index v2.0

5 models compared.

Claude Opus 5.5max 62

Claude Sonnet 5.5max 59

GPT-6.1 Solmax 54

GPT-6.1 Terramax 48

GPT-6 Lunamax 31

5 models · 1 drop · GPT-6.1 Terra

BenchCAD (with tools)

5 models compared.

Claude Opus 5.5max 96.2%

GPT-6 Astramax 95.9%

Kimi K3.1 Promax 92.7%

Fable 5.1max 92.6%

DeepSeek V4.1 Flash 1017max 81.6%

5 models · 1 drop · Kimi K3.1 Pro

CyberGym-E2E

5 models compared.

Mistral Large 4 82%

MiMo-V2.6-Pro 79%

Grok 4.7 74%

Kimi K3 58%

GLM-5.3 29%

5 models · 1 drop · Mistral Large 4

Factual error rate

Lower is better.

GPT-6 Astramax 4.2%

GPT-6.1 Terramax 4.3%

GPT-6.1 Solmax 4.4%

GPT-6 Lunamax 18.4%

GPT-5.6 Terramax 22.3%

5 models · 1 drop · GPT-6.1 Terra

IFBench (loose)

5 models compared.

Gemma 4 26B A4B 77.3%

Nemotron 3 Nano 72.2%

Nemotron 3.5 Lightning 71.9%

gpt-oss-20b 68.5%

Qwen3.6 35B A3B 63.7%

5 models · 1 drop · Nemotron 3.5 Lightning

MemoryBench

5 models compared.

Muse Wondermax 85.6%

Muse Wonder Fullmax 85.5%

Claude Opus 5.5max 81.5%

GPT-6 Astramax 81.4%

Fable 5.1max 79%

5 models · 1 drop · Muse Wonder

MMMU-Pro

5 models compared.

Claude Opus 5.5max 87.7%

GPT-6 Astramax 86.9%

Fable 5.1max 86.3%

Kimi K3.1 Promax 84.1%

DeepSeek V4.1 Flash 1017max 80.6%

5 models · 1 drop · Kimi K3.1 Pro

MMMU-Pro Vision

5 models compared.

GPT-6 Astramax 86.7%

GPT-6.1 Solmax 86.3%

GPT-6.1 Terramax 85.5%

GPT-5.6 Terramax 81.7%

GPT-6 Lunamax 79.9%

5 models · 1 drop · GPT-6.1 Terra

OSWorld

5 models compared.

Claude Opus 5.5max 81.8%

Fable 5.1max 80.7%

Kimi K3.1 Promax 79.6%

GPT-6 Astramax 75.8%

DeepSeek V4.1 Flash 1017max 69.3%

5 models · 1 drop · Kimi K3.1 Pro

Personal Superintelligence Index

5 models compared.

Muse Wonder Fullmax 59.1

Claude Opus 5.5max 55.2

GPT-6 Astramax 54.5

Muse Wondermax 54.3

Fable 5.1max 49.9

5 models · 1 drop · Muse Wonder

SWE-sweep

5 models compared.

Gemini 4 Carbonmax 9.6%

GPT-6 Astramax 9.5%

Gemini 4 Argonmax 4.3%

Claude Opus 5.5max 3.6%

Fable 5.1max 2.9%

5 models · 1 drop · Gemini 4 Carbon

Vals Finance Agent v2

5 models compared.

Gemini 3.8 Flashmax 61.4%

Claude Opus 5max 58.6%

GPT-5.6 Terramax 54.4%

Claude Sonnet 5max 53.9%

GPT-5.6 Solmax 53.8%

5 models · 1 drop · Gemini 3.8 Flash

Agents' Last Exam v1.1

4 models compared.

Gemini 4 Carbonmax 77.4%

GPT-6 Astramax 73.1%

Claude Opus 5.5max 71.6%

Gemini 4 Argonmax 69%

4 models · 1 drop · Gemini 4 Carbon

AIME 2025

4 models compared.

Claude Opus 4.6 99.8%

MAI-Thinking-1 97%

Claude Sonnet 4.6max 95.6%

DeepSeek V3.2 93.1%

4 models · 1 drop · MAI-Thinking-1

Chartography

4 models compared.

Claude Sonnet 5.5 61.6%

Claude Haiku 5.5max 46.4%

GPT-6 Luna 29.1%

Claude Haiku 4.5 6.4%

4 models · 1 drop · Claude Haiku 5.5

Claw-Eval pass^3

4 models compared.

Nanbeige4.3-33Bmax 78.3%

Qwen3.8max 75.2%

Muse Glimmer-30Bmax 57.3%

Gemma 4max 44.2%

4 models · 1 drop · Nanbeige4.3-33B model card

CursorBench 3.2

4 models compared.

Fable 5max 70.5%

Grok 4.6high 69.9%

GPT-5.6 Solmax 67.2%

Grok 4.5high 66.7%

4 models · 1 drop · Grok 4.6

DeepPlanning

4 models compared.

Nanbeige4.3-33Bmax 63.3%

Qwen3.8max 49.2%

Muse Glimmer-30Bmax 21.4%

Gemma 4max 19.4%

4 models · 1 drop · Nanbeige4.3-33B model card

EEBench

4 models compared.

Grok 4.7xhigh 64%

Fable 5.1max 56.4%

Grok 4.6high 53%

GPT-5.6 Solmax 39.4%

4 models · 1 drop · Grok 4.7

Finance Agent v2

4 models compared.

GLM-5.3 55.8%

Mistral Large 4 54.7%

GPT-6 Astra 53.5%

Kimi K3 53.1%

4 models · 1 drop · Mistral Large 4

GDM-MRCR v2

4 models compared.

Gemini 3.6 Flashmax 91.8%

Grok 4.5max 81.4%

GPT-5.6 Lunamax 74.8%

Claude Sonnet 5max 71.6%

4 models · 1 drop · Gemini 3.6 Flash

GDPval rubrics

4 models compared.

Qwen3.8max 86.4%

Nanbeige4.3-33Bmax 84.8%

Muse Glimmer-30Bmax 75.8%

Gemma 4max 71.4%

4 models · 1 drop · Nanbeige4.3-33B model card

HLE-Diamond (no tools)

4 models compared.

Muse Spark Openxhigh 26.1%

Kimi K3max 22.2%

Qwen3.8-2.4T-A95Bxhigh 17.3%

GLM-5.3max 16.4%

4 models · 1 drop · Muse Spark Open

Meta Internal Coding Bench

4 models compared.

Claude Opus 5max 79.4%

Muse Spark 1.2xhigh 70.6%

Muse Spark 1.1xhigh 68.3%

GPT-5.6 Terramax 65.4%

4 models · 1 drop · Muse Spark 1.2

MLE-Bench

4 models compared.

Claude Sonnet 5max 66.9%

Gemini 3.6 Flashmax 63.9%

GPT-5.6 Lunamax 47.6%

Grok 4.5max 43.2%

4 models · 1 drop · Gemini 3.6 Flash

PaperBench

4 models compared.

Qwen3.8-Max 93%

GPT-5.6 Solmax 90.5%

Fable 5max 88.8%

Claude Opus 4.8max 80.3%

4 models · 1 drop · Qwen3.8-Max

SEC-Bench Pro

4 models compared.

GPT-5.6 Solmax 71.2%

GPT-5.6 Terramax 57.7%

GPT-5.6 Lunamax 48.9%

GPT-5.5xhigh 45.8%

4 models · 1 drop · GPT-5.6 Sol, Terra, & Luna

SkillsBench

4 models compared.

Nanbeige4.3-33Bmax 61.1%

Qwen3.8max 56.4%

Muse Glimmer-30Bmax 39.7%

Gemma 4max 28.9%

4 models · 1 drop · Nanbeige4.3-33B model card

ARC-AGI-1

3 models compared.

GPT-5.6 Terramax 96.5%

Gemini 3.7 Flash 95.5%

Gemini 3.6 Flashhigh 91.2%

3 models · 1 drop · Gemini 3.7 Flash

ARC-AGI-3

3 models compared.

GPT-6 Astra 99.9%

Claude Opus 5 30.2%

GPT-5.6 Sol 7.8%

3 models · 1 drop · GPT-6 Astra

BioMysteryBench hard

3 models compared.

Mythos 5 46.1%

Claude Opus 4.8 40%

Claude Mythos Preview 29.6%

3 models · 1 drop · Fable 5 / Mythos 5

BioMysteryBench human-solved

3 models compared.

Mythos 5 83.9%

Claude Mythos Preview 82.6%

Claude Opus 4.8 80.4%

3 models · 1 drop · Fable 5 / Mythos 5

CyberGym Level 1 leaderboard

3 models compared.

Wiz Atlas 90.9%

MAI-Cyber-1-Flash 86.3%

Claude Mythos Preview 83.1%

3 models · 1 drop · MAI-Cyber-1-Flash

DeepSearchQA

3 models compared.

GPT-5.6 Solmax 93.1%

Claude Opus 5max 90.4%

Muse Spark 1.3max 90.3%

3 models · 1 drop · Muse Spark 1.3

Dense200

3 models compared.

Mistral Large 4 42%

GPT-6 Astra 41.5%

Kimi K3 28.9%

3 models · 1 drop · Mistral Large 4

FrontierMath Tier 4

3 models compared.

GPT-6 Astra 97.6%

Fable 5.1 87.8%

GPT-5.6 Sol 83%

3 models · 1 drop · GPT-6 Astra

MRCR 512K-1M

3 models compared.

Muse Spark 1.3max 98.1%

GPT-5.6 Solmax 73.8%

Muse Spark 1.2xhigh 55.5%

3 models · 1 drop · Muse Spark 1.3

SWE-bench Pro v2 Hard

3 models compared.

Claude Opus 5.5 100%

Fern 0.1 76.5%

Nemotron 3 Ultra 31.4%

3 models · 1 drop · Mirendil, "Introducing Fern"

AA-Omniscience

2 models compared.

Gemini 4 Carbon 54

Claude Opus 5.5 48

2 models · 1 drop · Gemini 4 Carbon

Artifacts Bench

2 models compared.

Claude Haiku 4.5 36.6%

MAI-Code-1-Flash 36.4%

2 models · 1 drop · MAI-Code-1-Flash

Hermes Bench

2 models compared.

Nemotron 3.5 Super VL 63.4%

Nemotron 3 Ultra 56.3%

2 models · 1 drop · Nemotron 3.5 Super VL

RULER (1M)

2 models compared.

Nemotron 3 Ultra 94.7%

Qwen3.5 397B 90.1%

2 models · 1 drop · Nemotron 3 Ultra

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

GPT-6 Astramax 70.5%

GPT-6.1 Solmax 69.5%

Gemini 4 Carbonhigh 69%

GPT-6.1 Terramax 68%

Claude Opus 5.5max 68%

Claude Sonnet 5.5max 59%

21 more

Muse Wonder Fullmax 56.5%

Gemini 4 Argonhigh 52.5%

Fable 5.1max 52.5%

Muse Wondermax 50.5%

Kimi K3.1 Pro 49.5%

Gemini 3.8 Flashhigh 46.5%

Claude Haiku 5.5max 43.5%

GPT-6 Lunamax 42.5%

Kimi K3max 40.5%

Ling-3.1-flash-1019 38.5%

MiMo-V2.6-Pro 34%

GLM-5.3max 33.5%

Grok 4.7xhigh 33.5%

MiniMax M3.1 Flash 32.5%

Qwen3.8-Max 29.5%

Muse Spark Openxhigh 29.5%

Mistral Large 4high 27%

DeepSeek V4.1 Flash 1017max 25%

Inklingxhigh 18%

Nemotron 3.5 Super VL 13.5%

Qwen3.8xhigh 4%

27 models · 0 drops · Artificial Analysis (2026-11-04)

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Gemini 4 Carbonhigh 64.8%

GPT-6 Astramax 63.3%

Claude Opus 5.5max 59%

GPT-6.1 Solmax 58.1%

GPT-6.1 Terramax 57.6%

Claude Sonnet 5.5max 53.3%

21 more

Gemini 4 Argonhigh 52.9%

Fable 5.1max 43.3%

Muse Wonder Fullmax 37.1%

Kimi K3.1 Pro 34.3%

Muse Wondermax 25.7%

Claude Haiku 5.5max 20%

DeepSeek V4.1 Flash 1017max 12.9%

Qwen3.8-Max 11.9%

Grok 4.7xhigh 11.4%

Gemini 3.8 Flashhigh 10%

GLM-5.3max 9.5%

GPT-6 Lunamax 8.6%

Kimi K3max 8.1%

MiMo-V2.6-Pro 5.7%

Mistral Large 4high 4.3%

Ling-3.1-flash-1019 4.3%

MiniMax M3.1 Flash 3.3%

Muse Spark Openxhigh 1.9%

Qwen3.8xhigh 0.5%

Nemotron 3.5 Super VL 0%

Inklingxhigh 0%

27 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

5 May 2026

7 Jun 2026

8 Jul 2026

7 Aug 2026

10 Sep 2026

18 Oct 2026

2 Nov 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.