The benchmark board

Every score from our Model Drops from the last 90 days on one board, since Aug 11, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

72benchmarks

38models scored

470scores logged

27Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

Open weights only

DeepSWE v1.1

Best score rose 9.5 points, from 67.5% (Kimi K3) to 77% (DeepSeek V4.1 Flash 1017).

Open weights only

Terminal-Bench 4.0

Best score rose 53.1 points, from 12.6% (Kimi K3) to 65.7% (Kimi K3.1 Pro).

Open weights only

AutomationBench

Best score rose 15.5 points, from 46.7% (Kimi K3) to 62.2% (MiniMax M3.1 Flash).

Open weights only

Artificial Analysis Intelligence Index

Best score rose 36.8, from 18.2 (Qwen3.6 35B A3B) to 55 (Kimi K3.1 Pro).

Open weights only

GDPval-AA

Best score rose 309 Elo, from 1537 Elo (Kimi K3) to 1846 Elo (Kimi K3.1 Pro).

Open weights only

Terminal-Bench 2.1

Best score rose 45.5 points, from 44.4% (Qwen3.6 35B A3B) to 89.9% (MiMo-V2.6-Pro).

Open weights only

GPQA Diamond

Best score rose 10.8 points, from 83.4% (Qwen3.6 35B A3B) to 94.2% (Kimi K3.1 Pro).

Open weights only

OSWorld 2

Best score rose 20.6 points, from 58.3% (Kimi K3) to 78.9% (Hy4).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

Qwen3.6-27BQwen3.8

OSWorld-Verified: 63.9% to 84.3%

+20.4

DeepSeek V4.1 FlashDeepSeek V4.1 Flash 1017

Terminal-Bench 4.0: 31.2% to 42.3%

+11.1

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Open weights only

DeepSWE v1.1

Fixing issues in real repositories.

DeepSeek V4.1 Flash 1017max 77%

Kimi K3.1 Promax 75.5%

DeepSeek V4.1 Flash 74.2%

MiniMax M3.1 Flash 73.7%

MiMo-V2.6-Pro 71.9%

Kimi K3 67.5%

9 more

GLM-5.3max 66.9%

Nanbeige4.3-33Bmax 65.5%

Mistral Large 4 62%

Muse Spark Openxhigh 60%

DeepSeek V4 Pro 0813 57%

Qwen3.8-2.4T-A95Bxhigh 57%

Qwen3.8max 42.5%

Nemotron 3 Ultra 3.5%

Gemma 4max 2.7%

15 models · 20 drops · Kimi K3.1 Pro, MiniMax M3.1 Flash, MiMo-V2.6-Pro, Nanbeige4.3-33B model card, Muse Spark Open, Mistral Large 4, Mirendil, "Introducing Fern"

Open weights only

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Kimi K3.1 Promax 65.7%

Hy4 44.4%

DeepSeek V4.1 Flash 1017max 42.3%

GLM-5.3max 41.8%

LongCat-2.5 38.5%

MiniMax M3.1 Flash 38.1%

9 more

MiMo-V2.6-Pro 34.9%

DeepSeek V4.1 Flash 31.2%

Mistral Large 4 28.3%

Nanbeige4.3-33Bmax 23.8%

Kimi K3 12.6%

DeepSeek V4 Pro 0813 10%

Qwen3.8max 6.3%

Gemma 4max 0%

Nemotron 3 Ultra 0%

15 models · 19 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, Meituan LongCat-2.5 launch post, MiniMax M3.1 Flash, MiMo-V2.6-Pro, Mistral Large 4, Nanbeige4.3-33B model card, Mirendil, "Introducing Fern"

Open weights only

AutomationBench

Real business automations (Zapier).

MiniMax M3.1 Flash 62.2%

DeepSeek V4.1 Flash 1017 60.5%

Mistral Large 4 59.9%

DeepSeek V4 Pro 0813 56.7%

Hy4 56.2%

DeepSeek V4.1 Flash 54.8%

8 more

Nanbeige4.3-33Bmax 54.2%

MiMo-V2.6-Pro 53.1%

LongCat-2.5 51.8%

GLM-5.3 48.8%

Kimi K3 46.7%

Qwen3.8max 38.3%

SenseNova-Loop-9B-Preview 13.7%

Gemma 4max 9.7%

14 models · 16 drops · MiniMax M3.1 Flash, Mistral Large 4, Tencent Hunyuan Hy4 launch post, Nanbeige4.3-33B model card, MiMo-V2.6-Pro, Meituan LongCat-2.5 launch post, SenseNova-Loop-9B-Preview model card

Open weights only

Artificial Analysis Intelligence Index

20 models compared.

Kimi K3.1 Pro 55

MiMo-V2.6-Pro 46.3

DeepSeek V4.1 Flash 1017 45.1

GLM-5.3 44.8

Kimi K3 44

MiniMax M3.1 Flash 42.7

14 more

Qwen3.8-2.4T-A95B 39.9

DeepSeek V4.1 Flash 39.5

Muse Spark Open 38.9

Mistral Large 4 38.4

DeepSeek V4 Pro 0813 36

Qwen3.8 33.7

GLM-5.2 33.7

DeepSeek V4 Pro 30.4

Qwen3.6-27B 21.4

Qwen3.6 35B A3B 18.2

Gemma 4 26B A4B 16.7

Nemotron 3.5 Lightning 12.9

gpt-oss-20bhigh 9

Nemotron 3 Nano 8.9

20 models · 15 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open, Mistral Large 4, Qwen3.8, Nemotron 3.5 Lightning

Open weights only

GDPval-AA

Professional work products, graded head to head (Elo).

Kimi K3.1 Promax 1846 Elo

GLM-5.3 1769 Elo

DeepSeek V4.1 Flash 1017max 1746 Elo

MiMo-V2.6-Pro 1673 Elo

Qwen3.8-2.4T-A95Bxhigh 1613 Elo

Kimi K3max 1537 Elo

2 more

Mistral Large 4 1424 Elo

Muse Spark Openxhigh 1401 Elo

8 models · 14 drops · Kimi K3.1 Pro, GLM-5.3, MiMo-V2.6-Pro, Muse Spark Open

Open weights only

Terminal-Bench 2.1

19 models compared.

MiMo-V2.6-Pro 89.9%

LongCat-2.5 88.4%

Kimi K3max 85%

GLM-5.3max 83.9%

Qwen3.8-2.4T-A95Bxhigh 82%

Nanbeige4.3-33Bmax 80.9%

13 more

Muse Spark Openxhigh 76.4%

Qwen3.8max 73%

Qwen3.7-Plusmax 64%

Qwen3.6-27Bmax 63.4%

Clover-35B-A3B-Preview 51.7%

Gemma 4max 47.2%

Qwen3.6 35B A3B 44.4%

SenseNova-Loop-9B-Preview 40.5%

Gemma 4 26B A4B 37.2%

Nemotron 3.5 Lightning 24.6%

gpt-oss-20b 15.2%

LFM3-1.7B 12.9%

Nemotron 3 Nano 8.3%

19 models · 13 drops · MiMo-V2.6-Pro, Meituan LongCat-2.5 launch post, Muse Spark Open, Nanbeige4.3-33B model card, Qwen3.8, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, SenseNova-Loop-9B-Preview model card, Liquid AI, "Introducing LFM3"

Open weights only

GPQA Diamond

23 models compared.

Kimi K3.1 Promax 94.2%

Qwen3.8-2.4T-A95Bxhigh 93.5%

Kimi K3max 93.5%

Qwen3.8-Flash-Next 92.7%

DeepSeek V4.1 Flash 1017max 92.2%

GLM-5.3max 91.7%

17 more

Gemma 4max 91.3%

Qwen3.7-Plusmax 90.3%

Nemotron 3.5 Super VL 89.5%

Nanbeige4.3-33Bmax 89.5%

Qwen3.8max 89.2%

Muse Spark Openxhigh 89%

Qwen3.6-27Bmax 87.8%

Nemotron 3 Ultra 87%

Qwen3.5-122B-A10B 86.7%

Clover-35B-A3B-Preview 83.8%

Qwen3.6 35B A3B 83.4%

DeepSeek V3.2 82.4%

Gemma 4 26B A4B 79.6%

Nemotron 3.5 Lightning 75.4%

Nemotron 3 Nano 74.1%

gpt-oss-20b 71.5%

LFM3-1.7B 63.4%

23 models · 10 drops · Kimi K3.1 Pro, Muse Spark Open, Nemotron 3.5 Super VL, Nanbeige4.3-33B model card, Qwen3.8, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, MAI-Thinking-1, Liquid AI, "Introducing LFM3"

Open weights only

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

DeepSeek V4.1 Flash 1017 83.9

Qwen3.8 83.6

GLM-5.3 78.4

Nemotron 3.5 Lightning 77.3

MiMo-V2.6-Pro 71.3

Nemotron 3.5 Super VL 68.2

4 more

Kimi K3.1 Pro 67.5

MiniMax M3.1 Flash 61.1

Muse Spark Open 52.7

Mistral Large 4 49.4

10 models · 10 drops · Every model's sources, quotes and method

Open weights only

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Kimi K3.1 Promax 51.1%

Qwen3.8max 43.6%

Kimi K3 43.5%

DeepSeek V4.1 Flash 1017 42.6%

Qwen3.8-Flash-Next 39.6%

DeepSeek V4.1 Flash 36.8%

4 more

Nemotron 3.5 Super VL 31.8%

Nemotron 3 Ultra 29.2%

Qwen3.5-122B-A10B 24.2%

LFM3-1.7B 7.2%

10 models · 8 drops · Kimi K3.1 Pro, Qwen3.8, DeepSeek V4.1 Flash 1017, Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

Open weights only

OSWorld 2

Using a computer: apps, files and the web.

Hy4 78.9%

MiniMax M3.1 Flash 61.7%

Kimi K3 58.3%

DeepSeek V4.1 Flash 54.3%

4 models · 8 drops · Tencent Hunyuan Hy4 launch post, MiniMax M3.1 Flash

Open weights only

Harvey Legal Agent Benchmark

Legal work end to end.

Kimi K3.1 Promax 23.7%

DeepSeek V4.1 Flash 1017max 21%

Mistral Large 4 15.8%

Kimi K3 12.9%

GLM-5.3 8.3%

5 models · 7 drops · Kimi K3.1 Pro, Mistral Large 4

Open weights only

SWE-bench Verified

12 models compared.

GLM-5.3-Flash 79.1%

Nemotron 3 Ultra 73.9%

Clover-35B-A3B-Preview 73.6%

DeepSeek V3.2 73.1%

Qwen3.5-122B-A10B 71.9%

Nemotron 3.5 Super VL 71.1%

6 more

Qwen3.6 35B A3B 70.1%

Gemma 4 26B A4B 57.4%

gpt-oss-20b 52.4%

Nemotron 3.5 Lightning 51.6%

LFM3-1.7B 43.4%

Nemotron 3 Nano 34.1%

12 models · 6 drops · Nemotron 3.5 Super VL, DiffuSpace, "Clover-35B-A3B-Preview", MAI-Thinking-1, Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

Open weights only

Terminal-Bench Science

Scientific computing tasks in a terminal.

Kimi K3.1 Promax 38.1%

Hy4 19.8%

DeepSeek V4.1 Flashmax 15.7%

GLM-5.3max 8.1%

4 models · 6 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post

Open weights only

ProgramBench

7 models compared.

Kimi K3.1 Promax 31.5%

Hy4 30%

DeepSeek V4.1 Flash 1017 29.1%

LongCat-2.5 25.5%

DeepSeek V4.1 Flash 20.3%

GLM-5.3max 19%

1 more

Kimi K3 17.5%

7 models · 5 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, Meituan LongCat-2.5 launch post

Open weights only

AA-LCR

18 models compared.

MiMo-V2.6-Pro 86.3%

Kimi K3.1 Pro 86.3%

Nanbeige4.3-33Bmax 84%

DeepSeek V4.1 Flash 1017max 82.7%

Ling-3.1-flash-1019 82.3%

Qwen3.8xhigh 82%

12 more

MiniMax M3.1 Flash 79.7%

GLM-5.3max 79.7%

Muse Spark Openxhigh 78.3%

Gemma 4max 72%

Clover-35B-A3B-Preview 72%

Nemotron 3.5 Super VL 69%

Qwen3.6 35B A3B 61.1%

Gemma 4 26B A4B 57.6%

LFM3-1.7B 52.8%

Nemotron 3.5 Lightning 52%

gpt-oss-20b 32.9%

Nemotron 3 Nano 32.8%

18 models · 4 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", Nemotron 3.5 Lightning, Liquid AI, "Introducing LFM3"

Open weights only

SWE-bench Pro

10 models compared.

Qwen3.8max 61.7%

Qwen3.8-Flash-Next 60.4%

Nanbeige4.3-33Bmax 60.3%

GLM-5.3-Flash 59.7%

Kimi K2.6 58.6%

Qwen3.7-Plusmax 57.6%

4 more

Qwen3.6-27Bmax 53.5%

Nemotron 3.5 Super VL 51.8%

Gemma 4max 51.2%

Nemotron 3 Ultra 49.7%

10 models · 4 drops · Qwen3.8, Nemotron 3.5 Super VL, Nanbeige4.3-33B model card, MAI-Thinking-1

Open weights only

JobBench

8 models compared.

MiMo-V2.6-Pro 62%

Muse Spark Openxhigh 61.8%

GLM-5.3max 61.4%

Kimi K3max 54.3%

Qwen3.8-2.4T-A95Bxhigh 52.7%

Nanbeige4.3-33Bmax 44.8%

2 more

Qwen3.8max 34.5%

Gemma 4max 9%

8 models · 4 drops · MiMo-V2.6-Pro, Muse Spark Open, Nanbeige4.3-33B model card

Open weights only

Agents' Last Exam

7 models compared.

Kimi K3.1 Promax 43.2%

Hy4 41%

DeepSeek V4.1 Flash 1017 35.4%

DeepSeek V4.1 Flash 31.8%

MiniMax M3.1 Flash 29.6%

Kimi K3 28.3%

1 more

GLM-5.3max 26.2%

7 models · 4 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash

Open weights only

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Kimi K3.1 Promax 70%

GLM-5.3 62.5%

Kimi K3 59.8%

DeepSeek V4.1 Flash 1017max 58.8%

LFM3-1.7B 13.9%

5 models · 4 drops · Kimi K3.1 Pro, GLM-5.3, Liquid AI, "Introducing LFM3"

Open weights only

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Kimi K3.1 Pro 67.2%

GLM-5.3max 41.9%

MiMo-V2.6-Pro 34.8%

DeepSeek V4.1 Flash 1017max 33.8%

Ling-3.1-flash-1019 32.8%

DeepSeek V4.1 Flash 27%

7 more

MiniMax M3.1 Flash 25.8%

Mistral Large 4high 24.7%

Kimi K3 17.2%

DeepSeek V4 Pro 0813 14.1%

Muse Spark Openxhigh 8.1%

Qwen3.8xhigh 5.6%

Nemotron 3.5 Super VL 0%

13 models · 3 drops · Artificial Analysis (2026-11-04), Grok 4.7, Mistral Large 4

Open weights only

NL2Repo

7 models compared.

DeepSeek V4.1 Flash 1017 68.2%

DeepSeek V4.1 Flash 65.4%

MiniMax M3.1 Flash 61.2%

Kimi K3 58%

GLM-5.3 58%

Nanbeige4.3-33Bmax 53%

1 more

Qwen3.8max 48.3%

7 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

Open weights only

BrowseComp

6 models compared.

Kimi K3.1 Promax 92.1%

LongCat-2.5 91.9%

Qwen3.6 35B A3B 48.7%

Nemotron 3.5 Lightning 37%

Gemma 4 26B A4B 26.3%

Nemotron 3 Nano 13.7%

6 models · 3 drops · Kimi K3.1 Pro, Meituan LongCat-2.5 launch post, Nemotron 3.5 Lightning

Open weights only

SciCode

5 models compared.

Ling-3.1-flash-1019 57%

Nanbeige4.3-33Bmax 52.6%

Qwen3.8max 46.7%

Gemma 4max 45.5%

LFM3-1.7B 28.5%

5 models · 3 drops · Ling-3.1-flash-1019 model card, Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Open weights only

Tau3-Bench

5 models compared.

LFM3-1.7B 68%

Clover-35B-A3B-Preview 65.3%

Nanbeige4.3-33Bmax 48.8%

Qwen3.8max 48.5%

Gemma 4max 18.6%

5 models · 3 drops · Liquid AI, "Introducing LFM3", DiffuSpace, "Clover-35B-A3B-Preview", Nanbeige4.3-33B model card

Open weights only

ZeroBench (with tools)

5 models compared.

Kimi K3.1 Promax 63%

DeepSeek V4.1 Flash 1017 51%

Muse Spark Openxhigh 50%

DeepSeek V4.1 Flash 49%

Kimi K3max 41%

5 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open

Open weights only

BabyVision (with tools)

4 models compared.

Kimi K3.1 Promax 95.4%

DeepSeek V4.1 Flash 1017 92.5%

DeepSeek V4.1 Flash 89.6%

Kimi K3 85.7%

4 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Open weights only

GDP.pdf

Work products built from PDFs (Surge AI).

Kimi K3.1 Promax 34.6%

DeepSeek V4.1 Flash 1017max 17.2%

GLM-5.3max 11.2%

3 models · 3 drops · Kimi K3.1 Pro

Open weights only

Terminal-Bench 3.0

2 models compared.

GLM-5.3 28.3%

Kimi K3 17.4%

2 models · 3 drops · GLM-5.3

Open weights only

AA-Briefcase v1.1

10 models compared.

Kimi K3.1 Pro 1675 Elo

DeepSeek V4.1 Flash 1017max 1570 Elo

Ling-3.1-flash-1019 1522 Elo

MiMo-V2.6-Pro 1512 Elo

GLM-5.3max 1503 Elo

MiniMax M3.1 Flash 1475 Elo

4 more

Qwen3.8xhigh 1393 Elo

Mistral Large 4high 1348 Elo

Muse Spark Openxhigh 1278 Elo

Nemotron 3.5 Super VL 999 Elo

10 models · 2 drops · Artificial Analysis (2026-11-04)

Open weights only

AutomationBench-AA

Business automations, run by Artificial Analysis.

Kimi K3.1 Pro 73.3%

MiniMax M3.1 Flash 72.5%

Ling-3.1-flash-1019 67.5%

DeepSeek V4.1 Flash 1017max 66.6%

GLM-5.3max 62.2%

MiMo-V2.6-Pro 58.6%

4 more

Mistral Large 4high 57.8%

Muse Spark Openxhigh 49.7%

Qwen3.8xhigh 48.2%

Nemotron 3.5 Super VL 14.8%

10 models · 2 drops · Artificial Analysis (2026-11-04)

Open weights only

IFBench

5 models compared.

Nemotron 3 Ultra 82.9%

LFM3-1.7B 73%

Nemotron 3.5 Super VL 70.9%

Qwen3.5-122B-A10B 67.6%

GLM-5.3-Flash 57.7%

5 models · 2 drops · Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

Open weights only

MCP Atlas

5 models compared.

Muse Spark Openxhigh 89.2%

Qwen3.8-2.4T-A95Bxhigh 84.5%

GLM-5.3max 84.2%

Kimi K3max 82.3%

LFM3-1.7B 32.6%

5 models · 2 drops · Muse Spark Open, Liquid AI, "Introducing LFM3"

Open weights only

OSWorld-Verified

Using a computer: apps, files and the web (2025 edition).

Kimi K3 84.8%

Qwen3.8max 84.3%

MiMo-V2.6-Pro 82%

Qwen3.7-Plusmax 73.3%

Qwen3.6-27Bmax 63.9%

5 models · 2 drops · MiMo-V2.6-Pro, Qwen3.8

Open weights only

Toolathlon-Verified

5 models compared.

MiMo-V2.6-Pro 76.9%

Kimi K3 76.5%

Nanbeige4.3-33Bmax 70.4%

Qwen3.8max 68.5%

Gemma 4max 27.8%

5 models · 2 drops · MiMo-V2.6-Pro, Nanbeige4.3-33B model card

Open weights only

Agents' Last Exam (CLI)

4 models compared.

Kimi K3.1 Promax 44.2%

DeepSeek V4.1 Flash 1017max 36%

GLM-5.3 28.5%

Kimi K3 27.6%

4 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

Open weights only

Chartography (with tools)

4 models compared.

Kimi K3.1 Promax 90.2%

DeepSeek V4.1 Flash 1017 83%

DeepSeek V4.1 Flash 78.9%

Kimi K3 68.1%

4 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Open weights only

CharXiv Reasoning

4 models compared.

Qwen3.5-122B-A10B 83.5%

GLM-5.3-Flash 81.9%

Nemotron 3.5 Super VL 80.8%

Inkling Small 77.8%

4 models · 2 drops · Nemotron 3.5 Super VL

Open weights only

EnterpriseOps-Gym

4 models compared.

Nanbeige4.3-33Bmax 41%

Qwen3.8max 40.2%

LFM3-1.7B 28.2%

Gemma 4max 27.3%

4 models · 2 drops · Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Open weights only

LiveCodeBench

4 models compared.

DeepSeek V4 93.5%

Kimi K2.6 89.6%

DeepSeek V3.2 83.3%

LFM3-1.7B 73.5%

4 models · 2 drops · MAI-Thinking-1, Liquid AI, "Introducing LFM3"

Open weights only

SWE-Atlas-QnA

4 models compared.

Nanbeige4.3-33Bmax 50.8%

Qwen3.8max 41.9%

Nemotron 3 Ultra 16.1%

Gemma 4max 3.3%

4 models · 2 drops · Nanbeige4.3-33B model card, Mirendil, "Introducing Fern"

Open weights only

Vals Index

4 models compared.

GLM-5.3 53.5%

Kimi K3 50.3%

Mistral Large 4 48.1%

DeepSeek V4 Pro 0813 47.6%

4 models · 2 drops · Mistral Large 4

Open weights only

APEX-Agents

3 models compared.

Kimi K3.1 Promax 67.2%

DeepSeek V4.1 Flash 1017max 63.4%

GLM-5.3max 56.6%

3 models · 2 drops · Kimi K3.1 Pro

Open weights only

CyberGym

3 models compared.

GLM-5.3 84.5%

MiniMax M3.1 Flash 82.2%

Kimi K3 80%

3 models · 2 drops · MiniMax M3.1 Flash

Open weights only

ExploitBench

3 models compared.

Kimi K3.1 Promax 74.7%

GLM-5.3 54.4%

Kimi K3 32.2%

3 models · 2 drops · Kimi K3.1 Pro, GLM-5.3

Open weights only

SWE-Marathon

3 models compared.

Kimi K3.1 Promax 51.7%

GLM-5.3max 42.5%

DeepSeek V4.1 Flash 1017max 40%

3 models · 2 drops · Kimi K3.1 Pro

From a single launch

Open weights only

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Hy4 31%

DeepSeek V4.1 Flash 1017max 28.5%

Kimi K3.1 Pro 25.5%

MiMo-V2.6-Pro 24%

GLM-5.3max 21.6%

MiniMax M3.1 Flash 20.8%

5 more

Ling-3.1-flash-1019 17%

Mistral Large 4high 15%

Qwen3.8xhigh 14.9%

Muse Spark Openxhigh 7.6%

Nemotron 3.5 Super VL 6.1%

11 models · 1 drop · Tencent Hunyuan Hy4 launch post, Artificial Analysis (2026-11-04)

Open weights only

Artificial Analysis Intelligence Index v5.0

10 models compared.

Kimi K3.1 Pro 46.5

DeepSeek V4.1 Flash 1017max 32.6

GLM-5.3max 31.7

MiMo-V2.6-Pro 29.9

Ling-3.1-flash-1019 29.6

MiniMax M3.1 Flash 29.1

4 more

Mistral Large 4high 26.1

Muse Spark Openxhigh 24.9

Qwen3.8xhigh 20.1

Nemotron 3.5 Super VL 13.6

10 models · 1 drop · Artificial Analysis (2026-11-04)

Open weights only

Artificial Analysis Cyber Index

8 models compared.

Kimi K3.1 Pro 64.1

DeepSeek V4.1 Flash 1017max 56.8

MiMo-V2.6-Pro 56.1

Mistral Large 4high 50.9

GLM-5.3-Flash 50

Kimi K3 41

2 more

GLM-5.3max 36.4

Qwen3.8xhigh 12.7

8 models · 1 drop · Artificial Analysis (2026-11-04), Mistral Large 4

Open weights only

Vals Index v2.2

8 models compared.

Kimi K3.1 Pro 62.5%

DeepSeek V4.1 Flash 1017 61.3%

GLM-5.3 59.7%

MiMo-V2.6-Pro 57.8%

Mistral Large 4 56.5%

MiniMax M3.1 Flash 53.8%

2 more

Muse Spark Open 48.6%

Nemotron 3.5 Super VL 29.8%

8 models · 1 drop · Vals Index v2.2 (2026-11-04)

Open weights only

Epoch Capabilities Index

5 models compared.

DeepSeek V4.1 Flash 1017 158.8

GLM-5.3 156.2

Muse Spark Open 155.1

Qwen3.8 151.8

Mistral Large 4 150.6

5 models · 1 drop · Epoch Capabilities Index (2026-11-04)

Open weights only

IFBench (loose)

5 models compared.

Gemma 4 26B A4B 77.3%

Nemotron 3 Nano 72.2%

Nemotron 3.5 Lightning 71.9%

gpt-oss-20b 68.5%

Qwen3.6 35B A3B 63.7%

5 models · 1 drop · Nemotron 3.5 Lightning

Open weights only

PinchBench

5 models compared.

Qwen3.6 35B A3B 88.1%

Nemotron 3.5 Lightning 85.4%

Gemma 4 26B A4B 74.7%

Nemotron 3 Nano 66.1%

gpt-oss-20b 57.2%

5 models · 1 drop · Nemotron 3.5 Lightning

Open weights only

Apex Bench v1.1

4 models compared.

DeepSeek V4.1 Flash 1017 72.1%

DeepSeek V4.1 Flash 64.6%

GLM-5.3 56.6%

Kimi K3 47.8%

4 models · 1 drop · DeepSeek V4.1 Flash 1017

Open weights only

BankerToolBench

4 models compared.

MiniMax M3.1 Flash 76.2

GLM-5.3 74.5

DeepSeek V4.1 Flash 73.7

Kimi K3 69.1

4 models · 1 drop · MiniMax M3.1 Flash

Open weights only

CyberGym-E2E

4 models compared.

Mistral Large 4 82%

MiMo-V2.6-Pro 79%

Kimi K3 58%

GLM-5.3 29%

4 models · 1 drop · Mistral Large 4

Open weights only

HLE-Diamond (no tools)

4 models compared.

Muse Spark Openxhigh 26.1%

Kimi K3max 22.2%

Qwen3.8-2.4T-A95Bxhigh 17.3%

GLM-5.3max 16.4%

4 models · 1 drop · Muse Spark Open

Open weights only

τ²-bench Telecom

4 models compared.

GLM-5.3-Flash 98.5%

Qwen3.5-122B-A10B 87.2%

Nemotron 3 Ultra 83%

Nemotron 3.5 Super VL 73.2%

4 models · 1 drop · Nemotron 3.5 Super VL

Open weights only

AIME 2026

3 models compared.

Nanbeige4.3-33Bmax 95.2%

Qwen3.8max 94.5%

Gemma 4max 89.2%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

Claw-Eval pass^3

3 models compared.

Nanbeige4.3-33Bmax 78.3%

Qwen3.8max 75.2%

Gemma 4max 44.2%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

DeepPlanning

3 models compared.

Nanbeige4.3-33Bmax 63.3%

Qwen3.8max 49.2%

Gemma 4max 19.4%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

Finance Agent v2

3 models compared.

GLM-5.3 55.8%

Mistral Large 4 54.7%

Kimi K3 53.1%

3 models · 1 drop · Mistral Large 4

Open weights only

Frontier Finance

3 models compared.

Kimi K3.1 Promax 58.6%

GLM-5.3max 57.5%

DeepSeek V4.1 Flash 1017max 54.5%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

GDPval rubrics

3 models compared.

Qwen3.8max 86.4%

Nanbeige4.3-33Bmax 84.8%

Gemma 4max 71.4%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

OfficeQA Pro v2

3 models compared.

Kimi K3.1 Promax 64.4%

DeepSeek V4.1 Flash 1017max 40.4%

GLM-5.3max 31.1%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

SkillsBench

3 models compared.

Nanbeige4.3-33Bmax 61.1%

Qwen3.8max 56.4%

Gemma 4max 28.9%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

BenchCAD (with tools)

2 models compared.

Kimi K3.1 Promax 92.7%

DeepSeek V4.1 Flash 1017max 81.6%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

Dense200

2 models compared.

Mistral Large 4 42%

Kimi K3 28.9%

2 models · 1 drop · Mistral Large 4

Open weights only

Hermes Bench

2 models compared.

Nemotron 3.5 Super VL 63.4%

Nemotron 3 Ultra 56.3%

2 models · 1 drop · Nemotron 3.5 Super VL

Open weights only

MMMU-Pro

2 models compared.

Kimi K3.1 Promax 84.1%

DeepSeek V4.1 Flash 1017max 80.6%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

OSWorld

2 models compared.

Kimi K3.1 Promax 79.6%

DeepSeek V4.1 Flash 1017max 69.3%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

Kimi K3.1 Pro 49.5%

Ling-3.1-flash-1019 38.5%

MiMo-V2.6-Pro 34%

GLM-5.3max 33.5%

MiniMax M3.1 Flash 32.5%

Muse Spark Openxhigh 29.5%

4 more

Mistral Large 4high 27%

DeepSeek V4.1 Flash 1017max 25%

Nemotron 3.5 Super VL 13.5%

Qwen3.8xhigh 4%

10 models · 0 drops · Artificial Analysis (2026-11-04)

Open weights only

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Kimi K3.1 Pro 34.3%

DeepSeek V4.1 Flash 1017max 12.9%

GLM-5.3max 9.5%

MiMo-V2.6-Pro 5.7%

Mistral Large 4high 4.3%

Ling-3.1-flash-1019 4.3%

4 more

MiniMax M3.1 Flash 3.3%

Muse Spark Openxhigh 1.9%

Qwen3.8xhigh 0.5%

Nemotron 3.5 Super VL 0%

10 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

3 Aug 2026

1 Sep 2026

11 Oct 2026

2 Nov 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.