The benchmark board

Every score from our Model Drops from the last 30 days on one board, since Oct 6, 2026: who leads, how fast the best scores move, and which new models jumped furthest past the last generation.

66benchmarks

26models scored

361scores logged

10Model Drops

Best model overall

Handy AI's weigh-in: every leaderboard on this page folded into one ranking.

Best score over time

Each dot is a model at its release. The line is the record holder at each point. Hollow dots are models without a drop of their own, placed where we first saw them cited.

Open weights only

Terminal-Bench 4.0

Best score rose 23.9 points, from 41.8% (GLM-5.3) to 65.7% (Kimi K3.1 Pro).

Open weights only

AutomationBench

Best score rose 2.3 points, from 59.9% (Mistral Large 4) to 62.2% (MiniMax M3.1 Flash).

Open weights only

ProgramBench

Best score rose 12.5 points, from 19% (GLM-5.3) to 31.5% (Kimi K3.1 Pro).

Open weights only

Agents' Last Exam

Best score rose 14.9 points, from 28.3% (Kimi K3) to 43.2% (Kimi K3.1 Pro).

Open weights only

GDPval-AA

Best score rose 196 Elo, from 1650 Elo (GLM-5.3) to 1846 Elo (Kimi K3.1 Pro).

Open weights only

AA-LCR

Best score rose 8 points, from 78.3% (Muse Spark Open) to 86.3% (Kimi K3.1 Pro).

Open weights only

Harvey Legal Agent Benchmark

Best score rose 7.9 points, from 15.8% (Mistral Large 4) to 23.7% (Kimi K3.1 Pro).

Open weights only

ZeroBench (with tools)

Best score rose 22 points, from 41% (Kimi K3) to 63% (Kimi K3.1 Pro).

Biggest generational jumps

A new model against the model it replaced, on the same chart in its launch post.

DeepSeek V4.1 FlashDeepSeek V4.1 Flash 1017

Terminal-Bench 4.0: 31.2% to 42.3%

+11.1

Leaderboards

The latest reported score for every model on each benchmark. Tap a card's share button for an image of it.

Open weights only

Terminal-Bench 4.0

Multi-hour work in a real terminal.

Kimi K3.1 Promax 65.7%

Hy4 44.4%

DeepSeek V4.1 Flash 1017max 42.3%

GLM-5.3max 41.8%

LongCat-2.5 38.5%

MiniMax M3.1 Flash 38.1%

8 more

DeepSeek V4.1 Flash 31.2%

Mistral Large 4 28.3%

Nanbeige4.3-33Bmax 23.8%

Kimi K3 12.6%

DeepSeek V4 Pro 0813 10%

Qwen3.8max 6.3%

Gemma 4max 0%

Nemotron 3 Ultra 0%

14 models · 11 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, Meituan LongCat-2.5 launch post, MiniMax M3.1 Flash, Mistral Large 4, Nanbeige4.3-33B model card, Mirendil, "Introducing Fern"

Open weights only

DeepSWE v1.1

Fixing issues in real repositories.

DeepSeek V4.1 Flash 1017max 77%

Kimi K3.1 Promax 75.5%

DeepSeek V4.1 Flash 74.2%

MiniMax M3.1 Flash 73.7%

Kimi K3 67.5%

GLM-5.3max 66.9%

8 more

Nanbeige4.3-33Bmax 65.5%

Mistral Large 4 62%

Muse Spark Openxhigh 60%

DeepSeek V4 Pro 0813 57%

Qwen3.8-2.4T-A95Bxhigh 57%

Qwen3.8max 42.5%

Nemotron 3 Ultra 3.5%

Gemma 4max 2.7%

14 models · 9 drops · Kimi K3.1 Pro, MiniMax M3.1 Flash, Nanbeige4.3-33B model card, Muse Spark Open, Mistral Large 4, Mirendil, "Introducing Fern"

Open weights only

GPQA Diamond

15 models compared.

Kimi K3.1 Promax 94.2%

Qwen3.8-2.4T-A95Bxhigh 93.5%

Kimi K3max 93.5%

Qwen3.8-Flash-Next 92.7%

DeepSeek V4.1 Flash 1017max 92.2%

GLM-5.3max 91.7%

9 more

Gemma 4max 91.3%

Nemotron 3.5 Super VL 89.5%

Nanbeige4.3-33Bmax 89.5%

Qwen3.8max 89.2%

Muse Spark Openxhigh 89%

Nemotron 3 Ultra 87%

Qwen3.5-122B-A10B 86.7%

Clover-35B-A3B-Preview 83.8%

LFM3-1.7B 63.4%

15 models · 7 drops · Kimi K3.1 Pro, Muse Spark Open, Nemotron 3.5 Super VL, Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", Liquid AI, "Introducing LFM3"

Open weights only

AutomationBench

Real business automations (Zapier).

MiniMax M3.1 Flash 62.2%

DeepSeek V4.1 Flash 1017 60.5%

Mistral Large 4 59.9%

DeepSeek V4 Pro 0813 56.7%

Hy4 56.2%

DeepSeek V4.1 Flash 54.8%

7 more

Nanbeige4.3-33Bmax 54.2%

LongCat-2.5 51.8%

GLM-5.3 48.8%

Kimi K3 46.7%

Qwen3.8max 38.3%

SenseNova-Loop-9B-Preview 13.7%

Gemma 4max 9.7%

13 models · 7 drops · MiniMax M3.1 Flash, Mistral Large 4, Tencent Hunyuan Hy4 launch post, Nanbeige4.3-33B model card, Meituan LongCat-2.5 launch post, SenseNova-Loop-9B-Preview model card

Open weights only

Terminal-Bench 2.1

11 models compared.

LongCat-2.5 88.4%

Kimi K3max 85%

GLM-5.3max 83.9%

Qwen3.8-2.4T-A95Bxhigh 82%

Nanbeige4.3-33Bmax 80.9%

Muse Spark Openxhigh 76.4%

5 more

Qwen3.8max 73%

Clover-35B-A3B-Preview 51.7%

Gemma 4max 47.2%

SenseNova-Loop-9B-Preview 40.5%

LFM3-1.7B 12.9%

11 models · 7 drops · Meituan LongCat-2.5 launch post, Muse Spark Open, Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", SenseNova-Loop-9B-Preview model card, Liquid AI, "Introducing LFM3"

Open weights only

Artificial Analysis Intelligence Index

11 models compared.

Kimi K3.1 Pro 55

MiMo-V2.6-Pro 46.3

DeepSeek V4.1 Flash 1017 45.1

GLM-5.3 44.8

Kimi K3 44

MiniMax M3.1 Flash 42.7

5 more

Qwen3.8-2.4T-A95B 39.9

DeepSeek V4.1 Flash 39.5

Muse Spark Open 38.9

Mistral Large 4 38.4

DeepSeek V4 Pro 0813 36

11 models · 6 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open, Mistral Large 4

Open weights only

Sentiment Bench

How people received the model in its first week on X, Hacker News, in the news and among trusted reviewers (Handy AI).

DeepSeek V4.1 Flash 1017 83.9

Nemotron 3.5 Super VL 68.2

Kimi K3.1 Pro 67.5

MiniMax M3.1 Flash 61.1

Muse Spark Open 52.7

Mistral Large 4 49.4

6 models · 6 drops · Every model's sources, quotes and method

Open weights only

Humanity's Last Exam (no tools)

Expert-level questions, no tools.

Kimi K3.1 Promax 51.1%

Kimi K3 43.5%

DeepSeek V4.1 Flash 1017 42.6%

Qwen3.8-Flash-Next 39.6%

DeepSeek V4.1 Flash 36.8%

Nemotron 3.5 Super VL 31.8%

3 more

Nemotron 3 Ultra 29.2%

Qwen3.5-122B-A10B 24.2%

LFM3-1.7B 7.2%

9 models · 5 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

Open weights only

ProgramBench

7 models compared.

Kimi K3.1 Promax 31.5%

Hy4 30%

DeepSeek V4.1 Flash 1017 29.1%

LongCat-2.5 25.5%

DeepSeek V4.1 Flash 20.3%

GLM-5.3max 19%

1 more

Kimi K3 17.5%

7 models · 5 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, Meituan LongCat-2.5 launch post

Open weights only

Agents' Last Exam

7 models compared.

Kimi K3.1 Promax 43.2%

Hy4 41%

DeepSeek V4.1 Flash 1017 35.4%

DeepSeek V4.1 Flash 31.8%

MiniMax M3.1 Flash 29.6%

Kimi K3 28.3%

1 more

GLM-5.3max 26.2%

7 models · 4 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post, DeepSeek V4.1 Flash 1017, MiniMax M3.1 Flash

Open weights only

GDPval-AA

Professional work products, graded head to head (Elo).

Kimi K3.1 Promax 1846 Elo

DeepSeek V4.1 Flash 1017max 1746 Elo

GLM-5.3max 1650 Elo

Qwen3.8-2.4T-A95Bxhigh 1613 Elo

Kimi K3max 1537 Elo

Mistral Large 4 1424 Elo

1 more

Muse Spark Openxhigh 1401 Elo

7 models · 4 drops · Kimi K3.1 Pro, Muse Spark Open

Open weights only

SWE-bench Verified

6 models compared.

GLM-5.3-Flash 79.1%

Nemotron 3 Ultra 73.9%

Clover-35B-A3B-Preview 73.6%

Qwen3.5-122B-A10B 71.9%

Nemotron 3.5 Super VL 71.1%

LFM3-1.7B 43.4%

6 models · 4 drops · Nemotron 3.5 Super VL, DiffuSpace, "Clover-35B-A3B-Preview", Liquid AI, "Introducing LFM3"

Open weights only

AA-LCR

11 models compared.

Kimi K3.1 Pro 86.3%

Nanbeige4.3-33Bmax 84%

DeepSeek V4.1 Flash 1017max 82.7%

Ling-3.1-flash-1019 82.3%

Qwen3.8max 82%

MiniMax M3.1 Flash 79.7%

5 more

Muse Spark Openxhigh 78.3%

Gemma 4max 72%

Clover-35B-A3B-Preview 72%

Nemotron 3.5 Super VL 69%

LFM3-1.7B 52.8%

11 models · 3 drops · Artificial Analysis (2026-11-04), Nanbeige4.3-33B model card, DiffuSpace, "Clover-35B-A3B-Preview", Liquid AI, "Introducing LFM3"

Open weights only

NL2Repo

7 models compared.

DeepSeek V4.1 Flash 1017 68.2%

DeepSeek V4.1 Flash 65.4%

MiniMax M3.1 Flash 61.2%

Kimi K3 58%

GLM-5.3 58%

Nanbeige4.3-33Bmax 53%

1 more

Qwen3.8max 48.3%

7 models · 3 drops · MiniMax M3.1 Flash, Nanbeige4.3-33B model card

Open weights only

Harvey Legal Agent Benchmark

Legal work end to end.

Kimi K3.1 Promax 23.7%

DeepSeek V4.1 Flash 1017max 21%

Mistral Large 4 15.8%

Kimi K3 12.9%

GLM-5.3 8.3%

5 models · 3 drops · Kimi K3.1 Pro, Mistral Large 4

Open weights only

SciCode

5 models compared.

Ling-3.1-flash-1019 57%

Nanbeige4.3-33Bmax 52.6%

Qwen3.8max 46.7%

Gemma 4max 45.5%

LFM3-1.7B 28.5%

5 models · 3 drops · Ling-3.1-flash-1019 model card, Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Open weights only

Tau3-Bench

5 models compared.

LFM3-1.7B 68%

Clover-35B-A3B-Preview 65.3%

Nanbeige4.3-33Bmax 48.8%

Qwen3.8max 48.5%

Gemma 4max 18.6%

5 models · 3 drops · Liquid AI, "Introducing LFM3", DiffuSpace, "Clover-35B-A3B-Preview", Nanbeige4.3-33B model card

Open weights only

ZeroBench (with tools)

5 models compared.

Kimi K3.1 Promax 63%

DeepSeek V4.1 Flash 1017 51%

Muse Spark Openxhigh 50%

DeepSeek V4.1 Flash 49%

Kimi K3max 41%

5 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017, Muse Spark Open

Open weights only

BabyVision (with tools)

4 models compared.

Kimi K3.1 Promax 95.4%

DeepSeek V4.1 Flash 1017 92.5%

DeepSeek V4.1 Flash 89.6%

Kimi K3 85.7%

4 models · 3 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Open weights only

OSWorld 2

Using a computer: apps, files and the web.

Hy4 78.9%

MiniMax M3.1 Flash 61.7%

Kimi K3 58.3%

DeepSeek V4.1 Flash 54.3%

4 models · 3 drops · Tencent Hunyuan Hy4 launch post, MiniMax M3.1 Flash

Open weights only

Terminal-Bench Science

Scientific computing tasks in a terminal.

Kimi K3.1 Promax 38.1%

Hy4 19.8%

DeepSeek V4.1 Flashmax 15.7%

GLM-5.3max 8.1%

4 models · 3 drops · Kimi K3.1 Pro, Tencent Hunyuan Hy4 launch post

Open weights only

Terminal-Bench 4.0 (standard harness)

Terminal-Bench run by a third party on one shared harness.

Kimi K3.1 Pro 67.2%

GLM-5.3 38.9%

DeepSeek V4.1 Flash 1017max 33.8%

Ling-3.1-flash-1019 32.8%

MiniMax M3.1 Flash 25.8%

Mistral Large 4high 24.7%

4 more

Kimi K3 17.2%

DeepSeek V4 Pro 0813 14.1%

Muse Spark Openxhigh 8.1%

Nemotron 3.5 Super VL 0%

10 models · 2 drops · Artificial Analysis (2026-11-04), Mistral Large 4

Open weights only

AutomationBench-AA

Business automations, run by Artificial Analysis.

Kimi K3.1 Pro 73.3%

MiniMax M3.1 Flash 72.5%

Ling-3.1-flash-1019 67.5%

DeepSeek V4.1 Flash 1017max 66.6%

GLM-5.3max 62.2%

Mistral Large 4high 57.8%

2 more

Muse Spark Openxhigh 49.7%

Nemotron 3.5 Super VL 14.8%

8 models · 2 drops · Artificial Analysis (2026-11-04), Kimi K3.1 Pro

Open weights only

JobBench

7 models compared.

Muse Spark Openxhigh 61.8%

GLM-5.3max 61.4%

Kimi K3max 54.3%

Qwen3.8-2.4T-A95Bxhigh 52.7%

Nanbeige4.3-33Bmax 44.8%

Qwen3.8max 34.5%

1 more

Gemma 4max 9%

7 models · 2 drops · Muse Spark Open, Nanbeige4.3-33B model card

Open weights only

SWE-bench Pro

7 models compared.

Qwen3.8max 61.7%

Qwen3.8-Flash-Next 60.4%

Nanbeige4.3-33Bmax 60.3%

GLM-5.3-Flash 59.7%

Nemotron 3.5 Super VL 51.8%

Gemma 4max 51.2%

1 more

Nemotron 3 Ultra 49.7%

7 models · 2 drops · Nanbeige4.3-33B model card, Nemotron 3.5 Super VL

Open weights only

IFBench

5 models compared.

Nemotron 3 Ultra 82.9%

LFM3-1.7B 73%

Nemotron 3.5 Super VL 70.9%

Qwen3.5-122B-A10B 67.6%

GLM-5.3-Flash 57.7%

5 models · 2 drops · Nemotron 3.5 Super VL, Liquid AI, "Introducing LFM3"

Open weights only

MCP Atlas

5 models compared.

Muse Spark Openxhigh 89.2%

Qwen3.8-2.4T-A95Bxhigh 84.5%

GLM-5.3max 84.2%

Kimi K3max 82.3%

LFM3-1.7B 32.6%

5 models · 2 drops · Muse Spark Open, Liquid AI, "Introducing LFM3"

Open weights only

Chartography (with tools)

4 models compared.

Kimi K3.1 Promax 90.2%

DeepSeek V4.1 Flash 1017 83%

DeepSeek V4.1 Flash 78.9%

Kimi K3 68.1%

4 models · 2 drops · Kimi K3.1 Pro, DeepSeek V4.1 Flash 1017

Open weights only

EnterpriseOps-Gym

4 models compared.

Nanbeige4.3-33Bmax 41%

Qwen3.8max 40.2%

LFM3-1.7B 28.2%

Gemma 4max 27.3%

4 models · 2 drops · Nanbeige4.3-33B model card, Liquid AI, "Introducing LFM3"

Open weights only

Humanity's Last Exam (with tools)

Expert-level questions, with search and code.

Kimi K3.1 Promax 70%

GLM-5.3max 62.5%

DeepSeek V4.1 Flash 1017max 58.8%

LFM3-1.7B 13.9%

4 models · 2 drops · Kimi K3.1 Pro, Liquid AI, "Introducing LFM3"

Open weights only

SWE-Atlas-QnA

4 models compared.

Nanbeige4.3-33Bmax 50.8%

Qwen3.8max 41.9%

Nemotron 3 Ultra 16.1%

Gemma 4max 3.3%

4 models · 2 drops · Nanbeige4.3-33B model card, Mirendil, "Introducing Fern"

Open weights only

SWE-Marathon

3 models compared.

Kimi K3.1 Promax 51.7%

GLM-5.3max 42.5%

DeepSeek V4.1 Flash 1017max 40%

3 models · 2 drops · Kimi K3.1 Pro

Open weights only

BrowseComp

2 models compared.

Kimi K3.1 Promax 92.1%

LongCat-2.5 91.9%

2 models · 2 drops · Kimi K3.1 Pro, Meituan LongCat-2.5 launch post

From a single launch

Open weights only

AA-Briefcase v1.1

8 models compared.

Kimi K3.1 Pro 1675 Elo

DeepSeek V4.1 Flash 1017max 1570 Elo

Ling-3.1-flash-1019 1522 Elo

GLM-5.3max 1507 Elo

MiniMax M3.1 Flash 1475 Elo

Mistral Large 4high 1348 Elo

2 more

Muse Spark Openxhigh 1278 Elo

Nemotron 3.5 Super VL 999 Elo

8 models · 1 drop · Artificial Analysis (2026-11-04), Kimi K3.1 Pro

Open weights only

FrontierCode 2.0

Real coding tasks in open-source repos (Cognition), run by Artificial Analysis.

Hy4 31%

DeepSeek V4.1 Flash 1017max 28.5%

Kimi K3.1 Pro 25.5%

MiniMax M3.1 Flash 20.8%

Ling-3.1-flash-1019 17%

Mistral Large 4high 15%

2 more

Muse Spark Openxhigh 7.6%

Nemotron 3.5 Super VL 6.1%

8 models · 1 drop · Tencent Hunyuan Hy4 launch post, Artificial Analysis (2026-11-04)

Open weights only

Artificial Analysis Intelligence Index v5.0

7 models compared.

Kimi K3.1 Pro 46.5

DeepSeek V4.1 Flash 1017max 32.6

Ling-3.1-flash-1019 29.6

MiniMax M3.1 Flash 29.1

Mistral Large 4high 26.1

Muse Spark Openxhigh 24.9

1 more

Nemotron 3.5 Super VL 13.6

7 models · 1 drop · Artificial Analysis (2026-11-04)

Open weights only

Artificial Analysis Cyber Index

6 models compared.

Kimi K3.1 Pro 64.1

DeepSeek V4.1 Flash 1017max 56.8

Mistral Large 4high 50.9

GLM-5.3-Flash 50

Kimi K3 41

GLM-5.3 36

6 models · 1 drop · Artificial Analysis (2026-11-04), Mistral Large 4

Open weights only

Vals Index v2.2

6 models compared.

Kimi K3.1 Pro 62.5%

DeepSeek V4.1 Flash 1017 61.3%

Mistral Large 4 56.5%

MiniMax M3.1 Flash 53.8%

Muse Spark Open 48.6%

Nemotron 3.5 Super VL 29.8%

6 models · 1 drop · Vals Index v2.2 (2026-11-04)

Open weights only

Apex Bench v1.1

4 models compared.

DeepSeek V4.1 Flash 1017 72.1%

DeepSeek V4.1 Flash 64.6%

GLM-5.3 56.6%

Kimi K3 47.8%

4 models · 1 drop · DeepSeek V4.1 Flash 1017

Open weights only

BankerToolBench

4 models compared.

MiniMax M3.1 Flash 76.2

GLM-5.3 74.5

DeepSeek V4.1 Flash 73.7

Kimi K3 69.1

4 models · 1 drop · MiniMax M3.1 Flash

Open weights only

CharXiv Reasoning

4 models compared.

Qwen3.5-122B-A10B 83.5%

GLM-5.3-Flash 81.9%

Nemotron 3.5 Super VL 80.8%

Inkling Small 77.8%

4 models · 1 drop · Nemotron 3.5 Super VL

Open weights only

CyberGym-E2E

4 models compared.

Mistral Large 4 82%

MiMo-V2.6-Pro 79%

Kimi K3 58%

GLM-5.3 29%

4 models · 1 drop · Mistral Large 4

Open weights only

HLE-Diamond (no tools)

4 models compared.

Muse Spark Openxhigh 26.1%

Kimi K3max 22.2%

Qwen3.8-2.4T-A95Bxhigh 17.3%

GLM-5.3max 16.4%

4 models · 1 drop · Muse Spark Open

Open weights only

Vals Index

4 models compared.

GLM-5.3 53.5%

Kimi K3 50.3%

Mistral Large 4 48.1%

DeepSeek V4 Pro 0813 47.6%

4 models · 1 drop · Mistral Large 4

Open weights only

τ²-bench Telecom

4 models compared.

GLM-5.3-Flash 98.5%

Qwen3.5-122B-A10B 87.2%

Nemotron 3 Ultra 83%

Nemotron 3.5 Super VL 73.2%

4 models · 1 drop · Nemotron 3.5 Super VL

Open weights only

Agents' Last Exam (CLI)

3 models compared.

Kimi K3.1 Promax 44.2%

DeepSeek V4.1 Flash 1017max 36%

GLM-5.3max 29.4%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

AIME 2026

3 models compared.

Nanbeige4.3-33Bmax 95.2%

Qwen3.8max 94.5%

Gemma 4max 89.2%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

APEX-Agents

3 models compared.

Kimi K3.1 Promax 67.2%

DeepSeek V4.1 Flash 1017max 63.4%

GLM-5.3max 56.6%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

Claw-Eval pass^3

3 models compared.

Nanbeige4.3-33Bmax 78.3%

Qwen3.8max 75.2%

Gemma 4max 44.2%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

CyberGym

3 models compared.

GLM-5.3 84.5%

MiniMax M3.1 Flash 82.2%

Kimi K3 80%

3 models · 1 drop · MiniMax M3.1 Flash

Open weights only

DeepPlanning

3 models compared.

Nanbeige4.3-33Bmax 63.3%

Qwen3.8max 49.2%

Gemma 4max 19.4%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

Finance Agent v2

3 models compared.

GLM-5.3 55.8%

Mistral Large 4 54.7%

Kimi K3 53.1%

3 models · 1 drop · Mistral Large 4

Open weights only

Frontier Finance

3 models compared.

Kimi K3.1 Promax 58.6%

GLM-5.3max 57.5%

DeepSeek V4.1 Flash 1017max 54.5%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

GDP.pdf

Work products built from PDFs (Surge AI).

Kimi K3.1 Promax 34.6%

DeepSeek V4.1 Flash 1017max 17.2%

GLM-5.3max 11.2%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

GDPval rubrics

3 models compared.

Qwen3.8max 86.4%

Nanbeige4.3-33Bmax 84.8%

Gemma 4max 71.4%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

OfficeQA Pro v2

3 models compared.

Kimi K3.1 Promax 64.4%

DeepSeek V4.1 Flash 1017max 40.4%

GLM-5.3max 31.1%

3 models · 1 drop · Kimi K3.1 Pro

Open weights only

SkillsBench

3 models compared.

Nanbeige4.3-33Bmax 61.1%

Qwen3.8max 56.4%

Gemma 4max 28.9%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

Toolathlon-Verified

3 models compared.

Nanbeige4.3-33Bmax 70.4%

Qwen3.8max 68.5%

Gemma 4max 27.8%

3 models · 1 drop · Nanbeige4.3-33B model card

Open weights only

BenchCAD (with tools)

2 models compared.

Kimi K3.1 Promax 92.7%

DeepSeek V4.1 Flash 1017max 81.6%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

Dense200

2 models compared.

Mistral Large 4 42%

Kimi K3 28.9%

2 models · 1 drop · Mistral Large 4

Open weights only

ExploitBench

2 models compared.

Kimi K3.1 Promax 74.7%

GLM-5.3max 54.4%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

Hermes Bench

2 models compared.

Nemotron 3.5 Super VL 63.4%

Nemotron 3 Ultra 56.3%

2 models · 1 drop · Nemotron 3.5 Super VL

Open weights only

MMMU-Pro

2 models compared.

Kimi K3.1 Promax 84.1%

DeepSeek V4.1 Flash 1017max 80.6%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

OSWorld

2 models compared.

Kimi K3.1 Promax 79.6%

DeepSeek V4.1 Flash 1017max 69.3%

2 models · 1 drop · Kimi K3.1 Pro

Open weights only

CritPt v2 Hard

Unpublished research-level physics problems, hard subset, run by Artificial Analysis.

Kimi K3.1 Pro 49.5%

Ling-3.1-flash-1019 38.5%

MiniMax M3.1 Flash 32.5%

Muse Spark Openxhigh 29.5%

Mistral Large 4high 27%

DeepSeek V4.1 Flash 1017max 25%

1 more

Nemotron 3.5 Super VL 13.5%

7 models · 0 drops · Artificial Analysis (2026-11-04)

Open weights only

Terminal-Bench Science (standard harness)

Terminal-Bench Science run by a third party on one shared harness.

Kimi K3.1 Pro 34.3%

DeepSeek V4.1 Flash 1017max 12.9%

Mistral Large 4high 4.3%

Ling-3.1-flash-1019 4.3%

MiniMax M3.1 Flash 3.3%

Muse Spark Openxhigh 1.9%

1 more

Nemotron 3.5 Super VL 0%

7 models · 0 drops · Artificial Analysis (2026-11-04)

Release pace

Every Model Drop by month, marked with its maker.

11 Oct 2026

2 Nov 2026

How this board works

Scores come from the benchmark section of each handyai.news Model Drop, mostly the makers' launch tables. When drops disagree, the newest drop wins, since later launches re-run rivals on the current version of a benchmark; the model's own launch number is kept as launch_score. Settings (effort level, harness) vary between makers, so compare within a board with care. Models without their own drop are dated by the first drop that cites them.

The data is open: /api/benchmarks (JSON), /benchmarks.md (Markdown), one benchmark at /api/benchmarks/{benchmark}, the best model overall at /api/benchmarks/weigh-in (or /weigh-in/{type} for a topic), a PNG of any card by adding .png, and the list_benchmarks, get_benchmark and get_weigh_in tools on our MCP server.