AI AgentsInfo

Report

AI Agent Harness Benchmark, November 2026

Public SWE-bench and Terminal-Bench scores for agent harnesses and coding agents, each with the date on the official source. Read November 5, 2026.

Download PDFDownload CSV

Key takeaways

  • This page copies public scores for coding agents and the harnesses around them.
  • The tables use the official SWE-bench leaderboard and the official Terminal-Bench 4.0 leaderboard. Each row keeps the date on that source.
  • Nothing here is estimated, and a score from another website is not filled in when the official board does not list it.

This page copies public scores for coding agents and the harnesses around them. A harness is the loop, tools, and limits around a model. The tables use the official SWE-bench leaderboard and the official Terminal-Bench 4.0 leaderboard. Each row keeps the date on that source. Nothing here is estimated, and a score from another website is not filled in when the official board does not list it.

What these numbers are

SWE-bench Verified is 500 real GitHub issues. The score is the percent resolved: the share of issues whose tests passed. The bash-only rows all use mini-SWE-agent, so the harness stays the same while the model changes. The SWE-bench site says release 2.x calls tools, while release 1.x reads the action out of the model's text, and that those two generations are not necessarily comparable. The version column is the release named on the row.

Terminal-Bench 4.0 is the current board on tbench.ai. The agent column changes by row, so those scores include Claude Code, Codex, Grok Build, mini-SWE-agent, or Muse Code, not one shared harness. Accuracy and the 95% half-width are the fields on the official leaderboard. The cost cell is copied as printed, including a partial-trial note where the board includes one.

The newest result date on the SWE-bench Verified file, as read on November 5, 2026, is 2026-02-26. The Terminal-Bench 4.0 board record says it was updated 2026-10-23. This November report is a reading of those boards. It is not a claim that either project published a new run in November.

SWE-bench Verified, bash only

47 rows from the Verified list where the harness is mini-SWE-agent. "Team checked" means the SWE-bench page marks the run as performed or checked by the SWE-bench team. A "No" means the row is on the official board without that mark. Source: swebench.com, read November 5, 2026.

Download CSV

Claude 4.5 Opus (high)mini-SWE-agentClaude 4.5 Opus76.8%2026-02-172.0.0high$376.95NoNo
MiniMax M2.5 (high)mini-SWE-agentMiniMax M2.575.8%2026-02-172.0.0high$36.64NoYes
Gemini 3 Flash (high)mini-SWE-agentGemini 3 Flash75.8%2026-02-172.0.0high$177.98NoNo
Claude 4.6 Opusmini-SWE-agentClaude 4.6 Opus75.6%2026-02-172.0.0Not stated$275.76NoNo
Claude 4.5 Opus (20251101) (medium)mini-SWE-agentClaude 4.5 Opus74.4%2025-11-241.16.0medium$360.62YesNo
Gemini 3 Pro Preview (2025-11-18)mini-SWE-agentGemini 3 Pro Preview74.2%2025-11-181.15.0Not stated$229.98YesNo
GPT 5.2 Codexmini-SWE-agentGPT 5.2 Codex72.8%2026-02-192.0.0Not stated$224.71NoNo
GPT 5.2 (high)mini-SWE-agentGPT 5.272.8%2026-02-172.0.0high$236.78NoNo
GLM 5 (high)mini-SWE-agentGLM 572.8%2026-02-172.0.0high$267.19NoYes
GPT 5.2 (2025-12-11) (high)mini-SWE-agentGPT 5.271.8%2025-12-111.17.2high$260.13NoNo
Claude 4.5 Sonnet (high)mini-SWE-agentClaude 4.5 Sonnet71.4%2026-02-172.0.0high$328.95NoNo
Kimi K2.5 (high)mini-SWE-agentKimi K2.570.8%2026-02-172.0.0high$73.28NoYes
Claude 4.5 Sonnet (20250929)mini-SWE-agentClaude 4.5 Sonnet70.6%2025-09-291.13.3Not stated$279.17YesNo
DeepSeek V3.2 (high)mini-SWE-agentDeepSeek V3.270%2026-02-172.0.0high$223.92NoYes
Gemini 3 Promini-SWE-agentGemini 3 Pro69.6%2026-02-262.0.0high$480.01NoNo
GPT 5.2 (2025-12-11)mini-SWE-agentGPT 5.269%2025-12-111.17.2Not stated$134.83NoNo
Claude 4 Opus (20250514)mini-SWE-agentClaude 4 Opus67.6%2025-08-021.0.0Not stated$565.64YesNo
Claude 4.5 Haiku (high)mini-SWE-agentClaude 4.5 Haiku66.6%2026-02-172.0.0high$165.46NoNo
GPT 5.1 Codex (medium)mini-SWE-agentGPT 5.1 Codex66%2025-11-241.16.0medium$294.44NoNo
GPT 5.1 (2025-11-13) (medium)mini-SWE-agentGPT 5.166%2025-11-201.15.0medium$153.08NoNo
GPT 5 (2025-08-07) (medium)mini-SWE-agentGPT 565%2025-08-071.7.0medium$140.19YesNo
Claude 4 Sonnet (20250514)mini-SWE-agentClaude 4 Sonnet64.93%2025-07-261.0.0Not stated$185.73YesNo
Kimi K2 Thinkingmini-SWE-agentKimi K2 Thinking63.4%2025-12-101.17.2Not stated$219.15YesYes
MiniMax M2mini-SWE-agentMiniMax M261%2025-11-241.17.0Not stated$214.13YesYes
DeepSeek V3.2 Reasonermini-SWE-agentDeepSeek V3.2 Reasoner60%2025-12-011.17.1Not stated$14.04YesYes
GPT 5 mini (2025-08-07) (medium)mini-SWE-agentGPT 5 mini59.8%2025-08-071.7.0medium$17.74YesNo
o3 (2025-04-16)mini-SWE-agento358.4%2025-07-261.0.0Not stated$166.83YesNo
Devstral Small (2512)mini-SWE-agentDevstral Small (2512)56.4%2025-12-091.17.2Not statedNot listedYesYes
GPT 5 minimini-SWE-agentGPT 5 mini56.2%2026-02-172.0.0Not stated$23.60NoNo
GLM 4.6 (T=1)mini-SWE-agentGLM 4.655.4%2025-12-011.17.1Not stated$48.31YesYes
Qwen3-Coder 480B/A35B Instructmini-SWE-agentQwen3-Coder 480B/A35B Instruct55.4%2025-08-021.0.0Not stated$123.96YesYes
GLM 4.5 (2025-08-22)mini-SWE-agentGLM 4.554.2%2025-08-221.9.1Not stated$148.60YesYes
Devstral (2512)mini-SWE-agentDevstral (2512)53.8%2025-12-091.17.2Not statedNot listedYesYes
Gemini 2.5 Pro (2025-05-06)mini-SWE-agentGemini 2.5 Pro53.6%2025-07-261.0.0Not stated$144.19YesNo
Claude 3.7 Sonnet (20250219)mini-SWE-agentClaude 3.7 Sonnet52.8%2025-07-200.0.0Not stated$177.31YesNo
o4-mini (2025-04-16)mini-SWE-agento4-mini45%2025-07-261.0.0Not stated$104.99YesNo
Kimi K2 Instructmini-SWE-agentKimi K2 Instruct43.8%2025-08-071.7.0Not stated$265.80YesYes
GPT 4.1 (2025-04-14)mini-SWE-agentGPT 4.139.58%2025-07-261.0.0Not stated$73.16YesNo
GPT 5 nano (2025-08-07) (medium)mini-SWE-agentGPT 5 nano34.8%2025-08-071.7.0medium$19.04YesNo
Gemini 2.5 Flash (2025-04-17)mini-SWE-agentGemini 2.5 Flash28.73%2025-07-261.0.0Not stated$66.94YesNo
gpt-oss-120bmini-SWE-agentgpt-oss-120b26%2025-08-071.7.0Not stated$28.56YesYes
GPT 4.1 mini (2025-04-14)mini-SWE-agentGPT 4.1 mini23.94%2025-07-200.0.0Not stated$217.58YesNo
GPT 4o (2024-11-20)mini-SWE-agentGPT 4o21.62%2025-07-200.0.0Not stated$765.57YesNo
Llama 4 Maverick Instructmini-SWE-agentLlama 4 Maverick Instruct21.04%2025-07-200.0.0Not stated$156.85YesNo
Gemini 2.0 Flashmini-SWE-agentGemini 2.0 Flash13.52%2025-07-260.0.0Not stated$0.00YesNo
Llama 4 Scout Instructmini-SWE-agentLlama 4 Scout Instruct9.06%2025-07-200.0.0Not stated$57.82YesNo
Qwen2.5-Coder 32B Instructmini-SWE-agentQwen2.5-Coder 32B Instruct9%2025-08-031.0.0Not stated$34.06YesYes

Other harnesses the SWE-bench team checked

30 Verified rows that use a harness other than mini-SWE-agent and that the board marks as team-checked. The full list also has 103 submitted rows without that mark. The highest of those is Sonar Foundation Agent + Claude 4.5 Opus (79.2% on 2025-12-05) and live-SWE-agent + Claude 4.5 Opus medium (20251101) (79.2% on 2025-12-15). They are named here and left out of the table.

Download CSV

OpenHands + GPT-5OpenHandsGPT-571.8%2025-08-07—Not statedNot listedYesNo
Moatless Tools + Claude 4 SonnetMoatless ToolsClaude 4 Sonnet70.8%2025-06-11—Not statedNot listedYesNo
OpenHands + Claude 4 SonnetOpenHandsClaude 4 Sonnet70.4%2025-05-24—Not statedNot listedYesNo
SWE-agent + Claude 4 SonnetSWE-agentClaude 4 Sonnet66.6%2025-05-22—Not statedNot listedYesNo
OpenHandsOpenHandsUndisclosed65.8%2025-04-15—Not statedNot listedYesNo
OpenHands + Kimi K2OpenHandsKimi K265.4%2025-07-16—Not statedNot listedYesYes
SWE-agent + Claude 3.7 Sonnet w/ Review HeavySWE-agentClaude 3.7 Sonnet w/ Review Heavy62.4%2025-02-25—Not statedNot listedYesNo
OpenHands + 4x Scaled (2024-02-03)OpenHands4x Scaled60.8%2025-02-03—Not statedNot listedYesNo
Nemotron-CORTEXANemotron-CORTEXAMultiple58.2%2025-04-10—Not statedNot listedYesNo
OpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)OpenHandsCodeAct v2.1 (claude-3-5-sonnet-20241022)53%2024-10-29—Not statedNot listedYesNo
Composio SWE-Kit (2024-10-25)Composio SWE-KitMultiple48.6%2024-10-25—Not statedNot listedYesNo
AppMap Navie v2AppMap Navie v2Multiple47.2%2024-11-06—Not statedNot listedYesNo
Skywork-SWE-32B + TTS(Bo8)Skywork-SWE-32BTTS(Bo8)47%2025-06-16—Not statedNot listedYesYes
OpenHands + DevStral Small 2505OpenHandsDevStral Small 250546.8%2025-05-20—Not statedNot listedYesYes
Agentless Lite + O3 Mini (20250214)Agentless LiteO3 Mini42.4%2025-02-14—Not statedNot listedYesNo
SWE-agent + SWE-agent-LM-32BSWE-agentSWE-agent-LM-32B40.2%2025-05-11—Not statedNot listedYesYes
SWE-agent + DevStral Small 2507SWE-agentDevStral Small 250738%2025-07-25—Not statedNot listedYesYes
Skywork-SWE-32BSkywork-SWE-32BQwen2.5 Coder 32B Instruct38%2025-06-16—Not statedNot listedYesYes
SWE-agent + Claude 3.5 SonnetSWE-agentClaude 3.5 Sonnet33.6%2024-06-20—Not statedNot listedYesNo
SWE-Fixer (Qwen2.5-7b retriever + Qwen2.5-72b editor)SWE-FixerQwen2.5 (7B + 72B)32.8%2025-03-06—Not statedNot listedYesYes
AppMap Navie + GPT 4o (2024-05-13)AppMap NavieGPT-4o26.2%2024-06-15—Not statedNot listedYesNo
SWE-agent + GPT 4o (2024-05-13)SWE-agentGPT-4o23.2%2024-07-28—Not statedNot listedYesNo
SWE-agent + GPT 4 (1106)SWE-agentGPT-4 (1106)22.4%2024-04-02—Not statedNot listedYesNo
SWE-agent + Claude 3 OpusSWE-agentClaude 3 Opus15.8%2024-04-02—Not statedNot listedYesNo
RAG + Claude 3 OpusRAG baselineClaude 3 Opus7%2024-04-02—Not statedNot listedYesNo
RAG + Claude 2RAG baselineClaude 24.4%2023-10-10—Not statedNot listedYesNo
RAG + GPT 4 (1106)RAG baselineGPT-4 (1106)2.8%2024-04-02—Not statedNot listedYesNo
RAG + SWE-Llama 7BRAG baselineSWE-Llama 7B1.4%2023-10-10—Not statedNot listedYesNo
RAG + SWE-Llama 13BRAG baselineSWE-Llama 13B1.2%2023-10-10—Not statedNot listedYesNo
RAG + ChatGPT 3.5RAG baselineGPT-3.50.4%2023-10-10—Not statedNot listedYesNo

SWE-bench Multilingual, same harness

300 instances, 13 mini-SWE-agent rows on the same official file. This is a separate task set from Verified, so the percents are not a second reading of the 500 Verified issues.

Download CSV

Gemini 3 Flashmini-SWE-agentGemini 3 Flash72.7%2026-02-132.0.0a0Not stated$105.55YesNo
Claude 4.6 Opusmini-SWE-agentClaude 4.6 Opus72%2026-02-132.0.0a0Not stated$198.89YesNo
Claude 4.5 Opusmini-SWE-agentClaude 4.5 Opus70.7%2026-02-132.0.0a0Not stated$250.07YesNo
GLM 5mini-SWE-agentGLM 569.7%2026-02-132.0.0a0Not stated$192.74YesYes
Gemini 3 Promini-SWE-agentGemini 3 Pro68.7%2026-02-132.0.0a0Not stated$306.33YesNo
MiniMax M2.5mini-SWE-agentMiniMax M2.568.3%2026-02-162.0.0a0Not stated$30.06YesYes
Kimi K2.5mini-SWE-agentKimi K2.567.3%2026-02-132.0.0a0Not stated$207.85YesYes
Claude 4.5 Sonnetmini-SWE-agentClaude 4.5 Sonnet67%2026-02-132.0.0a0Not stated$200.86YesNo
GPT 5.2 (high)mini-SWE-agentGPT 5.266.7%2026-02-132.0.0a0high$160.92YesNo
GPT 5.2 Codexmini-SWE-agentGPT 5.2 Codex66.3%2026-02-202.0.0Not stated$198.65NoNo
Claude 4.5 Haikumini-SWE-agentClaude 4.5 Haiku64.7%2026-02-132.0.0a0Not stated$113.85YesNo
DeepSeek V3.2mini-SWE-agentDeepSeek V3.259%2026-02-132.0.0a0Not stated$115.15YesYes
GPT 5 minimini-SWE-agentGPT 5 mini39.7%2026-02-132.0.0a0Not stated$15.49YesNo

Terminal-Bench 4.0

35 rows. The official leaderboard for Terminal-Bench 4.0. The board name on Harbor Hub is 4-0-0, and the record was updated 2026-10-23. Read November 5, 2026 from the Terminal-Bench site through the public leaderboard it displays. Click a model or agent name when the board supplied a link.

Download CSV

1Opus 5.5Claude Codemax64.85%± 3.11214 / 330$4,718.652026-09-22
2Sonnet 5.5Claude Codemax61.82%± 2.94204 / 330$7,333.642026-09-28
3GPT-6 AstraCodexmax58.18%± 2.79192 / 330$3,267.182026-09-03
3GPT-6.1 SolCodexmax58.18%± 3.11192 / 330$634.242026-09-29
5Fable 5.1Claude Codemax57.88%± 3.76191 / 330$6,243.502026-09-01
5Fable 5.1Claude Codexhigh57.88%± 3.36191 / 330$4,872.042026-09-01
5GPT-6 AstraCodexhigh57.88%± 2.97191 / 330$2,269.422026-09-03
5GPT-6 AstraCodexxhigh57.88%± 2.72191 / 330$2,350.512026-09-03
9Fable 5.1Claude Codehigh54.55%± 3.44180 / 330$3,985.382026-09-01
10GPT-6 AstraCodexmedium54.24%± 2.66179 / 330$1,914.802026-09-03
11Fable 5.1Claude Codemedium53.94%± 3.39178 / 330$2,832.902026-09-01
11Opus 5Claude Codexhigh53.94%± 3.17178 / 330$6,086.222026-07-24
13Opus 5Claude Codemax51.82%± 3.39171 / 330$5,969.112026-07-24
14GPT-6 AstraCodexlow50.61%± 2.75167 / 330$1,557.302026-09-03
15Opus 5Claude Codehigh50.3%± 3.73166 / 330$4,662.272026-07-24
16GPT-6 SolCodexmax49.39%± 3.23163 / 330$1,451.322026-09-22
17Opus 5Claude Codemedium44.85%± 3.83148 / 330$3,191.592026-07-24
18Fable 5Claude Codemax44.55%± 3.85147 / 330$7,265.012026-06-09
19Fable 5.1Claude Codelow43.33%± 3.61143 / 330$2,358.722026-09-01
20GLM-5.3Claude Codemax41.82%± 3.23138 / 330$2,727.632026-08-14
21Grok 4.7Grok Buildxhigh37.58%± 3.54124 / 330$3,683.29 (partial: 324/330 trials)2026-09-21
22GPT-5.6 SolCodexmax37.27%± 3.78123 / 330$2,541.702026-06-26
23GLM-5.3-FlashClaude Codenone35.76%± 3.54118 / 330$118.742026-08-26
24Opus 5Claude Codelow34.85%± 3.94115 / 330$2,393.882026-07-24
25Qwen3.8-Max-0902Claude Codemax26.97%± 3.7889 / 330$4,635.672026-09-02
26Opus 4.8Claude Codemax23.64%± 3.5678 / 330$6,481.262026-05-28
27GPT-5.6 TerraCodexmax21.52%± 3.2571 / 330$1,733.522026-06-26
28Grok 4.6Grok Buildhigh20.3%± 3.0967 / 330$3,591.582026-08-12
29Gemini 3.8 Flashmini-SWE-agenthigh19.09%± 3.3663 / 330$1,828.772026-09-02
30GPT-5.6 LunaCodexmax17.27%± 2.8557 / 330$346.672026-06-26
31GPT-6 LunaCodexmax16.36%± 2.7254 / 330$72.142026-09-22
32Muse Spark 1.3Muse Codexhigh14.55%± 2.9448 / 330$0.002026-09-02
33Grok 4.5Grok Buildhigh12.42%± 2.6241 / 330$2,094.112026-07-16
33Sonnet 5Claude Codemax12.42%± 3.0641 / 330$9,603.862026-06-30
35Gemini 3.7 Flashmini-SWE-agenthigh11.21%± 2.4537 / 330$1,261.872026-08-13

Left out

  • Third-party score roundups, including pages that list SWE-bench results above the official board, are not used. If the official file does not contain the row, it is not on this page.
  • SWE-bench Full, Lite, and Multimodal are on swebench.com and were not copied into this month's tables.
  • OSWorld, WebArena, GAIA, and SWE-bench Pro were not read from an official board for this edition, so they are not given scores here.
  • The November 3, 2026 paper "You don't need long context" reports its own SWE-bench Verified and Terminal-Bench 2.1 runs. Those are the authors' runs, not rows on the public boards, and they stay on the research note.

FAQ

Does a higher percent mean a better product?

Only inside one table, and only for the harness named on the row. A bash-only SWE-bench score and a Terminal-Bench score are different tests. A mini-SWE-agent 1.x row and a 2.x row are not described by SWE-bench as a clean comparison.

Why are some famous models missing?

They were not on the official file when it was read on November 5, 2026. A score that exists only on a recap site is left out. The newest SWE-bench Verified date in that file is 2026-02-26.

Who checked the runs?

The SWE-bench tables have a team-checked column taken from the official file. Terminal-Bench rows are the rows on the official 4.0 board. This site did not re-run the tasks.

How often does this page change?

It is the November 2026 edition. A later month gets its own page when the boards are read again. The reports index is where that page will be linked.

Cite or embed this

The citation names this page and the date above. The embed is a blockquote with a link back here.

Citation

AI Agents Info. "AI Agent Harness Benchmark, November 2026." Last updated November 5, 2026. https://www.aiagentsinfo.com/reports/agent-harness-benchmark-november-2026.

Embed

<blockquote cite="https://www.aiagentsinfo.com/reports/agent-harness-benchmark-november-2026">
<p>Public SWE-bench and Terminal-Bench scores for agent harnesses and coding agents, each with the date on the official source. Read November 5, 2026.</p>
<footer><a href="https://www.aiagentsinfo.com/reports/agent-harness-benchmark-november-2026">AI Agent Harness Benchmark, November 2026</a>, AI Agents Info, last updated November 5, 2026.</footer>
</blockquote>

Report

AI agents, Nov 2026 to May 2027

What filings and company pages have dated for coding agents, computer use, harnesses, and regulation from November 2026 through May 2027.

November 5, 2026

Glossary

Benchmark

A frozen set of tasks plus a scoring rule. It is not the same as your production job.

Data

Agent cost calculator

Estimate a 30-day model bill from official per-token prices. Pick a model, then enter tokens per task and tasks per day. No login is required.

November 5, 2026

Tracker

Benchmark tracker

A leaderboard for public agent benchmarks. A score is published only with a source, a date, and the harness that produced it.