HaiAI123

Curated Global AI Tools Directory

NewSurgeIndustry update
↑ 246%

Devin Fusion tops Coding Agent Index with score of 68

10/23/2026 — 10/23, 10:22·1 sources (all)·5 reports (all)

Key takeaways

  • Artificial Analysis has released Coding Agent Index v2.0, which replaces DeepSWE with Cognition's FrontierCode v1.1;
  • 20 of the 21 configurations scored on both versions dropped, with the average falling from 54.8 to 47.4. Cognition's Devin Fusion, using Cla…

Background & analysis

On October 21, 2026, Artificial Analysis posted on X that Cognition's Devin Fusion, running Claude Opus 5.5 (max) as its lead model with GPT-6 Luna (high) as a lower-cost sidekick, scored 68 on the Coding Agent Index. That was 2 points above Claude Code with Opus 5.5 (max), at 31% lower cost per task.

Two days later, on October 23, Artificial Analysis released Coding Agent Index v2.0. The new version replaces DeepSWE with Cognition's FrontierCode v1.1 and revises grading for SWE-Atlas-QnA. On the leaderboard, Claude Opus 5.5 in Claude Code leads at 61.7. According to the organization, FrontierCode v1.1 contains 100 software engineering tasks drawn from real open-source repositories, uses a private test set, and grades results on whether a maintainer would merge the change. Claude Code with Claude Opus 5.5 (max) scores 56.0% on that benchmark.

In the same announcement, Artificial Analysis said scores under v2.0 are lower than under v1.5 for almost every configuration measured on both. Across the 21 configurations evaluated on both versions, the mean Index score falls from 54.8 to 47.4, with 20 of the 21 moving down. The organization attributes the shift to the replacement of the old benchmark with FrontierCode v1.1. The v2.0 index uses FrontierCode v1.1 together with the SWE-Atlas-QnA-AA dataset and judge, and the leaderboard lets users view each configuration's performance by benchmark score, cost per task, and token usage, alongside methodology and version history. The public record currently stops at the launch of this leaderboard.

AI-generated from 5 reports · updated 2 hours ago

Latest turnArtificial Analysis has published version 2.0 of its Coding Agent Index, which shows scores by benchmark alongside cost per task and token usage for each configuration, with methodology and version history included. The new index runs on FrontierCode v1.1 and the SWE-Atlas-QnA-AA dataset and judge.

Related AI tools

24-hour heatHeat index 90 · peak 98 · 2h ago
24 hours agonow

Reports on this story headlines open the original

Today
  1. Artificial Analysis has published version 2.0 of its Coding Agent Index, which shows scores by benchmark alongside cost per task and token usage for each configuration, with methodology and version history included. The new index runs on FrontierCode v1.1 and the SWE-Atlas-QnA-AA dataset and judge.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 44
  2. Artificial Analysis says 20 of the 21 configurations evaluated on both versions of its Coding Agent Index scored lower under v2.0, with the mean falling from 54.8 to 47.4. The firm attributes the shift to FrontierCode v1.1 replacing the older benchmark.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 45
  3. DeepSWE v1.1 has been swapped out of the Coding Agent Index for Cognition's FrontierCode v1.1, which packs 100 software engineering tasks on real open-source repositories, a private test set and grading based on whether a maintainer would merge the change. Claude Code with Claude Opus 5.5 (max) scores 56.0% on it.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 42
  4. Artificial Analysis has launched version 2.0 of its Coding Agent Index, replacing DeepSWE with Cognition's FrontierCode v1.1 and revising how SWE-Atlas-QnA is graded. Claude Opus 5.5 running in Claude Code leads the index at 61.7.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 51
Oct 21
  1. According to Artificial Analysis on X, Cognition's Devin Fusion, which pairs a Claude Opus 5.5 (max) lead model with a lower-cost GPT-6 Luna (high) sidekick, scored 68 on the Coding Agent Index. That is 2 points above Claude Code with Opus 5.5 (max), at 31% lower cost per task.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 50

Other stories people are talking about

How is heat calculated?About the method

Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.

This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.

Surge
Discussion rising fast
New
First report within 6 hours
Rising
Still gathering discussion

Back to AI industry updates →