HaiAI123

Curated Global AI Tools Directory

NewIndustry update
97
heat index
New

Artificial Analysis releases VIALS-AA and analyzes frontier models

11/07/2026 — 11/07, 01:19·1 sources (all)·4 reports (all)

Key takeaways

  • Artificial Analysis has launched VIALS-AA, a leaderboard built on Handshake AI's VIALS benchmark for evaluating visual reasoning in life sci…

Background & analysis

On 2026-11-07, Artificial Analysis announced on X that it has launched VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark covering visual reasoning in life sciences and biotech research. Image-like visual artifacts are central to how scientists analyze experiments and make research decisions, but correctly interpreting them remains unsolved for AI systems.

The same day, Artificial Analysis posted several VIALS-AA data points. On cost efficiency, GPT-6.1 Sol scores 59% at roughly $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073 per task; in comparison, GPT-6 Astra reaches 63% at roughly 5x that cost per task, while Gemini 4 Carbon reaches 64% at roughly 23x. The account also highlighted how visual reasoning differs by internal setup: Claude Opus 5.5 (max with fallback) averages about 32 tool calls per task, versus roughly 8 for GPT-6 Astra, even though their VIALS-AA scores are similar (61% and 63%, respectively). The takeaway, in Artificial Analysis's framing, is that similar leaderboard scores can come from very different visual-reasoning approaches.

In the reporting available here, Artificial Analysis also described VIALS consistency for Kimi K3.1 Pro versus GPT-6. Across three attempts, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once, compared with 118 of 161 for GPT-6. The account stressed that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the advantage for frontier models on VIALS. No later updates are included in these sources, so the current public state is the launch plus these measurements.

AI-generated from 4 reports · updated 1 hour ago

Latest turnOn the VIALS benchmark, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once across three attempts, versus 118 of 161 for GPT-6, according to Artificial Analysis. The group notes that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the edge frontier models hold.

Related AI tools

updream
24-hour heatHeat index 97
Just charted — trend is building up
24 hours agonow

Reports on this story headlines open the original

Today
  1. On the VIALS benchmark, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once across three attempts, versus 118 of 161 for GPT-6, according to Artificial Analysis. The group notes that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the edge frontier models hold.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 44
  2. Claude Opus 5.5 (max with fallback) averages roughly 32 tool calls per task on visual reasoning, compared with about 8 for GPT-6 Astra, yet their VIALS-AA scores are close at 61% and 63%, according to Artificial Analysis. The group uses the gap to show that similar scores can come from very different approaches to visual reasoning.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 43
  3. GPT-6.1 Sol scores 59% on VIALS-AA at about $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073, according to Artificial Analysis. By comparison, GPT-6 Astra reaches 63% at roughly 5x the cost per task and Gemini 4 Carbon 64% at about 23x.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 45
  4. Artificial Analysis has launched VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark covering visual reasoning in life-sciences and biotech research. The group says visual artifacts are central to how scientists analyze experiments and make research decisions, but correct interpretation remains difficult for models.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 46

Other stories people are talking about

How is heat calculated?About the method

Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.

This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.

Surge
Discussion rising fast
New
First report within 6 hours
Rising
Still gathering discussion

Back to AI industry updates →