Artificial Analysis releases VIALS-AA and analyzes frontier models
11/07/2026 — 11/07, 01:19·1 sources (all)·4 reports (all)
Key takeaways
- Artificial Analysis has launched VIALS-AA, a leaderboard built on Handshake AI's VIALS benchmark for evaluating visual reasoning in life sci…
Background & analysis
On 2026-11-07, Artificial Analysis announced on X that it has launched VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark covering visual reasoning in life sciences and biotech research. Image-like visual artifacts are central to how scientists analyze experiments and make research decisions, but correctly interpreting them remains unsolved for AI systems.
The same day, Artificial Analysis posted several VIALS-AA data points. On cost efficiency, GPT-6.1 Sol scores 59% at roughly $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073 per task; in comparison, GPT-6 Astra reaches 63% at roughly 5x that cost per task, while Gemini 4 Carbon reaches 64% at roughly 23x. The account also highlighted how visual reasoning differs by internal setup: Claude Opus 5.5 (max with fallback) averages about 32 tool calls per task, versus roughly 8 for GPT-6 Astra, even though their VIALS-AA scores are similar (61% and 63%, respectively). The takeaway, in Artificial Analysis's framing, is that similar leaderboard scores can come from very different visual-reasoning approaches.
In the reporting available here, Artificial Analysis also described VIALS consistency for Kimi K3.1 Pro versus GPT-6. Across three attempts, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once, compared with 118 of 161 for GPT-6. The account stressed that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the advantage for frontier models on VIALS. No later updates are included in these sources, so the current public state is the launch plus these measurements.
AI-generated from 4 reports · updated 1 hour ago
Latest turnOn the VIALS benchmark, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once across three attempts, versus 118 of 161 for GPT-6, according to Artificial Analysis. The group notes that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the edge frontier models hold.
Related AI tools
- Heat index
- 97
- All sources
- 1
- All reports
- 4
- First seen
- 1 hour ago
Reports on this story headlines open the original
On the VIALS benchmark, Kimi K3.1 Pro answered 119 of 161 tasks correctly at least once across three attempts, versus 118 of 161 for GPT-6, according to Artificial Analysis. The group notes that solving a task once does not mean a model will answer it consistently, and that consistency is a key part of the edge frontier models hold.
X:Artificial Analysis (@artificialanlys)First-partyAI score 44Claude Opus 5.5 (max with fallback) averages roughly 32 tool calls per task on visual reasoning, compared with about 8 for GPT-6 Astra, yet their VIALS-AA scores are close at 61% and 63%, according to Artificial Analysis. The group uses the gap to show that similar scores can come from very different approaches to visual reasoning.
GPT-6.1 Sol scores 59% on VIALS-AA at about $0.056 per task and GPT-6.1 Terra scores 60% at about $0.073, according to Artificial Analysis. By comparison, GPT-6 Astra reaches 63% at roughly 5x the cost per task and Gemini 4 Carbon 64% at about 23x.
X:Artificial Analysis (@artificialanlys)First-partyAI score 45Artificial Analysis has launched VIALS-AA, a leaderboard for Handshake AI's VIALS benchmark covering visual reasoning in life-sciences and biotech research. The group says visual artifacts are central to how scientists analyze experiments and make research decisions, but correct interpretation remains difficult for models.
X:Artificial Analysis (@artificialanlys)First-partyAI score 46
Other stories people are talking about
- Heat index 190Anthropic open-sources FlashProve to verify AI replies come from the claimed model4 sources
- Heat index 763Claude rolls out Personal Finance to US Pro, Max and Ultra users via read-only Plaid links13 sources
- Heat index 915OpenAI rolls out GPT-6 Cyber to Daybreak Red users with API, Codex access16 sources
- Heat index 408Cat Wu joins OpenAI to lead core products10 sources
- Heat index 199Claude Code has been routing user email addresses to websites in User-Agent headers, and Anthropic has yet to patch the issue in stable build 2.1.311.3 sources
How is heat calculated?About the methodHide
Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.
This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.
- Surge
- Discussion rising fast
- New
- First report within 6 hours
- Rising
- Still gathering discussion

