HaiAI123

Curated Global AI Tools Directory

Industry update
25
heat index
Flat

Reddit user runs 8 agents with 250K context each on two RTX 3090s

11/02/2026 — 11/02, 10:18·1 sources (all)·1 reports (all)

Key takeaways

  • A Reddit user reports running eight agents concurrently on two RTX 3090 GPUs, each with a 250K context, at roughly 600+ tokens per second, a…

Background & analysis

On 2026-11-02, a post appeared in Reddit's LocalLLaMA community. The author claims to have run 8 agents concurrently on two 3090s, each with a 250K context, for a combined throughput of about 600+ tok/s, and shared a screen recording of the interface. The author says they first tried the approach behind the Stanford/Berkeley TokenGate paper, which makes long context cheap by pruning tokens up front. In their experience it works for a single question, but agents keep asking new ones, and by then the tokens they need have already been pruned, so code recall drops hard. They therefore switched to a different approach. The author adds that they are open to being misguided or misinformed, but consider the findings worth sharing. Only this one report is available so far. The material cuts off right where the author describes the replacement approach, so the details of that method, whether fitting 8 agents with 250K contexts in the VRAM of two 3090s actually holds up, and any follow-up coverage are all outside what these sources confirm.

AI-generated from 1 reports · updated 4 days ago

24-hour heatHeat index 25
Just charted — trend is building up
24 hours agonow

Reports on this story headlines open the original

Nov 2
  1. A Reddit user reports running 8 agents concurrently at 250K context each on two RTX 3090s, totaling roughly 600+ tok/s, and shared a screen recording of the UI. He says he first tried TokenGate-style upfront token pruning, which worked for a single question but broke down once agents kept asking new ones and the pruned tokens were gone.

    Reddit · LocalLLaMAAI score 53

Other stories people are talking about

How is heat calculated?About the method

Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.

This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.

Surge
Discussion rising fast
New
First report within 6 hours
Rising
Still gathering discussion

Back to AI industry updates →