RTX 3060 Test: Three Local Inference Engines Run Qwen3.6-35B-A3B
11/10/2026 — 11/10, 18:20·1 sources (all)·1 reports (all)
Key takeaways
- A Reddit user on r/LocalLLaMA benchmarked three local inference engines — RustingStrata, PolyStrata and llama.cpp b12119 — on an RTX 3060 12…
Background & analysis
On November 10, 2026, at 17:38, a user posted on Reddit's LocalLLaMA subreddit reporting benchmark results of three local inference engines on a single RTX 3060 12GB paired with a Ryzen 5 7600X and 32 GB RAM. All three engines consumed the same GGUF file, Qwen3.6-35B-A3B-UD-Q3_K_M.gguf (from Unsloth, with the MTP layer included), which measures 15.9 GiB and therefore does not fit in the card's VRAM. Each run used a 5290-token prompt followed by 128 generated tokens.
During prefill of the 5290-token prompt, RustingStrata reached 2330 tok/s, PolyStrata reached 1458-1549 tok/s, and llama.cpp b12119 reached 1692 tok/s (with -ncmoe 22 and -ub 2048). During decode without MTP, the three engines managed 90.9, 78.5 (--no-draft), and 53.5 tok/s respectively. Enabling MTP draft speculation (--spec-type draft-mtp, with 92 of 102 drafts actually used) raised decode throughput to 128.4, 97.5-100.4, and 77.7 tok/s. So far this is the only available source on the test; the results have not been corroborated elsewhere.
AI-generated from 1 reports · updated 3 days ago
Related AI tools
- Heat index
- 25
- All sources
- 1
- All reports
- 1
- First seen
- 3 days ago
Reports on this story headlines open the original
A Reddit LocalLLaMA user compared RustingStrata, PolyStrata and llama.cpp b12119 on a single RTX 3060 12 GB with Ryzen 5 7600X, feeding all three the same Qwen3.6-35B-A3B GGUF file. On a 5,290-token prompt, prefill hit 2330, 1458-1549 and 1692 tok/s, while decode without MTP reached 90.9, 78.5 and 53.5 tok/s. Enabling MTP drafts pushed decode to 128.4, 97.5-100.4 and 77.7 tok/s; the 15.9 GiB file does not fit in VRAM.
Reddit · LocalLLaMAAI score 53
Other stories people are talking about
- Heat index 2236Nvidia stock plunges after Jensen Huang resigns, with retail investors buying the dip35 sources
- Heat index 1463RisingGoogle Opens Gemini 4 Hydrogen to All Users as High-Speed Model21 sources
- Heat index 1429SurgeJensen Huang exits as NVIDIA CEO, leadership vacuum lingers16 sources
- Heat index 785SurgeAnthropic hires gas supply lead to power data center expansion after IPO10 sources
- Heat index 673SurgeMicrosoft races to fix global outage hitting Outlook, Teams and Copilot8 sources
How is heat calculated?About the methodHide
Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.
This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.
- Surge
- Discussion rising fast
- New
- First report within 6 hours
- Rising
- Still gathering discussion