Benchmarking Qwen3.8 27B Across 9 KV Quantization Methods and 189 Tests
10/15/2026 — 10/16, 03:23·1 sources (all)·1 reports (all)
Key takeaways
- A user on Reddit tested Qwen3.8 27B across 9 KV quantization combinations and 189 benchmarks, providing KLD and perplexity results to guide…
Background & analysis
On October 15, 2026, a user posted on the LocalLLaMA subreddit under the title "Tested Qwen3.8 27B: 189 benchmark results across 9 KV quantizations." According to the post, the author calculated KLD and perplexity for Qwen3.8 27B quantization combinations that fit within 16GB of VRAM, covering 9 KV quantization types, 21 models, and 189 benchmarks in total. The post notes that the benchmark data was placed in the comments because Reddit's filters kept deleting the submission.
The stated conclusion is that q5_1/q5_1 is almost always better than q8_0/q4_0 or q4_0/q8_0. The difference between q8_0/q4_0 and q4_0/q8_0 is described as very small, with q4_0/q8_0 sometimes outperforming q8_0/q4_0, so the author suggests it is safer to simply go with q5_1/q5_1. The post also says that moving up one model quantization and running at q4_0/q4_0 is almost always better in terms of KLD than running the quantization below at f16/f16.
So far the only available account is this single Reddit post. It was published by an individual user, concerns Qwen3.8 27B, a 16GB VRAM constraint, 9 KV quantization types, 21 models, and 189 benchmarks, and uses KLD and perplexity as its metrics. The post body does not include the full results and instead points readers to the comments.
AI-generated from 1 reports · updated 1 hour ago
Latest turnA Reddit user benchmarked Qwen3.8 27B quant combinations that fit in 16GB of VRAM, covering 9 KV quant settings, 21 models and 189 benchmarks with KLD and perplexity results. The takeaway: q5_1/q5_1 is almost always better than q8_0/q4_0 or q4_0/q8_0, and running one model quant higher at q4_0/q4_0 usually beats the smaller quant at f16/f16 on KLD.
Related AI tools
- Heat index
- 70
- All sources
- 1
- All reports
- 1
- First seen
- 12 hours ago
Reports on this story headlines open the original
A Reddit user benchmarked Qwen3.8 27B quant combinations that fit in 16GB of VRAM, covering 9 KV quant settings, 21 models and 189 benchmarks with KLD and perplexity results. The takeaway: q5_1/q5_1 is almost always better than q8_0/q4_0 or q4_0/q8_0, and running one model quant higher at q4_0/q4_0 usually beats the smaller quant at f16/f16 on KLD.
Reddit · LocalLLaMAAI score 56
Other stories people are talking about
- Heat index 351Cook confirms Apple Intelligence beta for mainland China by end of October5 sources
- Heat index 1395NewMeta Open-Sources Muse Spark Open Weights, Partners With Apple for Local Runs15 sources
- Heat index 73Cook says Apple Intelligence will use Qwen in China, beta in late October1 sources
- Heat index 58Qwen Office e-commerce edition launches for low-cost store setup1 sources
- Heat index 0Qwen launches AI glasses N1 and N1 Pro with Bose clip-on earbuds1 sources
How is heat calculated?About the methodHide
Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.
This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.
- Surge
- Discussion rising fast
- New
- First report within 6 hours
- Rising
- Still gathering discussion
