deepseek-one-gpu runs DeepSeek-V4.1-Flash on one 96GB GPU
10/21/2026 — 10/24, 00:21·2 sources (all)·2 reports (all)
Key takeaways
- A developer open-sourced deepseek-one-gpu, an engine that quantizes the 763B-parameter DeepSeek-V4.1-Flash to Q2_K and serves it through an…
Background & analysis
On October 21, 2026, a DEV Community article introduced deepseek-one-gpu, an open-source engine released by a developer for running DeepSeek-V4.1-Flash on a single GPU. According to the article, DeepSeek-V4.1-Flash has 763B parameters, and even after quantization to Q2_K it still occupies 264.5 GB, while one RTX PRO 6000 Blackwell offers 96 GB of VRAM. The engine serves the model from that single card together with the server's RAM, exposing it through an OpenAI-compatible API.
Drawing on measurements published in the repository, the article explains what determines speed. Of the 384 experts in each layer, the 5,825 most frequently used are kept on the GPU, taking up 69.5 GiB, while the remaining experts sit in pinned memory. In the measured runs, roughly nine out of ten expert selections landed on the GPU. The write-up is aimed at people who plan to set the engine up themselves, covering the factors that govern throughput and what to check before blaming the engine for slow performance.
That is where the public information currently stops: the engine is open source, the performance figures come from the project's own repository, and no independent verification or follow-up release notes have appeared in the material reviewed.
AI-generated from 1 reports · updated 3 days ago
Latest turnDevelopers open-sourced deepseek-one-gpu, an engine that serves the 763B-parameter DeepSeek-V4.1-Flash as an OpenAI-compatible API from a single 96 GB RTX PRO 6000 Blackwell plus server RAM, after quantizing the model to Q2_K at 264.5 GB. Based on measured runs, the writeup explains what decides speed: 5,825 of the 384 experts per layer are kept on the GPU (69.5 GiB) while 9,535 sit in pinned RAM, and roughly nine in ten expert picks landed on the GPU.
Related AI tools
- Heat index
- 25
- All sources
- 2
- All reports
- 2
- First seen
- 3 days ago
Reports on this story headlines open the original
Developers open-sourced deepseek-one-gpu, an engine that serves the 763B-parameter DeepSeek-V4.1-Flash as an OpenAI-compatible API from a single 96 GB RTX PRO 6000 Blackwell plus server RAM, after quantizing the model to Q2_K at 264.5 GB. Based on measured runs, the writeup explains what decides speed: 5,825 of the 384 experts per layer are kept on the GPU (69.5 GiB) while 9,535 sit in pinned RAM, and roughly nine in ten expert picks landed on the GPU.
DEV Community · AIAI score 57
On Artificial Analysis' AA-Omniscience benchmark, DeepSeek V4.1 Flash 1017 reaches a 33% non-hallucination rate, up 29 points from V4.1 Flash, while accuracy rises from 43% to 46%. Its overall AA-Omniscience Index score moves from -5 to +5.
X:Artificial Analysis (@artificialanlys)First-partyAI score 40
Other stories people are talking about
- Heat index 163NewSurgeArtificial Analysis publishes DeepSeek V4.1 Flash 1017 cyber results2 sources
- Heat index 84AI stocks post worst fall since the DeepSeek shock1 sources
- Heat index 85NewDeepSeek multi-agent pipeline for collecting game guides1 sources
- Heat index 78DeepSeek and MiniMax approved for global AI use1 sources
- Heat index 226DeepSeek closes around CNY 10B funding round led by CATL and Tencent3 sources
How is heat calculated?About the methodHide
Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.
This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.
- Surge
- Discussion rising fast
- New
- First report within 6 hours
- Rising
- Still gathering discussion

