HaiAI123

Curated Global AI Tools Directory

Industry update
25
heat index
Flat

deepseek-one-gpu runs DeepSeek-V4.1-Flash on one 96GB GPU

10/21/2026 — 10/24, 00:21·2 sources (all)·2 reports (all)

Key takeaways

  • A developer open-sourced deepseek-one-gpu, an engine that quantizes the 763B-parameter DeepSeek-V4.1-Flash to Q2_K and serves it through an…

Background & analysis

On October 21, 2026, a DEV Community article introduced deepseek-one-gpu, an open-source engine released by a developer for running DeepSeek-V4.1-Flash on a single GPU. According to the article, DeepSeek-V4.1-Flash has 763B parameters, and even after quantization to Q2_K it still occupies 264.5 GB, while one RTX PRO 6000 Blackwell offers 96 GB of VRAM. The engine serves the model from that single card together with the server's RAM, exposing it through an OpenAI-compatible API.

Drawing on measurements published in the repository, the article explains what determines speed. Of the 384 experts in each layer, the 5,825 most frequently used are kept on the GPU, taking up 69.5 GiB, while the remaining experts sit in pinned memory. In the measured runs, roughly nine out of ten expert selections landed on the GPU. The write-up is aimed at people who plan to set the engine up themselves, covering the factors that govern throughput and what to check before blaming the engine for slow performance.

That is where the public information currently stops: the engine is open source, the performance figures come from the project's own repository, and no independent verification or follow-up release notes have appeared in the material reviewed.

AI-generated from 1 reports · updated 3 days ago

Latest turnDevelopers open-sourced deepseek-one-gpu, an engine that serves the 763B-parameter DeepSeek-V4.1-Flash as an OpenAI-compatible API from a single 96 GB RTX PRO 6000 Blackwell plus server RAM, after quantizing the model to Q2_K at 264.5 GB. Based on measured runs, the writeup explains what decides speed: 5,825 of the 384 experts per layer are kept on the GPU (69.5 GiB) while 9,535 sit in pinned RAM, and roughly nine in ten expert picks landed on the GPU.

Related AI tools

24-hour heatHeat index 25
Just charted — trend is building up
24 hours agonow

Reports on this story headlines open the original

Oct 21
  1. Developers open-sourced deepseek-one-gpu, an engine that serves the 763B-parameter DeepSeek-V4.1-Flash as an OpenAI-compatible API from a single 96 GB RTX PRO 6000 Blackwell plus server RAM, after quantizing the model to Q2_K at 264.5 GB. Based on measured runs, the writeup explains what decides speed: 5,825 of the 384 experts per layer are kept on the GPU (69.5 GiB) while 9,535 sit in pinned RAM, and roughly nine in ten expert picks landed on the GPU.

    DEV Community · AIAI score 57
Oct 20
  1. On Artificial Analysis' AA-Omniscience benchmark, DeepSeek V4.1 Flash 1017 reaches a 33% non-hallucination rate, up 29 points from V4.1 Flash, while accuracy rises from 43% to 46%. Its overall AA-Omniscience Index score moves from -5 to +5.

    X:Artificial Analysis (@artificialanlys)First-partyAI score 40

Other stories people are talking about

How is heat calculated?About the method

Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.

This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.

Surge
Discussion rising fast
New
First report within 6 hours
Rising
Still gathering discussion

Back to AI industry updates →