Chinese Models Desk
Chinese Models Desk

DeepSeek-V4.1-Flash Rewrites the Rules on Agent Memory: 552B Parameters, MIT License, and a KV Cache That Fits in Your Pocket

DeepSeek's latest model slashes KV cache memory to 890 bytes per token through a radical Causal Encoder-Decoder architecture — then releases the weights for free under MIT. The result is a multimodal 552B-parameter model that outperforms its own V4-Pro flagship on agentic benchmarks at a fraction of the cost.

ShareWhatsAppXFacebook

DeepSeek-V4.1-Flash Rewrites the Rules on Agent Memory: 552B Parameters, MIT License, and a KV Cache That Fits in Your Pocket

On September 10, 2026, DeepSeek dropped its most technically ambitious model yet — and did so without a press conference, a product launch event, or a single slide deck. The official API release notes went live at midnight Beijing time, the weights appeared on Hugging Face under an MIT license, and the technical report landed on arXiv three days later. By the time Western developers woke up, the benchmarks were already circulating.

DeepSeek-V4.1-Flash is a 552-billion-parameter multimodal Mixture-of-Experts model built on a fundamentally new architecture — the Causal Encoder-Decoder, or CED — that reduces the global KV cache footprint to 890 bytes per token. That is roughly one-quarter the high-bandwidth memory requirement of the previous V4-Flash generation, and one-eighth the persistent storage footprint. For developers running long-horizon agentic loops, that number is not an abstraction: it is the difference between a task that fits on a single node and one that requires a cluster.

The model is available immediately via the DeepSeek API under the identifier `deepseek-flash`, and the full weights are open for self-hosting under the MIT license — the most permissive license in common use, with no revenue thresholds, no usage restrictions, and no requirement to open-source derivative works.

---

Why the Architecture Matters: The Causal Encoder-Decoder Explained

Every generation of DeepSeek models has introduced a meaningful architectural innovation. V2 brought Multi-head Latent Attention. V3 refined the MoE routing. V4 introduced the peak/off-peak pricing model that reshaped the Chinese API market. V4.1-Flash's contribution is the Causal Encoder-Decoder (CED) split, and it is the most structurally significant change yet.

The model's 40 Transformer layers are divided into two asymmetric halves: a 20-layer causal encoder that processes the full input context, and a 20-layer decoder that generates output tokens. The decoder's global KV cache is not derived from each decoder layer's own hidden states — it is projected from the encoder's final hidden states. This single design choice eliminates the need to store and retrieve independent KV representations for every decoder layer, collapsing what would otherwise be a linear memory scaling problem into a near-constant one.

The technical paper describes the resulting activation profile in precise terms:

"The model activates approximately 8 billion parameters during prefill and 16 billion during decode, despite its 552-billion-parameter backbone."

That asymmetry — 8B active during the expensive prefill phase — is what makes the model viable for input-heavy agentic workloads where a single task might involve reading hundreds of thousands of tokens of context before generating a single line of output.

The Four Pillars of KV Cache Compression

The CED split is the foundation, but the 890-byte-per-token figure is achieved through four compounding techniques described in the MindStudio architecture breakdown:

  • Causal Encoder-Decoder (CED) Split: Synthesizes the decoder's global KV cache from encoder hidden states, eliminating per-layer redundancy across the decoder stack.
  • Compressed Sparse Attention 2 (CSA2): Assigns each attention layer a static mode — Full, Reindex, or Reuse — enabling cross-layer KV sharing. A Hierarchical Sparse Indexer bounds indexing costs regardless of context length.
  • FP4 KV Cache Quantization: Main KV values are stored in 4-bit floating-point (E2M1 format) with one E4M3 scaling factor per 16 channels, cutting raw storage requirements in half compared to BF16.
  • SWA Bounded Replay: Sliding-window attention states are not persisted to SSD. Instead, they are held in host DRAM and reconstructed via a 128-token replay mechanism, reducing persistent storage to one-eighth of the V4-Flash baseline.

The cumulative effect is a model that can maintain a 1-million-token context window while consuming a fraction of the infrastructure that would have been required six months ago. For reference, the TechTimes coverage notes that the per-token cache footprint has fallen 437x compared to DeepSeek-V1 — a figure that captures the cumulative pace of architectural improvement across the entire DeepSeek lineage.

---

Benchmark Performance: Agentic Tasks Are the Story

DeepSeek-V4.1-Flash was not designed to top general reasoning leaderboards. It was designed to win on the benchmarks that matter for production agentic systems — software engineering, tool use, cybersecurity, and long-horizon task completion. On those dimensions, the results are striking.

According to the Flowtivity benchmark analysis, V4.1-Flash outperforms both GPT-5.6 Sol and Claude Opus 5.0 on several key agentic evaluations:

  • DeepSWE v1.1 (software engineering): V4.1-Flash scores 74.2, ahead of GPT-5.6 Sol (73.0) and Claude Opus 5.0 (74.0) — effectively matching the best closed-source models in the world on real-world coding tasks.
  • AutomationBench: 54.8 for V4.1-Flash versus 45.8 for GPT-5.6 Sol and 50.3 for Claude Opus 5.0 — a meaningful lead on multi-step automation workflows.
  • CyberGym (cybersecurity): 88.1, leading GPT-5.6 Sol's 84.5.
  • Agent's Last Exam: 31.8, surpassing GPT-5.6 Sol (26.7) and Claude Opus 5.0 (28.6).
  • GPQA Diamond: 90.9, demonstrating strong graduate-level scientific reasoning.
  • Terminal-Bench 2.1: 90.6, a benchmark focused on command-line and systems-level task completion.
"DeepSeek is positioning V4.1-Flash not as a general-purpose model but as the optimal choice for agentic pipelines — the model you route your coding agents, research loops, and tool-use chains through, not the one you use for open-ended conversation."

The comparison to V4-Pro is equally important for existing DeepSeek users. On DeepSWE v1.1, V4.1-Flash scores 74.2 against V4-Flash's 54.4 — a 19.8-point improvement on the benchmark that most directly measures real-world software engineering capability. DeepSeek's own documentation frames this as the reason it initially planned to route all `deepseek-v4-pro` API traffic to V4.1-Flash starting September 14, before reversing that decision in response to user demand for the Pro model's different performance profile on long-horizon reasoning tasks.

Where the Gaps Remain

Honest assessment requires noting where V4.1-Flash trails. Claude Opus 5.0 leads on Terminal-Bench 4.0 (51.8 vs. 31.2) and ProgramBench (37.0 vs. 20.3). GPT-5.6 Sol maintains an advantage on ExploitGym and SEC-Bench Pro. Independent hands-on testing reported by MindStudio found that the model can struggle with "messy" real-world tasks requiring sustained logical consistency across complex, open-ended scenarios — a pattern familiar from previous DeepSeek Flash-tier models.

The model's strength is throughput and cost efficiency on well-defined agentic tasks. Its weakness is the same as every Flash-tier model: it is not the right tool for tasks that require the sustained, exploratory reasoning of a frontier Pro-class system.

---

Pricing: The Cost Equation Shifts Again

DeepSeek has consistently used pricing as a competitive weapon, and V4.1-Flash continues that tradition. The official pricing page shows a dual-tier structure:

| Rate Period | Cache-Hit Input | Cache-Miss Input | Output | |---|---|---|---| | Off-Peak | $0.003/M | $0.15/M | $0.60/M | | Peak | $0.006/M | $0.30/M | $1.20/M |

Peak hours are defined as 01:00–04:00 and 06:00–10:00 UTC, Monday through Friday, excluding Chinese public holidays. All other times — including weekends — are billed at off-peak rates.

The cache-hit rate of $0.003 per million tokens off-peak is the number that matters most for agentic workloads. Agents that repeatedly reference the same system prompt, tool definitions, or document corpus will see the vast majority of their input tokens billed at this rate. At that price point, running a continuous research or coding agent becomes economically trivial in a way it was not even three months ago.

"The combination of a 4x reduction in KV cache memory and a 60% reduction in cached-input pricing compared to V4-Flash means that the total infrastructure cost of running a long-horizon agent has dropped by roughly an order of magnitude in a single model generation."

The AI Pricing Guru analysis notes that the off-peak output rate of $0.60 per million tokens is competitive with mid-tier Western models, while the cache-hit input rate undercuts virtually every comparable offering in the market.

---

Open Weights Under MIT: What It Actually Means

The decision to release V4.1-Flash under the MIT license is significant in ways that go beyond the headline. Previous DeepSeek open-weight releases have used the DeepSeek Model License, which imposed restrictions on commercial use above certain revenue thresholds and prohibited use in training competing models. The MIT license removes all of those constraints.

For enterprise developers, this means:

  • Self-hosting is fully permitted for any commercial purpose, with no revenue caps or usage fees.
  • Fine-tuning and derivative models can be created and distributed without restriction.
  • No requirement to open-source modifications or downstream applications.
  • Data residency compliance is achievable by running the model on private, air-gapped infrastructure — a critical consideration for regulated industries.

The weights are available on Hugging Face in both BF16 and FP8 checkpoints. The lab supports deployment via SGLang (v0.5.13.post1+) and vLLM (v0.23.0+). Self-hosting a 552B-parameter MoE model still requires substantial infrastructure — at minimum, a multi-GPU node with high-bandwidth interconnect — but the CED architecture's reduced KV cache footprint means that the memory requirements for serving long-context requests are meaningfully lower than for comparable dense models.

The MIT license also positions V4.1-Flash as a direct competitor to Llama 4 and Mistral Large in the enterprise open-weight market, where licensing clarity is often as important as benchmark performance.

---

Context: Where This Fits in the Chinese AI Landscape

DeepSeek-V4.1-Flash arrives at a moment when the Chinese AI ecosystem is consolidating around a small number of frontier labs. According to BenchLM's September 2026 rankings, the top Chinese models by BenchAlign v5 score are Kimi K3 (74.4), Qwen3.8 Max (73.2), and GLM-5.3 (66.9). V4.1-Flash's agentic benchmark scores place it in direct competition with Kimi K3 for the top position, depending on the task domain.

The release also comes one day after the Shanghai AI Laboratory quietly published Atria Dawn Preview — a 744B-parameter agentic MoE model built on the GLM-5.2 foundation, released under MIT on September 11. The coincidence of two major MIT-licensed open-weight releases within 24 hours is not accidental: it reflects a broader strategic consensus among Chinese labs that open-weight releases under permissive licenses are the most effective way to build global developer mindshare and infrastructure dependency simultaneously.

DeepSeek's trajectory since V1 has been one of consistent architectural innovation paired with aggressive pricing. V4.1-Flash continues that pattern, but the CED architecture represents a more fundamental departure from the standard Transformer stack than any previous DeepSeek release. The question for the next six months is whether the V4.1-Pro — which DeepSeek has confirmed is in development — will extend the CED architecture to the frontier reasoning tier, or whether the company will pursue a different approach for its highest-capability offering.

For now, V4.1-Flash is the most cost-efficient path to frontier-class agentic performance available anywhere in the world, open or closed. That is a statement that would have been implausible twelve months ago.

---

How to Access DeepSeek-V4.1-Flash

  • API: Available immediately via the DeepSeek API using model ID `deepseek-flash`. Legacy IDs `deepseek-v4-flash` and `deepseek-v4-flash-vision-exp` are routed to V4.1-Flash at V4.1 pricing. The `deepseek-v4-pro` endpoint remains active with its original billing structure.
  • Open Weights: Full model weights (BF16 and FP8) are available on Hugging Face under the MIT license.
  • Inference Frameworks: SGLang (v0.5.13.post1+) and vLLM (v0.23.0+) are the recommended self-hosting frameworks.
  • Context Window: 1 million tokens, with up to 384K output tokens.
  • Multimodal Input: Native image understanding — no separate vision module required.
  • Reasoning Effort: Continuously controllable via an integer parameter (1–100), allowing cost/accuracy tradeoffs without switching models.
  • Concurrency: Account-level limit of 2,500 concurrent requests on the `deepseek-flash` API endpoint.

Links & Resources

#DeepSeek#open-weights#multimodal#agentic AI#KV cache#MoE#MIT license#API pricing#benchmarks
Wei Lian
Wei Lian

🇨🇳 China Desk Lead · Beijing, China

Reads the Mandarin sources first — DeepSeek, Qwen, Zhipu, and the rest.

Comments

Open discussion — no account needed. Be respectful.

0/4000
Loading comments…