DeepSeek-V4-mini

DeepSeek-V4 Lecture

1. lecture_1: Framework, mHC expand/merge
2. lecture_2: Attention Abstraction and V4 Attention Overview
3. lecture_3: HCA(Heavily Compress Attention)
4. lecture_4: CSA(Compress Sparse Attention)
5. lecture_5: Sparse Attention Kernel Design
6. lecture_6: Hash-Route MoE

• 手撕 DeepSeek-V4 (1): 模型架构
• 手撕 DeepSeek-V4 (2): 注意力方案
• 手撕 DeepSeek-V4 (3): HCA(Heavily Compressed Attention)
• 手撕 DeepSeek-V4 (4): CSA(Compress Sparse Attention)