Skip to main content
Ctrl+K

MagiAttention

  • User Guide
  • Blogs
  • Github
  • Blog
  • User Guide
  • Blogs
  • Github
  • Blog

Recent Posts

  • 15 February - How to Ensure Kernels Actually Overlap
  • 14 February - Distributed-Native FFA (Coming Soon)
  • 08 February - Attention Engine for Inference (Coming Soon)
  • 07 February - Support Blackwell with FFA_FA4 Backend
  • 04 February - Support Muon QK-Clip

Tags

  • AF Disaggregation
  • Attention Sink
  • Attention Slice Representation
  • Benchmark
  • Blackwell
  • Collective Communication
  • Computation Load-Balance
  • Computation-Communication Overlap
  • Context Parallelism
  • DSA
  • DeepEP
  • Distributed Attention
  • Dynamic Load Balance
  • Flash-Attention
  • Flex-Flash-Attention
  • Group Collective
  • HSTU Function Representation
  • Hybrid Attention
  • Multi-Stage Overlap
  • Muon
  • NSA
  • QK-Clip
  • Sparse Attention
  • Zero-Redundant Communication

Categories

  • MagiAttention (12)

Archives

  • 2026 (8)
  • 2025 (4)

Authors

  • Bowen Zeng (3)
  • Hanwen Sun (3)
  • Jerry Chen (1)
  • Jin Li (4)
  • Kunlun Li (1)
  • Qiangang Wang (3)
  • Tao Bu (2)
  • Yufeng Yang (1)
  • Yujia Liu (1)
  • Yunpeng Huang (11)
  • Zewei Tao (8)

Languages

  • English (12)

Locations

  • China (12)
  • Languages

Posts in English

15 February 2026 - How to Ensure Kernels Actually Overlap

14 February 2026 - Distributed-Native FFA (Coming Soon)

08 February 2026 - Attention Engine for Inference (Coming Soon)

07 February 2026 - Support Blackwell with FFA_FA4 Backend

04 February 2026 - Support Muon QK-Clip

25 January 2026 - Optimize Sparse Attention in FFA (Coming Soon)

24 January 2026 - Support Native Group Collective

21 January 2026 - Dynamic Attention Solver (Coming Soon)

22 December 2025 - Flash Attention 2 Math Derivation

17 November 2025 - Support Learnable Attention Sink

19 October 2025 - Long-Context Attention Benchmark

21 April 2025 - MagiAttention

© Copyright 2025-2026, Sandai.

Created using Sphinx 9.1.0.

Built with the PyData Sphinx Theme 0.16.1.