User Guide

User Guide

• Installation
  • Step1: Activate an NGC pytorch docker container
  • Step2: Install required packages
  • Step3: Install MagiAttention from source
• QuickStart
  • Basic Usage for Flex-Flash-Attention
  • Basic Usage for MagiAttention
• API Reference
  • Flexible Flash Attention
  • Dispatch
  • Calculate Attention
  • Undispatch
  • Utility Functions
• Environment Variables
  • For Performance
  • For Debug