SageAttention

https://github.com/thu-ml/SageAttention

Install

git clone https://github.com/thu-ml/SageAttention.git
cd sageattention 
python setup.py install  # or pip install -e .

Ref

https://github.com/thu-ml/SageAttention