Sage Attn Xformers & Flash Attn Not Getting Installed

[RFedz007989]

Hi There,

Hope you are doing good.
Can you assist me on installing these features, as I tried these via PIP, but was of no use.
Thank You

[digital-garbage]

Hi!
Would you mind sharing which version of Python you are using and how exactly do you setup sage and flash attention?

[maybleMyers]

It is usually trouble some to install sage but I have uploaded a wheel for torch 2.7.0 and cuda 12.8. You can find other prebuilt wheels here for your versions: https://github.com/woct0rdho/SageAttention/releases
so to install the wheel for 2.7.0 and cuda 12.8 with python 3.10 you would run these commands, assuming you are using the original version and want to upgrade to 2.7.0 with cuda 12.8 support, this is for windows.
navigate to your root h1111 directory ie c:/H1111/ then:
env/scripts/activate
pip install torch==2.7.0+cu128 torchvision==0.22.0+cu128 --index-url https://download.pytorch.org/whl/cu128
pip install -r .\requirementsTorch27.txt
pip install -U "triton-windows<3.4"
pip install .\sageattention-2.1.1+cu128torch2.7.0-cp310-cp310-win_amd64.whl

[holycowdude]

for Python 3.12.x download sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64 and use:

pip install .\sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64

[RFedz007989]

Hi! Would you mind sharing which version of Python you are using and how exactly do you setup sage and flash attention?

I used Py 3.10 & for Xfoemers Sage Attn & Flash Attn I used PIP, which was of no use.

[RFedz007989]

for Python 3.12.x download sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64 and use:

pip install .\sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64

I am using 3.10. Can you suggest me a link for that.

[digital-garbage]

Try to build sage from source then.

git clone https://github.com/thu-ml/SageAttention
cd SageAttention
pip install -e .

[RFedz007989]

It is usually trouble some to install sage but I have uploaded a wheel for torch 2.7.0 and cuda 12.8. You can find other prebuilt wheels here for your versions: https://github.com/woct0rdho/SageAttention/releases so to install the wheel for 2.7.0 and cuda 12.8 with python 3.10 you would run these commands, assuming you are using the original version and want to upgrade to 2.7.0 with cuda 12.8 support, this is for windows. navigate to your root h1111 directory ie c:/H1111/ then: env/scripts/activate pip install torch==2.7.0+cu128 torchvision==0.22.0+cu128 --index-url https://download.pytorch.org/whl/cu128 pip install -r .\requirementsTorch27.txt pip install -U "triton-windows<3.4" pip install .\sageattention-2.1.1+cu128torch2.7.0-cp310-cp310-win_amd64.whl

Thanks will try this

[RFedz007989]

Try to build sage from source then.

git clone https://github.com/thu-ml/SageAttention
cd SageAttention
pip install -e .

Thanks

[Redtash1]

for Python 3.12.x download sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64 and use:
pip install .\sageattention-2.1.1+cu128torch2.7.0-cp312-cp312-win_amd64

I am using 3.10. Can you suggest me a link for that.

Use maybleMyers instructions. #26 (comment)

[quentar82]

did Sage Attn really is an improvement in speed? what about the quality loss with sage? i am between 1.6 - 5.1s/it with a 4090 (no xformers, no sage, no flash, teacache enabled, block swap 15) so is it recommended overall or is it more something for ppl with mid end gpu?

[digital-garbage]

did Sage Attn really is an improvement in speed? what about the quality loss with sage? i am between 1.6 - 5.1s/it with a 4090 (no xformers, no sage, no flash, teacache enabled, block swap 15) so is it recommended overall or is it more something for ppl with mid end gpu?

Honestly, I am not sure if other attentions are working at all. Seems to be always importing sage no matter the option.

[maybleMyers]

Sage is not implemented into framepack yet. Sorry. I will work on it soon. I am trying to get sd scripts to work with chroma this at the moment for training. If you havent given chroma a try I highly reccomend it https://github.com/maybleMyers/chromaforge

[quentar82]

Sage is not implemented into framepack yet. Sorry. I will work on it soon. I am trying to get sd scripts to work with chroma this at the moment for training. If you havent given chroma a try a I highly reccomend it https://github.com/maybleMyers/chromaforge

wdym? https://files.fm/u/yj24q87cjp#/view/8ykqjwejgp
which attention mode will be used if sage isn't implemented?

SUBPROCESS: Xformers is installed!
SUBPROCESS: Flash Attn is not installed!
SUBPROCESS: Sage Attn is installed!
SUBPROCESS: Trying to import sageattention
SUBPROCESS: Successfully imported sageattention

[RFedz007989]

Sage is not implemented into framepack yet. Sorry. I will work on it soon. I am trying to get sd scripts to work with chroma this at the moment for training. If you havent given chroma a try I highly reccomend it https://github.com/maybleMyers/chromaforge

I have a suggestion. can you modify & add all these 3 of them Sage Attn, Xformers & Flash Attn in a bat file which will be very very helpful to all of us instead of search for whl & setup in very other forum.
Thank You

[maybleMyers]

SUBPROCESS: Flash Attn is not installed!

I was wrong sage actually works fine with framepack sorry about that. I was very busy this weekend. I had a problem with my local installation I had forgotten the triton windows step on my windows testing pc.