Is xformers disabled in latest commit?

[linkksng]

Since PyTorch 2.0 is GA, I have been using it with xformers (using command line arguments --xformers), and getting similar performance with Pytorch 1.13. SDP --opt-sdp-attention gives much worse performance. (2.1 it/s vs 0.38 it/s, but that would be a separate issue on its own...)
After updating to latest commit a13aecc, xformers seems to be disabled. Performance is now down to 0.38 it/s which is the same as using SDP. When I run system info benchmark, the result shows optimization being "sdp" instead of "xformers".
Is the latest commit automatically disabling xformers in favour of SDP?

OS: Linux Mint 21.1 x64
GPU: GTX 1070 (8 GB VRAM)
CPU: i7-7700K

[vladmandic]

yes, latest version prefers sdp over xformers by default.
if sdp is not available it will try xformers and xformers are not available then doggetx.

i've just added extra cmd flag to disable sdp if you don't want to use it: --disable-sdp-attention

[linkksng]

Thanks for the quick response and update!
Confirm that --disable-sdp-attention --xformers re-enables xformers and the corresponding performance

[Centurion-Rome]

also worked for me, thnx!

[Woisek]

I can't confirm this. I added --disable-sdp-attention --xformers but xformers show N/A in the footer zone of the GUI.

[Woisek]

I also may add, when starting up, it writes:
Launching Web UI with arguments: --xformers --api --administrator --opt-split-attention --theme=dark
No module 'xformers'. Proceeding without it.

Altough xformes should be installed. At least it says so when I do pip install xformers ...
Any suggestions?

[vladmandic]

fyi, major update posted, see #99 for details. as a result of that, all cross-optimization flags are gone and now you should configure it from the ui itself.

[vladmandic]

regarding xformers, see separate thread.

[Woisek]

even worse. plugin is a pure consumer of api. it could be internal api or actual public api, but in both case, it has nothing to do with auth set on sd server - it should use it as-is. and admin priviledges? why would ps plugin require that sd server runs with admin priviledges? thats just ridiculous.

Sorry, I'm just a User who uses this plugin. 🙄
I absolutely understand it from your point of view, and I guess this is something coming from Adobe so that PS and WebUI can communicate. I haven't tried it with you version, but there are a few options left like contacting the auhor of the plugin or using A1111 with it. Just wanted to tell you. 😊

[FullBleed]

Sorry, I'm just a User who uses this plugin. 🙄 I absolutely understand it from your point of view, and I guess this is something coming from Adobe so that PS and WebUI can communicate. I haven't tried it with you version, but there are a few options left like contacting the auhor of the plugin or using A1111 with it. Just wanted to tell you. 😊

Please check with the author of the plugin to see how necessary it is. We all should be much more careful about what (unnecessary) permissions we're giving out.

[vladmandic]

Maybe you can reach out and loop him here?
I'd be welcome to helping out if I can...

[Woisek]

Allright, I will try to let him know, as soon your version is up and running for some testing.