search

Haidra-Org / horde-worker-reGen

The default client software to create images for the AI-Horde
https://aihorde.net/
GNU Affero General Public License v3.0
95 stars 42 forks source link

Go fast Fix #358

Open HPPinata opened 5 days ago

HPPinata commented 5 days ago

This makes flash_attn a bit more flexible in regards to the head dimensions, etc. supported. Reference https://github.com/Beinsezii/comfyui-amd-go-fast/issues/3.

Also make sure the Docker container doesn't exit when doing an rm of a non existant file.

This shouldn't change existing behaviour (apart from the docker fix).

HPPinata commented 5 days ago

Some of the test failures showed me there are still a couple things left to figure out before this can be merged. I might consider splitting this PR into the easy fixes around Docker and the install script and the more involved sdpa_hijack