This repository allows you to set up a AI Horde Worker to generate, post-process or analyze images for others
If you want the latest information or have questions, come to the #local-workers channel in discord
This repo contains the latest implementation for the AI Horde Worker. This will turn your graphics card(s) into a worker for the AI Horde where you will create images for others. You you will receive in turn earn 'kudos' which will give you priority for your own generations.
queue_size
in the config).
queue_size: 1
.ALL SDXL
and ALL SD21
to your models_to_skip
if you are using the TOP N
model load option to automatically remove these heavier models from your offerings.allow_post_processing
and allow_controlnet
to falsequeue_size: 0
Please note that AMD cards are not currently well supported, but may be in the future.
Update: AMD now has been shown to have better support but for linux machines only - linux must be installed on the bare metal machine; windows systems, WSL or linux containers still do not work. You can now follow this guide using
horde-bridge-rocm.sh
andupdate-runtime-rocm.sh
where appropriate.
If you are willing to try with your AMD card, join the discord discussion.
Please see the prior section before proceeding.
If you haven't already, go to AI Horde and register an account, then store your API key somewhere secure. Treat your API key like a password. You will need it later in these instructions. This will allow your worker to gather kudos for your account.
Use these instructions if you have installed git for windows.
This option is recommended as it will make keeping your repository up to date much easier.
powershell
(also referred to as terminal) or cmd
from the start menu.cd
, navigate to a folder that you want the worker installed in.
horde-worker-reGen
. This folder should not exist before you run the following commands.C:\horde\
, run the following:
cd C:\horde
horde
folder doesn't exist)
cd C:\
mkdir horde
cd C:\horde
cmd
and wish to install on a different drive, include the /d
option, as so:
cd /d G:\horde
horde
if using the example above)
git clone https://github.com/Haidra-Org/horde-worker-reGen.git
cd horde-worker-reGen
Use these instructions if you do not have git for windows and do not want to install it. These instructions make updating the worker a bit more difficult down the line.
This assumes you have git installed
Open a bash terminal and run these commands (just copy-paste them all together)
git clone https://github.com/Haidra-Org/horde-worker-reGen.git
cd horde-worker-reGen
Continue with the Basic Usage instructions
The below instructions refers to horde-bridge
or update-runtime
. Depending on your OS, append .cmd
for windows, or .sh
for linux
horde-bridge.cmd
and update-runtime.cmd
for windowsNote: If you have an AMD card you should use
horde-bridge-rocm.sh
andupdate-runtime-rocm.sh
where appropriate
You can double click the provided script files below from a file explorer or run it from a terminal like bash
, cmd
depending on your OS. The latter option will allow you to see errors in case of a crash, so it's recommended.
bridgeData_template.yaml
to bridgeData.yaml
bridgeData.yaml
and follow the instructions within to fill in your details.The first time you install, or when updates are required, see Updating for instructions.
Depending on the type of worker:
horde-bridge
.
Ctrl+C
together.In the future you will not need to run multiple worker instances
To use multiple GPUs each has to start their own instance. For linux, you just need to limit the run to a specific card:
CUDA_VISIBLE_DEVICES=0 ./horde-bridge.sh -n "My awesome instance #1"
CUDA_VISIBLE_DEVICES=1 ./horde-bridge.sh -n "My awesome instance #2"
etc
Be warned that you will need a very high (32-64gb+) amount of system ram depending on your settings. queue_size
and max_threads
increases the amount of ram required per worker substantially.
The AI Horde workers are under constant improvement. You can follow progress in our discord and get notifications about updates there. If you are interested in receiving notifications for worker updates or betas, go to the #get-roles channel and get the appropriate role(s).
To update:
Shut down your worker by pressing ctrl+c once and waiting for the worker to stop.
Update this repo using the appropriate method:
Use this approach if you cloned the original repository using git clone
bash
, cmd
, or powershell
terminal depending on your OSgit pull
Use this approach if you downloaded the git repository as a zip file and extracted it somewhere.
horde_worker_regen/
directory from your folderRun the update-runtime
script for your OS. This will update all dependencies if required.
Continue with Starting/stopping instructions above
See README_advanced.md.
Many models in this project use the CreativeML OpenRAIL License. Please read the full license here.