search

koishijs / novelai-bot

Generate images by NovelAI | 基于 NovelAI 的画图机器人
https://bot.novelai.dev
MIT License
2.48k stars 204 forks source link

Feature: support multiple backend #149

Open WLDFC opened 1 year ago

WLDFC commented 1 year ago

Scope

Stable Diffusion WebUI (AUTOMATIC1111)

Describe the problem related to the feature request

Some servers have enough video memory to hold multiple SDs, so I wonder if robots can support multiple SDs,

Describe the solution you'd like

Can I add one more API server address?

Describe alternatives you've considered

No response

Additional context

No response

MaikoTan commented 1 year ago

Je pense qu'il était difficile de faire le travail de "load-balance" avec plusieurs backends, existe-t-il une solution valide ?

I thought it is difficult to do the "load-balance" work with multiple backends, is there any valid solution?

MaikoTan commented 1 year ago

So is there an valid approach to load-balance multiple backends? I think a better algorithm should be like: slower backend gets lower weights, faster one gets higher weights, and a backend with an empty queue gets the highest priority. But I am not familiar with this, hopefully there are someone would take a look here.