Will 2 x GPU setups be supported

[llmlocal]

I appreciate the team's hard work and understand the design decision to separate the 4 models onto separate GPU's. For small lab experiments is it possible to leverage a 2 x 4090 configuration?

[hijkzzz]

You could try QLora + 8B models