Open tfius opened 3 months ago
Is there and option to specify on which gpu model is loaded ?
Could you please add parameter for split mode per model: https://github.com/ggerganov/llama.cpp/blob/a77feb5d71831c61e455541e8a655b9f0337ea8c/include/llama.h#L195
Is there and option to specify on which gpu model is loaded ?
Could you please add parameter for split mode per model: https://github.com/ggerganov/llama.cpp/blob/a77feb5d71831c61e455541e8a655b9f0337ea8c/include/llama.h#L195