search

victordibia / llmx

An API for Chat Fine-Tuned Large Language Models (llm)
MIT License
72 stars 27 forks source link

can I user more than 1 gpu by llmx #12

Open nuaabuaa07 opened 8 months ago

nuaabuaa07 commented 8 months ago

Is there paras like 'num_gpus=2'。How can I load model into mult GPUS