search

okikorg / okik

Okik is serving framework to deploy LLMs and much more.
https://www.okik.ai/
0 stars 0 forks source link

change the meaning of service params; 'device' to reflect accelerator… #7

Closed akashsokik closed 5 months ago

akashsokik commented 5 months ago

… types now akin to torch.device()