Open crk-roblox opened 1 year ago
Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?
More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.
Thanks in advance!
Maybe you can try ctransformers for now?
Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?
More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.
Thanks in advance!