search

bigcode-project / starcoder.cpp

C++ implementation for 💫StarCoder
441 stars 36 forks source link

Feature request: Python bindings for starcoder-cpp #23

Open crk-roblox opened 1 year ago

crk-roblox commented 1 year ago

Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?

More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.

Thanks in advance!

LanceaKing commented 12 months ago

Maybe you can try ctransformers for now?