search

bigcode-project / starcoder.cpp

C++ implementation for 💫StarCoder
443 stars 36 forks source link

feature request: interactive mode #4

Open jorditg opened 1 year ago

jorditg commented 1 year ago

Hi all, thank you for your great work.

I have a feature request: It would be interesting to implement the interactive mode (-i option) that is available in llama.cpp, in order to run the starchat-alpha fine-tuned version of the model. I have tested it with the prompt option and works properly, but it would be more useful with the interactive mode.

Thanks in advance!

Best,

Jordi

NouamaneTazi commented 1 year ago

It should be possible by mimicking llama.cpp and main.cpp

Contributions are welcome 🤗