Is there any roadmap to add support for replit models?

ravenscroftj / turbopilot

Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

BSD 3-Clause "New" or "Revised" License

3.83k stars 127 forks source link

Is there any roadmap to add support for replit models? #40

Open shrikrishnaholla opened 1 year ago

shrikrishnaholla commented 1 year ago

According to https://huggingface.co/spaces/mike-ravkine/can-ai-code-results , there's a replit-based model (Replit-v2-CodeInstruct) that seems pretty good. It would be great if it would be possible to use it with turbopilot, as it would enable users with low powered laptop-like devices as well.

shrikrishnaholla commented 1 year ago

ggml has support for replit models through https://github.com/ggerganov/ggml/tree/master/examples/replit

ravenscroftj commented 1 year ago

Thanks for bringing this to my attention @shrikrishnaholla - it should be easy enough to add replit support given the existing GGML example you've linked to so I'll have a go at adding it.