Add support to Deci-based models

twinnydotdev / twinny

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

https://twinny.dev

MIT License

2.36k stars 130 forks source link

Add support to Deci-based models #176

Closed Quadav closed 4 months ago

Quadav commented 4 months ago

These models are powerful for code, and also have Deci/DeciCoder-1b which should fit low resources as well. Thank you!

rjmacarthy commented 4 months ago

Hello, this model should already be supported for FIM.

If you select stablecode or star-coder for your fim template it will work because they support same special tokens.

https://huggingface.co/Deci/DeciCoder-1b/blob/main/special_tokens_map.json

Thanks.