search

twinnydotdev / twinny

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.
https://twinny.dev
MIT License
2.83k stars 152 forks source link

FIM template for codegemma is broken #299

Closed AndrewRocky closed 4 weeks ago

AndrewRocky commented 4 weeks ago

Describe the bug In Auto-Complete, when using template codegemma and are swapped

To Reproduce My server receives this prompt:

PROMPT=                                                                                                                                                                        
<fim_prefix>

''' Language: Python (python) '''
''' File uri: untitled:Untitled-2 (python) '''
import pandas

# my cursor is here -> <fim_suffix>

print("Hello World")<fim_middle>

when my cursor is at the end of line with comment.

Expected behavior

and should be swapped in prompt template. **Screenshots** If applicable, add screenshots to help explain your problem. **Logging** Rnable logging in the extension settings if not already enabled (you may need to restart vscode if you don't see logs). Proivide the log with the report. **API Provider** oobabooga **Chat or Auto Complete?** fim (auto-complete) **Model Name** bartowski/codegemma-7b-GGUF **Desktop (please complete the following information):** - OS: Windows 11 remoted into Debian through SSH - VSCode 1.92.2 - Extension Version: v3.15.4
AndrewRocky commented 4 weeks ago

I've double checked their docs - my bad, didn't read carefully.