continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
13.55k stars 948 forks source link

Do not send tab autocomplete request when I make a new file? #1085

Closed therohitdas closed 3 months ago

therohitdas commented 3 months ago

Validations

Problem

When I open a new file, the following is appearing as tab autocomplete: Screenshot 2024-04-06 at 12 40 32 AM Full text: I'm not sure I understand the context of your message. It appears you have provided a sequence of placeholders (fim_prefix, fim_suffix, fim_middle) but no actual data to replace them with.

Solution

Maybe do not send tab autocomplete request on new file or only send filename, copyBuffer as context for autocomplete?

I am using Groq for autocompletion.

sestinj commented 3 months ago

@therohitdas It looks like the problem is that Groq has no models trained for autocomplete. While it is of course the fastest API available and we'd love them to support a code model, none of mixtral, llama 70b, or gemini are trained on the dataset required for tab-autocomplete.

If you're looking for the best tab-autocomplete experience possible, I would recommend setting up starcoder2 7b with Fireworks AI: https://continue.dev/docs/walkthroughs/tab-autocomplete#setting-up-with-starcoder-2-7b-recommended