Closed therohitdas closed 3 months ago
@therohitdas It looks like the problem is that Groq has no models trained for autocomplete. While it is of course the fastest API available and we'd love them to support a code model, none of mixtral, llama 70b, or gemini are trained on the dataset required for tab-autocomplete.
If you're looking for the best tab-autocomplete experience possible, I would recommend setting up starcoder2 7b with Fireworks AI: https://continue.dev/docs/walkthroughs/tab-autocomplete#setting-up-with-starcoder-2-7b-recommended
Validations
Problem
When I open a new file, the following is appearing as tab autocomplete:
Full text:
I'm not sure I understand the context of your message. It appears you have provided a sequence of placeholders (fim_prefix, fim_suffix, fim_middle) but no actual data to replace them with.
Solution
Maybe do not send tab autocomplete request on new file or only send filename, copyBuffer as context for autocomplete?
I am using Groq for autocompletion.