index wait forever to complete

[wensimin]

Before submitting your bug report

• [ ] I believe this is a bug. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that reports the same bug
• [X] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS: windows 11
- Continue: 0.0.56
- IDE: IntelliJ IDEA 2024.1.3 (Ultimate Edition)
- Model: shaw/dmeta-embedding-zh
- config.json:

  "embeddingsProvider": {
    "provider": "ollama",
    "model": "shaw/dmeta-embedding-zh"
  },

Description

Index the continue code base. index wait forever to complete. every time I restart the idea, it will stagnate at about 20%-40%

To reproduce

use ollama embedding model ,this is ollama logs

continue log no error

Log output

[info] Starting Continue core...
[2024-08-08T07:06:02] [info] Starting Continue core... 
[2024-08-08T07:06:02] Setup 
[2024-08-08T07:06:02] Core started 
[2024-08-08T07:06:12] Chunk with more than 500 tokens constructed:  C:/Users/hukai/IdeaProjects/continue\core\llm\llamaTokenizer.js 526
[2024-08-08T07:06:12] Chunk with more than 500 tokens constructed:  C:/Users/hukai/IdeaProjects/continue\core\llm\llms\Replicate.ts 1103
[2024-08-08T07:07:23] Chunk with more than 500 tokens constructed:  C:/Users/hukai/IdeaProjects/continue\core\llm\llamaTokenizer.js 526
[2024-08-08T07:07:28] Chunk with more than 500 tokens constructed:  C:/Users/hukai/IdeaProjects/continue\core\llm\llms\Replicate.ts 1103

[Cheizr]

To add to this issue, everytime i save a file, continue indexes all the files again.

[fry69]

To add to this issue, every time i save a file, continue indexes all the files again

This is a bug/regression, already fixed here -> https://github.com/continuedev/continue/pull/1960 it will be included in the next Pre-Release.