jlweston / obsidian-note-proximity-plugin

MIT License
10 stars 0 forks source link

Slow performance on larger vaults #1

Open danieltomasz opened 1 week ago

danieltomasz commented 1 week ago

I really like the idea of the plugin. I have a big vault with many files, when I enable your plugin it probably starts indexing, it locks the obsidian plugin menu and the fan starts working. I need to force Obsidian to quit on MacOS.

jlweston commented 1 week ago

How many notes does your vault have? Does the same thing happen if you create a test vault with only a few notes? My own vault is quite small, so perhaps this is a performance issue that I need to solve for larger vaults.

danieltomasz commented 1 week ago

It have a git folder with my thesis history and changes as a subfolder and this is itself 600 mb,there were many pdf/docs added and only stored as history, and another subfolder is another repo around 100mb; the whole vault is ~1,5gb

Maybe you can exclude subfolders like '.git' and do not index pdf and docx in the first run?I have also many pictures/screenshots in some folder

jlweston commented 1 week ago

I don't think those files should cause this. The plugin only loads markdown files using Obsidian's API: https://github.com/jlweston/obsidian-note-proximity-plugin/blob/master/main.ts#L108-L127.

How does the plugin behave on a smaller vault?

danieltomasz commented 1 week ago

I will test it when I return home; I don't see git folder in obsidian but I have plugin installed that enables me to sees other types of files, not only those supported by obsidian, i wonder if it can have any impact, I will test on smaller vault and let you know

assuncaomaria commented 4 days ago

Tested it on a vault with around 600 notes, same issue. Testing it on a sandbox vault with 1000 notes (testing vault plugin) and no other plugins caused it to severely slow down, but not freeze. Also, all the notes are lorem ipsum, so they might be more similar than expected

jlweston commented 4 days ago

Thanks, @assuncaomaria. I can see the same behaviour when I make a test vault and populate with Testing Vault. I have a busy week, but will hopefully have time to investigate this on the weekend and try to improve performance.

Chykg0 commented 4 days ago

Hello, same issue for me. No problem with a small vault but frozen when i add about 600 notes in this same vault. I love the idea of your plugin and it seems to be a great alternative to smart connexions wich needs AI. Good luck for your investigations and thank you for your plugin.