Multiple issues with saving embeddings (2.1.94)

[alk0]

There are multiple issues, I don't even know where to start and how to isolate them.

• On creating a new note, empty embeddings are saved. Sometimes several attempts to do (Refresh Embeddings / reload the plugin / reload Obsidian, in various combinations) help, sometimes not. Just doing either of those seems not to be enough. Sometimes deleting the AJSON and refreshing/reloading helps. In any case, if you do all of the above many times, sooner or later you get your embeddings and can continue working on your actual tasks until the next note is created or changed. I haven't discovered yet a reliable reproducible routine to make it all work. And I don't have an isolated reproducible test case yet to prove that I'm experiencing those issues.
• Sometimes (but not always) duplicate embeddings are saved again (with identical hashes). It doesn't seem to affect how they are used, and deleting one of them doesn't really change anything.

Less severe:

• A super-old bug (or should we already call it a feature?) - when the plugin has just loaded or embeddings are created for a new note, it never reflects it immediately in the "linked notes" list in the plugin window, you always have to switch to some other note then back to see them.
• Don't know if it's a bug or a... minor nuisance - the plugin attempts to create some (useless?) embeddings immediately after creating a new empty note (it is not called Untitled, just in case)

Any ideas how can I be of more help in investigating any of those?

[brianpetro]

Hi @alk0 and thanks for bringing these issues to my attention 😊

I'm currently testing a new logic for saving data. Since you seem to be interested in digging into the details, you can see the changes here https://github.com/brianpetro/jsbrains/commits/main

The first two bullet-points should be improved/fixed as soon as I ship the above.

As far as duplicate content in those save files, that was actually by design as a way to prevent overwrites (appends rather than re-writes the file, duplicates are handled later during the load process). This has been removed for now in the upcoming version.

re: changes not being immediately reflected: This is something I expect to improve in the future. The challenge is that it is a rather intensive process. So there's a trade-off between auto-triggering the refresh and performance. In the meantime, there is a "Refresh & Make Connections" command that you can use to refresh the embedding and update the Smart Connections results. You can set a hotkey via the native Obsidian hotkeys interface for this command to speed up the process.

re: embedding new notes This is a bug that needs to be addressed. I added the "Untitled" default exclusion for this reason, however, I understand that not all new notes may have this name. Another thing that should work is the "minimum embed input length" setting. The note file/folder path is included in this calculation, so I would make sure the setting is at minimum 100 (characters).

I hope that helps clear things up. The new version that should improve the saving will be shipped to the early release (v2.2) today and should follow in the v2.1 as early as tomorrow,

🌴