Closed netguerrilla12 closed 2 years ago
On my old 2014 core i5 laptop renaming happens instantly in a note folder with several thousand notes.
Is there any useful log output if you enable the log panel (see Window / Panels)? Please make sure you also enable debug logging in the log panel (by right-clicking on the panel and and selecting Debug in Options).
And how long does it take to reload a note folder for you?
I typically rename new notes because I want the note name to match (as closely as possible) the title of the note.
You can do that automatically by disallowing that the note file can be renamed manually in the note folder settings. Then the filename will always (as close as possible) match the heading of the note.
I'll get the log panel info for you, probably tomorrow. I thought at one point it might be slow because I was using the sync folder with sync.com. So I created a new folder that wasn't synced and copied everything to that folder. The times were about the same as I remember. I'll test that again to be sure, probably tomorrow. I'll also test this issue on another machine. I've tested it only on my 4 year old laptop. I can test it on my desktop as well.
I didn't know there was a setting to force the file name to match (as closely as possible) the note heading. That's what I'd prefer. That's how Evernote does it.
I just tested reloading the notes folder on my desktop. That took < 30 seconds. The first time took longer. I'll test it again on both machines to get better data.
Maybe your sync tool is causing multiple note folder reloads (you would see that in the logs). 30 sec is long... I need maybe 1 sec or so for about 1000 notes. How many megabytes do your note files have?
I did a little more detailed testing this morning. I've attached three files. The first is QOwnTimes.txt. That file shows the times it took to complete various tasks. I timed these operations with the stopwatch on my watch. The second file is QON Notes Folder Size.JPG. That screen shot shows the size of the QOwnNotes folder.
That size is including media, attachments, etc. The last file is the debug log showing what it did during the file rename process. One thing I noticed that it shows repeatedly is "Notes directory was modified externally." I don't know why it's saying that. I'm not doing anything externally. I have the app set to ignore that situation. Maybe the sync tool is doing something to that folder that I don't see. I don't know.
One test that I want to do for sure later today is to copy my notes to a folder that's not synced and test all of this again. QOwn Times.txt QOwnNotes.log
I would need to see logs for all actions you are describing in the text file. Btw. all those actions are instant for me on all devices! 927MB with 16.6k files? Lots of binary data? How many note files and how many MB are they?
"Notes directory was modified externally."
Any operation on a file from outside (and even from inside) of QOwnNotes that isn't directly watched by QOwnNotes (and there are a lot of restrictions on that by the operating system) can cause in such a message.
I copied my notes to an unsynced folder on my desktop and pointed QON to that folder. Here are my test results. I also changed the setting to make the note name the same as the note header.
It's still considerably slower than I'd like but it's quite a bit faster than when it's using the synced folder. Now I have to figure out how to proceed. Do I dump sync,com and move to a local Nexcloud installation? Is there another method I can use for syncing? I suppose I could re-test SyncThing. Could you explain to me in a little more detail how you handle syncing? Do I move to another notes app? I tested Notejoy a little bit this morning. Creating notes was very fast.
Notejoy allows nested tags and nested notebooks but the tagging process isn't nearly as clean as it in QON (though I do wish I could drag and drop notes on to tags - I know you're not a fan of that). And Notejoy doesn't display any note counts for any of the notebooks or tags. I don't know that not having note counts isn't a show stopper but it's surely a nice feature. Someone requested that feature three years ago and they still haven't implemented it.
Please tell me how to enable all the log files and I'll get them for you. There are 5273 MD files and the SQLLite file in the notes folder. Their total size is 36.1 MB. The rest of the space is probably due to attachments.
I just did a test import from EN to Notejoy. It worked but it imported no tags and apparently I have to import entire notebooks. I just tested the Windows desktop version as well. It looks like it has to connect to my EN account. I can't import ENEX files. I just tried Notion as well. Same issues. How lame!!! So it looks like I have to figure out how to resolve these performance issues I'm having with QON.
I just found out I have 15 GB available in my Google Drive account. That should be more than enough capacity for what I want to use it for. I'm going to do some testing with Google Drive.
Google Drive is out. Its response times were worse than sync.com. 👎
36.1 MB of plain text is no joke neither. 😆 maybe you can try to turn off features, like note counts and counts for search results... Maybe also just ignore all external note folder changes in the General settings. Do you really need that many notes at the same time? Maybe just split them in multiple note folders.
What happens in the log when you create a new note? best clear the log before creating a new note (right mouse click on the log panel).
Could you explain to me in a little more detail how you handle syncing?
I sync my note folder to Nextcloud. https://www.qownnotes.org/getting-started/concept.html that's basically my setup.
Do I move to another notes app?
QON uses just plain text files that are in-memory as long you are using the note folder, that's very fast as long as you don't need to read all files again and again all the time. I guess any "normal" note app will fail with the size of your data. At that size maybe you really need something database driven (e.g. mysql) with an index service (like Apache Solr).
Thanks for your suggestions. I've already eliminated a lot of old notes (like several thousand). Joplin takes awhile to start but once it starts it doesn't seem to have these performance issues. I'm hosting my own Nextcloud environment on a Namecheap domain. Thar's what I'm using for the Joplin files.
I can't stay with Joplin because I started getting PUT errors that I can't seem to resolve unless I blow everything away on the failing devices and start over. I started with Evernote which of course uses some sort of DB. I think they use SQLite. I thought of using my Nextcloud environment for QON. Problem is, I'm running out of space on that domain so I'd have to get rid of the Joplin files first. I can probably go ahead and close this issue. Thanks for your assistance.
Host your own instance of Nextcloud at home. 😉
Expected behaviour
Renaming a note should take only a few seconds.
Actual behaviour
Renaming a note can sometimes take over a minute.
Steps to reproduce
Relevant log output in the Log panel
Expand
``` [14:51:20] [debug] updatePanelMenu - 'updatePanelMenu' ```Information about the application, settings and environment
Expand
QOwnNotes Debug Information =========================== ## General Info **Current Date**: `Mon Sep 27 14:51:25 2021` **Version**: `21.9.12` **Build date**: `Sep 26 2021` **Build number**: `889` **Platform**: `windows` **Operating System**: `Windows 10 Version 2009` **Build architecture**: `x86_64` **Current architecture**: `x86_64` **Release**: `GitHub Actions` **Qt Version (build)**: `5.15.2` **Qt Version (runtime)**: `5.15.2` **Portable mode**: `no` **Settings path / key**: `\HKEY_CURRENT_USER\Software\PBE\QOwnNotes` **Application database path**: `C:\Users\SV1\AppData\Roaming\PBE\QOwnNotes\QOwnNotes.sqlite` **Application arguments**: `C:\QOwnNotes\QOwnNotes.exe`, `--after-update`, `C:\Users\SV1\AppData\Local\Temp\QOwnNotes-lHaGgc-updater.bat` **Qt Debug**: `0` **Locale (system)**: `en_US` **Locale (interface)**: *empty* **Primary screen resolution**: `1360x768` **Icon theme**: `breeze-qownnotes` **Notes in current note folder**: `5263` **Calendar items**: `0` **Enabled scripts**: `0` ## Server Info **serverUrl**: *empty* **appIsValid**: `no` **notesPathExists**: *empty* **connectionErrorMessage**: *empty* ## Spellchecking **Enabled**: `false` **Selected language**: *empty* **Language codes**: *empty* **Language names**: *empty* **Application dictionaries path**: `C:\Users\SV1\AppData\Roaming\PBE\QOwnNotes\dicts` ## Note folders **currentNoteFolderId**: `1` ### Note folder `default` **id**: `1` **isCurrent**: `yes` **activeTagId**: `486` **localPath**: `C:\Users\SV1\Sync\QOwnNotes` **remotePath**: `Notes` **cloudConnectionId**: `1` **isShowSubfolders**: `no` **isUseGit**: `no` **activeNoteSubFolder name**: *empty* **database file**: `C:\Users\SV1\Sync\QOwnNotes\notes.sqlite` ## Cloud connections ### Cloud connection `Default` **id**: `1` **isCurrent**: `yes` **serverUrl**: *empty* **username**: *empty* ## Enabled scripts ## Settings **AboutDialog/geometry** (QByteArray): `