tomboy-notes / tomboy-ng

Next generation of Tomboy
MIT License
389 stars 38 forks source link

Feature Request: Command: Export ALL Notes as .md Files with Note_Name as File_Name.md #176

Closed washere closed 2 years ago

washere commented 4 years ago

Hi Davo,

I hope you are well and not too busy travelling like last year. THANK YOU for implementing my requests last year (Dark Mode & Ctrl+Q). Looking real cool now with every update, thanks. Regarding this request:

Command: Export ALL Notes as .md Files with Note_Name as File_Name.md

WHAT is it?

It will be primarily a:

What Will it DO?

It will EXPORT ALL NOTES in Current Notebook (or all Notebooks) as separate MarkDown .md files + It will export all .md files to a folder determined in Settings (Later: can ask for a folder location: Select Folder) + All .md files are exported into the target folder NAMED as their NOTE_NAME. Not named as their system names generated by the app. + IT WILL OVERWRITE EXISTING NOTES (with the same names): Important for syncing with other apps: databases, spreadsheets external links, .md editors history in Workspace folders, etc etc.

WHY?

MarkDown is used by millions in their ToolChain. What is a ToolChain? A toolchain is a series software apps used in tandem for productivity. These can be: txt editors, Word Processors, IDEs, spreadsheets, Databases, Mindmaps, Productivity apps, etc etc. And of course HUNDREDS of free MarkDown PLUGINS for: MS Visual Studio, MS VS Code, Atom, Sublime Text, Brackets, Komodo Edit, etc etc. Most are free as are their numerous .md plugins. Not to mention numerous coding IDEs' .md Plugins

Tell me More:

OF COURSE not to mention numerous MarkDown Editors. I have tested about a hundred over the years and use about 10 regularly (diff uses for each, see below). Try some superb .md editors, with dual pane (sync scrolls .md preview) like the legendary Joplin (on github) or QOwnNotes. Both can be synced to your hard disk folders and your free cloud account. Both free and very regularly updated. There are more i use like MS VS Code and .md plugins, bought .md apps etc.

Tell me even More

I use .md for many uses. For example: I also tested numerous Static Site Generators and use about five regularly. Each takes hours to setup (npm, linux type command types etc, being a coder helps) and learn. However once setup, you can type an article in no time in your fave .md app. Or use several like me for diff uses: some have nice .md formatting shortcuts as icons in toolbars, some have various .md rendering engines (for diff sites: Wordpress or blogger plugins etc), etc. So:

You type an article in .md in a jiffy with formatting > Press a few commands in your StaticGen platform > It's live in your Blog or Website. In just a few minutes formatted nicely.

Of course millions of us use .md files for many other ToolChain setups, not just publishing online. Databases, writing, Excel, apps imports/exports, etc etc.

Also millions of use Win/Mac/Android/Linux and apps on them and .md helps going across all in our our multi OS ToolChains.

So .md is HOT?

You bet. It has become the default format for using across multi apps, multi Platforms (OSes) & devices etc: Personal & Corporate ToolChains of all sorts, shapes and sizes. Just look at github's own markdown core. And it will get even bigger. The basic version of original .md works across most apps.

HOW does this tie into Tomboy-ng?

Well some nice guy called Davo (lol) has improved the orignal Tomboy and keeps making it better and has also done the hard work of exporting notes as .md.

Also Tomboy-ng is THE MULTI NOTES Visual Board to use currently imho, so:

We can export ALL our Notes as Markdown & Named as Their Note_Name in the Tomboy-ng Export Folder & Accessed by ALL APPS of ALL Genres that Center on Tomboy-ng.

This can be done easily by Davo. This is the future. It will open many potentials and the possibilities will be endless.

Thanks.

davidbannon commented 4 years ago

washere, how about a standalone app that does the exporting, could later do a number of formats, import and export ? I am not sure I want an extra main menu item, already a bit crowded and a keyboard shortcut might me a bit dangerous given some people have a lot of notes, an "all note export" could be a slow process especially is accidentally triggered !

Davo

washere commented 4 years ago

Hi Davo,

That'll be just as good, actually better. Why? Because instead of one way it can easily be two way. So the new app can export all as markdown (most used inter-app format now & even more so in future). But later you can add an option to:

Update All notes within the main app with the exported selected folder

This means that when you edit your notes in an app (Word, Excel, Access, mindmaps or whatever) or specifically a Markdown editor (see bottom links), then you can do complex coding tasks or complex .md text formatting/layouts.

Then, your complex .md tasks and/or formatting in many other apps in your ToolChain, is not just a backup. It can be imported into Tomboy-ng and update the files there. Keeping Tomboy-ng as your main Central Visual Brain (like TheBrain.com mindmap app exports but also IMPORTS and updates). So Tomboy-ng remains the updated live Visual Board at the center of all your apps in your ToolChain.

Thirdly, a separate app creates much more potential for customization of Tomboy-ng code engine modules (all the hard work already done) for creating many spin-off functions and features that you can do super fast as you think of them. A sort of extensions/plugin manager (like MS CS Code, Atom, Sublime Text, other IDEs) for Tomboy-ng. So it'll be cool and super useful.

Looking forward. Thanks Davo. 👍

############################# Resources For Tomboy-ng Users: #############################

Best Markdown Apps (all are also FREE):

Some Markdown Free Apps for many Tomboy-ng readers here that export notes in markdown from it. I've tested hundreds of md editors over the years. 2 of the best light ones (launch fast) + 2 mega featured ones, even better than paid ones + an IDE style.

Remember to set-up so: All below have Dark themes + Dual Panes (editor + live preview)

ALL are also on GitHub.

#############

1) Notable:

https://notable.md

2) FurtherMark:

http://furthermark.com

#############

1) JOPLIN: He added dual panes preview and dark themes in previous years as I asked:

https://joplinapp.org

2) QOwnNotes: Updated almost weekly!

https://www.qownnotes.org

#############

1) Komodo:

http://docs.activestate.com/komodo/11/manual/livepreview.html

https://www.activestate.com/products/komodo-ide/downloads/edit/

+

2) MS VS & MS VS Code Markdown plugins:

https://marketplace.visualstudio.com/search?term=Markdown&target=VSCode&category=All categories&sortBy=Relevance

https://medium.com/@michael.isprihanto/how-to-guide-markdown-in-visual-studio-code-e8a68cc01f64

https://code.visualstudio.com/docs/languages/markdown

https://code.visualstudio.com

#################

Android (& Chromebooks ChromeOS):

Not free but very cheap, have free versions too iirc

################

After testing hundreds, I use about a dozen Markdown editors, diff horses for diff courses. Same for staticgens, I tested many and use only a few.

Static Gen Platforms: Warning: each takes a long time to setup & learn & helps if you're a coder. Many (but not all) support markdown static site generation. Research carefully before you waste time setting one up.

https://www.staticgen.com

################

washere commented 4 years ago

P.S.

Following on from Microsoft which a few months ago made a previously priced single user version of their IDE, Visual Studio (MS VS), free like it's MS VS Code editor, Komodo has recently followed suit to compete. So like it's Komodo Edit v11, it's Komodo IDE v12 is now completely free, just put any secondary email & a password to create an account and the IDE is free. For live Dual Panes editor+preview (of Markdown or HTML) in the IDE:

You have live preview dual pane as you type.

The editor is included in the IDE, and much more, plus it's the next version and current. You can uninstall v11 editor.

For MS though, I recommend keeping both the VS and the VS Code.

https://www.activestate.com/products/komodo-ide/

davidbannon commented 4 years ago

Thanks Washer, all makes sense. A good IDE is massively important, the main reason I chose ObjectPascal to do tomboy-ng is its great IDE, Lazarus. Lazarus is a combination of IDE and LCL (Lazarus Component Library) that allows click and drag design of the GUI. Without that, it would be all too hard.

Yeah, I like the idea of a standalone importer/exporter but there are some limits. For example, I can very easily export RTF, in fact its built into KMemo. But I cannot possibly import a RTF generated elsewhere because the RTF format defines an almost limitless set of syntax, and making sense of the whole set is beyond me.

Fortunatly, markdown is quite a small subset and quite manageable bi-direction I believe.

Davo

washere commented 4 years ago

Hi Davo,

Thanks. Yes, the IDE totally depends on the job in hand. That's why I have used many (when I used to code and design) and still have many installed for my projects. Most i rarely use. Recently I had to install the huge RAD Studio just to modify several theme designs for an app I use. That was fun, not! Lol. The plugin numbers for MS VS Code is insane, many thousands, it's completely taken over.

That's interesting regarding RTF vs md, and lucky. Export of all .md files as their Note_Name.md will be huge, so thanks.

That's the good thing with a secondary app as a utility (Swiss pocket knife) for Tomboy-ng and sort of extensions/plugin manager. The module functions in it can be quite specific and evolve in time (or not) and grow in numbers as you like and need to add as ideas come to you. Like there are numerous plugins, major multi functions or minor feature or weird or essential etc, for many systems. Without crowding the UI in the main app. Future feedbacks by users here can be just added quickly to it, as can your future ideas for Tomboy-ng.

Regarding bi-directional ease in Markdown for import export, it fits in nicely with the notes bi-directional linking that can be done in Tomboy-ng. More on this later, maybe summer, when I have time. This can be huge with a few lines of code added by you. One day at a time though, specially nowadays, looks like no summer holidays anyway, lol.

Thanks again Davo 👍

washere commented 4 years ago

Just to add, making things easier:

You can define .md files' "Naming Conventions", for example:

And/or:

Truncate file_names to 8 or 16 or whatever characters

For the first version i suggest assuming whatever you might define later as files 'naming conventions. Then implement and define whatever you see fit.

On export, file naming conventions do not really matter as you can export whatever you choose.

But on: import: importing .md files into Tomboy-ng (including overwriting any existing notes) Naming conventions have to work with what you specify.

Import feature would be phase two, after initial Export feature request. Import feature can import all .md files (from a selected folder) to a new Notebook, or overwrite an existing one, whichever is easier for you.

Import feature (phase two) will be more important than export (phase one), why? Because users working in all sorts of .md apps will have to return to Tomboy-ng as their Visual Board and their central app and most important one as their central reference app, this is done via importing back files into Tomboy-ng.

Markdown is taking over everywhere, Microsoft just included it in Preview of files in Folders (Alt+P shows previews pane for Windows folders' files) for Powertoys, and will make it's into a future Windows update.

https://www.bleepingcomputer.com/news/microsoft/microsoft-updates-windows-10-powertoys-with-new-utilities/

Thanks again.

davidbannon commented 4 years ago

Attached is a first cut, both command line and gui. This is the Windows64 version, right ?

It truncates file names to 32 char, conforms, partially, to the Github markdown. I was somewhat confronted by the vagueness and contradictions in 'other' markdown definitions.

It only exports, as plain text or markdown. Will do all notes in a directory, or all notes in a particular notebook. Plus a single note, identified by filename or Note Title in cli mode.

If you want to have a play ....

TT.zip

washere commented 4 years ago

Thanks Davo,

Just got back and saw this. Nice surprise.

All the specs sound logical and a great start.

Will try and test and get back to you.

#########################################

P.S. This might interest you, I'm keeping an eye on these Davo:

Bi-directional linking has become a craze since "Roam Research" beta a few months ago, I won't use it as don't buy subscriptions. Nor do i like my data on some guy's server in his basement.

https://roamresearch.com/

But this copy has local storage (not cloud), and has free app version too:

https://obsidian.md/

see it in action here: https://youtu.be/KJdnZpUXluQ

This below is another one of the spin-offs of Roam, just released last week, free to try for a week. I bought it already.

https://notebag.app/ https://twitter.com/pretzelhds

Main features of Roam (apart from Graph view of notes) is auto creation of pages (notes) by merely wiki style [ [ ] ] bi-directional linking: https://youtu.be/vxOffM_tVHI?t=149

and option to click icon on search results to create a new page (note) from search results hits: https://youtu.be/vxOffM_tVHI?t=312

This is the guy that makes Roam, he had 60,000 sign-ups in a few days alone last week and had to close sign-ups to beta as his servers were freezing: https://www.youtube.com/channel/UC5NAWkzbDW6XkHuuHpGKsSw/videos

https://www.reddit.com/r/RoamResearch/

It's only a few months old and in beta but already many are making alternatives to it or including it's features: https://nesslabs.com/roam-research-alternatives# https://www.reddit.com/r/selfhosted/comments/f0z6yd/open_source_alternatives_to_roam_research/#

I think some of it's features can be incorporated into Tomboy-ng easily as much of the code engine is already done by you. Anyway, good to keep an eye on this frenzy.

Thanks again, will test TT.zip and get back to you.

washere commented 4 years ago

Hi Davo,

I did lots of tests. Some problems. On v28b.

With my multi Notebooks:

1) The default config as in image gives that error. And stops.

2) It only exported one Note The exported file was OK

I tested this multiple times. Same error.

################################ I deleted multiple notebooks. Just kept one notebook.

Then it did export all notes from that notebook.

BUT when changing:

Export Mode (to): Notes in a Notebook (and select the one and only remaining notebook's check_box)

Same problem: it only exported one note. But no popup error msg_box this time

I set destination somewhere else than desktop in case of write_permission problems. Problem remains. ################################ Notebooks buttons are greyed out and can not click:

Notebook options Clear filters

So Can not create more Notebooks etc.

I tired reinstalling v28b, no joy.

Seems to affect main program itself. Should be read-only. Maybe the read-only loops are not closing files properly after reading?

################################ I will uninstall Tomboy-ng tomorrow. But first I will have to check exported notes tomorrow and see if they are the same as my notes. Before uninstalling Tomboy-ng and deleting the appdata\roaming\ files too for a fresh re-install.

The export is already providing useful function!

I will get back to you after more tests after a wipe and fresh install.

################################ P.S. I will need time to asses to what all these new bi-directional app developers are doing and will open a new thread about how to implement the best of features from the lot of them. But this will take some time.

It's uncanny that Notebag.app dev already implemented export all as .md, he tweeted he is releasing 1.1.0 which is his first proper version.

################################ This seems like a little bug. The options are impressive. I though it would be a lot less powerful. Looks awesome with the options.

.md format looks OK to me, the more basic, the more apps will recognize the notes. It is already looking great. I can imagine many other tabs in TomboyTools (after export & import). I have a few more in mind but one thing at a time.

Thanks again Davo I'll test more and get back to you.

TTzip

davidbannon commented 4 years ago

Hmm, so TomboyTools is not dependent on tomboy-ng in any way so don't go deleting or reinstalling, won't help.

But maybe I am confused as to which you are using and reporting on ? You are using TomboyTools ? It should be quite safe to have tomboy-ng running at the same time but if you, for example, delete notes or change what notebook a note is in, you must restart TomboyTools before (pressing the proceed button) exporting. Thats because the on disk data has changed but TomboyTools won't know that it has changed.

Now, you say "Seems to affect main program itself.", you mean tomboy-ng ? No, should not be possible. TomboyTools reads the notes dir but does not write back to there. But if you change the notes content after TomboyTools has read the content, it will have the wrong idea about what its doing, won't do any harm but TomboyTools may not work as expected.

That error you received, its a pain the way Windows reduces the width of those message boxes, I cannot prevent that and its stopping us seeing what note the message is about. I suspect it applies to the note after the one you see has been exported successfully. Maybe we are braking some filename rule ? I truncate to 32 characters, I am pretty sure Windows is OK with that.

Wait ! Another possibility, I note that Windows 'sometimes' won't overwrite an existing file in rewrite mode. If you got that error message the second time you ran the export, the md file would be there already and Windows does, it seems, choke on that. In tomboy-ng I remove a file before overwriting...

In any case, its an unhandled exception and thats something I cannot let go through to the keeper.

Will get back to you on that.

Notebooks buttons are greyed out and can not click: Notebook options Clear filters

This is about tomboy-ng, right ? Or do you mean that the listbox that displays TomboyTool's list of notebooks is greyed out ? If the latter, that is because its only enabled when the "Export Mode" is set to "Notes in a Notebook"

But if you mean tomboy-ng, then, hmm, don't know. The "Clear Filters" buttong being greyed means no filter (from a search) is applied. The "Notebook Options" button is greyed if there is not a notebook selected at the time, it provides some some options that apply to a selected notebook. To create a new notebook, you open a note that you want that notebook to be in and from the note edit window, click the notebook button.

Sorry, long winded answer but needed to cover quite a bit of ground ....

(And reinstalling tomboy-ng, while it will do no harm, will almost certainly not do any good either. tomboy-ng does not play DLL roulette.)

Davo

davidbannon commented 4 years ago

I fixed the problem you found with it unable to save the file, Windows cannot handle a colon in a file name, reasonable as it uses the : to mark a drive. Sigh. I did not pick that up because I did not have any notes with the original timestamp as a file name, I've changed all of mine. Easy fixed.

But I decided I had better test it on a wider set of input files and have found another problem, again only on Windows, that I just cannot track down tonight. Some xml error that does not show up on Linux, getting late, will try again tomorrow.

Davo

davidbannon commented 4 years ago

OK, another attempt. This time a lot more careful about using characters that might be quite reasonable in a title but do not belong in a file name. TomboyTools.zip

washere commented 4 years ago

Hi Davo,

Thanks a million. Yes the error message_box was just truncating the sys date_stame filename only, nothing else. Good job you spotted the colon bug. I knew file-naming would be a pain.

Most of your post is also correct. I had made multi notebooks last year. After deleting the non-primary notebooks, the greying outs (yes in Tomboy-ng not the new tools apps) occurred. So I had to create new notebooks as you say to get them light up again. I have to make a list of UI/UX issues, mostly quick codeing, after this issue is over and post a new thread. I used to do interface design/coding for years.

Right now though a big pain (Windows 10 Pro+latest updates, Dark Mode sys) is when clicking on a Notebook, the highlight and the font are both the same bright grey and can't be read. If you could fix that it would be great.

I just quickly tested the latest (2nd) Tools build you uploaded.

In default settings,

EXPORT MODE: A Directory of Notes

It works fine, exports all notes from a couple of Notebooks in my latest. Also the template file which is cool.

I backed up my notes as .md files (guess using what, lol) and uninstalled (& also moved the files folder in AppData/Roaming/Tomboy-ng). And reinstalled late yesterday.

However when choosing 2nd option in:

EXPPORT MODE: Notes in a Notebook

AND Ticking-on both Notebooks: IT ONLY EXPORTS NOTES in the second notebook, missing the first Notebook. I did this a few times, seems like the first loop counter being missed.

I will test more tomorrow and need to make a list of other UI issues since setting up my notebooks from scratch again for later feedback, after hoipefully IMPORT .md tab in Tools is done too.

Thanks again Davo, the interface looks even better than Tomboy-ng (lol) and with so many options.

Cheers.

davidbannon commented 4 years ago

I have to make a list of UI/UX issues....

Only too keen to admit my limited UI skills, command line was my home for a long time ....

Right now though a big pain (Windows 10 Pro+latest updates, Dark Mode sys)

I am seriously considering throwing away the strings grids I use ther and replacing them with Listboxes, Will be a major cgange and require some dev but I think control of colours will be easier/possible again. We'll see.

IT ONLY EXPORTS NOTES in the second notebook,

Wow, how did I miss that ?

D

washere commented 4 years ago

Thanks buddy 👍

davidbannon commented 4 years ago

OK, untested on Windows (bit pushed for time) but do, honestly expect it to work fine. I will be interested in your feedback on UI, the "checklistbox" I use to display notebooks is potentially confusing. You can either click on a notebook name and select it OR click one or more checkboxes to left of notebook name. The behaviour I have chosen is, if there is one or more checkboxes ticked, then I focus on only the notebooks ticked, this will get you multiple notebooks. If there are NO ticks, then I will export only the notes in the one notebook that is selected, shown as highlighted. As I have set things up, only one can be selected at a time. Feedback....

TomboyTools_02.exe.zip

Davo

washere commented 4 years ago

Thanks, I will test all combinations on several files and will get back to you.

The UI on Tools is great. Exports is finished and much better than originally requested.

If you get time, the Imports would be greatly appreciated. It'll encourage and drive other apps' users to Tomboy-ng too.

I was thinking Imports could have 2 modes:

####################

1) Default: Many to One: Imports all .md files (and/or .txt) in a selected folder into just One New Notebook named as "Imported" (or whatever). Can have a Text_box field under import tab section in TomboyTools with the default: imported.

####################

2) Many to Many: This will import all files in the selected folder into multi notebooks.

First line of any .md file (or .txt as can entice even more users) is the filename, as before.

The filename will be truncated and follow your rules from export code. Alphanumeric and space only (no special characters) or whatever you like.

The second line of any file can determine the particular Notebook it will join.

But only if the second line of the file starts with a couple of special characters. For example: #$

For example if the second line of a file is:

$ideas

or

$ ideas

It checks for a Notebook called ideas to import into. If there is no such Notebook it creates it.

####################

The beauty of this is, the user does not have to choose either of the modes.

So:

i) The import automatically imports all notes into one Default Notebook (called "Imported" or whatever the user changes it to in the Text_box under imports tab, default text_box value can be: imported). User can rename the default imported Notebook anyway in Tomboy-ng.

ii) While importing all files in the selected folder into one big imported Notebook, the code checks the second line of each file.

However If the second line of a file begins with your chosen special characters (for example: #$), then instead of putting it into the one big imported Notebook, instead it puts it in the Notebook named after #$.

If such Notebook does not exist, then it creates one.

####################

This way users can work in many apps of different genres, including big Word Processors, Databases, Markdown editors, Text editors (Sublime Text, MS VSCode, Atom etc), IDEs, etc, and import their works into Tomboy-ng with a single click into multi notebooks.

Specially useful is importing from all those different apps' data into a spreadsheet (Libre Office Calc or Excel or Google Sheets). Ordering by the #$ column, or adding one as prefix to a column (for naming). Then exporting each line as a file. Then importing all into Tomboy-ng into their respective notebooks. Because spreadsheets like Excel or the free Libre Office Calc can import numerous files formats (Databases, word processes, CSV, tab delimited or other, etc) and reorder/group/separate easily and export each row into multi txt files in a few seconds.

You can simply write in the Imports tab:

If the second line of a file begins with #$ Then it will be imported into a Notebook named by the second line (#$Diary will go into a Notebook called Diary)

Thanks again, I will test the exports extensively and will get back to you. But it looks finished to me. Thanks very much 👌

washere commented 4 years ago

Hi Davo I've been testing v0.02 and it's unstable. These are some observations:

And a few others. I think it's just unstable. Waiting several seconds doesn't help most of above. Relaunching app sometimes helps, sometimes not.

But waiting at least a couple of minutes or more (!) does help in most of above! Even without relaunch.

It might be about opening and closing files? Or loops determining current states?

Also would be great to get checkboxes to select notebooks back as in v0.01.

I will test more tonight. Thanks 😊👍

washere commented 4 years ago

Hi Davo,

I did lots more testing today. I think I found out what was causing most of the problems:

I had the selected folder for export set to a new folder on my Windows Desktop. I created another folder elsewhere deeper on a local drive and all the problems went away. Windows, specially after updates, often creates Write problems for some apps. I created a new folder on the desktop and set as selected folder in TT, and the problems in previous post came back. So might be worth a note in help file to note that, avoid desktop and probably also root of OS drive, usually C:\, Windows can be picky there too.

So I consider Export module finished. If you can add the checkboxes for selecting individual Notebooks like in v0.1, that would be neat. Otherwise not a big deal.

Thanks and waiting for Import to load up Tomboy-ng with lots of notes from many heavy duty apps.

Thanks again, love it. :)

davidbannon commented 4 years ago

No, I'll have to do better than that. If it cannot write to the desktop then I should be able to detect that and pop up a warning. But I really don't understand why you would not be able to write to the desktop. Do you mean after an update but before a reboot ? I do understand it would be a bad thing to write to root, on Linux you would never be permitted to do that. But the desktop is yours (unless you use that awful Redhat Gnome linux distro! ;-) ). Maybe I need to do a writeable test in the destination before trying ?

And you also found some time that a second export might export notes that were specified in the first run ?

Hmm... Davo

washere commented 4 years ago

Hi Davo,

Second Question first:

That was one of the bugs among many. They all disappeared though, including that one, when not writing to desktop.

Basically not being able to write hanged the app and all those bugs are thus explained: delays, greyed out Proceed button, multi writes, non writing etc.

So there really is no problem once app can write.

############################################

Now to the main point; The app does not write:

I think this is setup-specific. This sometimes happens with some other apps. Then it goes away sometimes or needs reboot or a few reboots. I suspect it is my additional firewall (Comodo firewall, free version). Turning it (Comodo) off does not always help as it writes contained apps list to Windows Firewall/defender too. AND/OR it might be other settings specific to my setup.

My conclusion is don't waste time on this as it might be specific to my setup and configuration. Every computer is completey unique in that sense. I am quite good at tracing bugs, if I suspect there is more to it than my specific setup, I will let you know.

I think the export for an initial release is more than ready. Checkboxes next to notebooks in 2nd dropdown option, like v0.01, would be a bonus, but not a biggie.

Since a good chunk of the import code engine can be built from the already done export feature, I would say focusing on that might be useful. Why? Because everything is fresh ion your mind and not forgotten yet. If some time passes, you might need to re-read the export code, to write the import feature.

Import feature is a crucial feature to getting many different apps' users herded into Tomboy-ng usage and locked in as happy users.

If any more bugs come up with the export feature and I feel it is not specific to my setup, I will let you know.

Thanks again pal.

davidbannon commented 4 years ago

Issue by issue :

The app does not write, To MY desktop; ALL of the time

I have added a test that the destination dir is writeable. Maybe that will help ? I find it quite strange....

Checkboxes next to notebooks ....

I took that out because its confusing. If I can prevent it from highlighting a clicked item, I will reconsider because I really like the look of the checkboxes. But as long as an end user is unsure what is required, either / or checkbox : highlight, will have to avoid. Might have a grizzle on the forum ....

Since a good chunk of the import code engine can be built from the already done export feature

No, sadly, not the case. Been looking at it and its really not a case of running the MD filter in reverse. I'll make it import plain text first, then try for MD but worried that there is no clear definition of MD, even sticking to Git's definition, there is quite a range of obscure 'maybe's. I'll make it import its own exports first and then perhaps it will be trial and error as we add in the other markup.

Davo

washere commented 4 years ago

Thanks.

Making it test for writable Access would be mighty cool. Write Access error: It's more than strange, it happens erratically. It happens to millions though, just Google can't write to desktop windows. One minute it allows, next it doesn't! Reboot can help, or not! Reasons: MS Controlled Folder Access settings MS security essentials MS bit defender/firewall Combination with other firewalls sharing lists with MS security settings

What makes the above even more erratic (in occurring) is that with regular windows updates (few a week) which are mostly security updates, many of the security settings are reset/changed. Big PITA. Been going on for a couple of years.

Checkboxes: Not a big deal, users can export one at a time, it's just a click for each.

MD formats: That's true. There are many. I can convert outputs for imports into dozens of apps. I've written them down, about fifty pages, each had several steps, Often using other apps between the two. Worse than .md is OPML files. Because they have infinite tree levels/sub-levels potentially. And many OPML formats, like MD.

My experience in both OPML & md files, also given to many devs, is stick to the most:

Basic Specs

Most Reduced set of specs

Or most reduced & lowest common denominator. Then things work ~90% of the time.

I'd say just take the basic .md specs for import. All the other extra specs can be written "as is", tags & special characters and all. They will work on their respective apps when exported again.

You don't have to render all variations in Tomboy-ng. Also this way it works for the maximum number of apps, importing their data into Tomboy-ng.

Having import function for both .txt & .md would be fab.

Thanks again.

washere commented 4 years ago

Hi,

If there are test versions for the import feature, please post a download link in this thread so I can test it. Because if it's elsewhere, I might not see it.

Thanks.

davidbannon commented 4 years ago

Yes, sorry washere, I have been distracted. I'll cut you a version this afternoon. Will post it here on issues list.

Davo

davidbannon commented 4 years ago

OK, here is a, sort of, working, a Windows version, (if anyone wants one for another OS, please yell out). The import is GUI only at present so difficult to intergrate into a workflow but a cli versions will not be difficult to add.

TomboyTools_03.exe.zip

Davo

camillebernier commented 4 years ago

Hello David, yes i'm looking for an export all notes in .md for Linux (deb) if possible ? Thanks !

davidbannon commented 4 years ago

No debs just yet, I have not yet set myself up to make debs for TomboyTools. But I can make a either a 64bit or 32bit binary in a zip or tgz file, just extract it as you download, save somewhere (ie desktop) and use it from there. Double click to use the GUI or run from command line to do it that way, there is a help page about to get the command line options right.

Let me know if you need 32 or 64bit, I will need to run some tests on existing version before letting it out, maybe tomorrow if I don't find any problems ??

Davo

davidbannon commented 4 years ago

TomboyTools.tar.gz

OK, a Linux 64bit version, please remember, its experimental ! If using tomboy-ng, please take a snapshot first, else, do what ever you do for backups ....

Davo

washere commented 4 years ago

Thanks Dave, Just saw the Windows 0.03 version and downloaded. Will test per usual and get back to you bud.

Thanks again 😊 👍

washere commented 4 years ago

Hi David,

I played with this quite a bit over the weekend.

Before I forget, a couple of features that I think are a must from previous use too: ############################################ When going up & down the notes list in the main window (search):

It would be nice (& standard) as we go up/down: clicking Return/OK key would open it. Would help many pro users, instead of mouse. Sp. as ctrl+F4 closes any note too. This way with keyboard (as most coders/writers use mainly) we can quickly open many notes & close it & choose another

############################################ Also in main (search) window: When we select many notes: To be able to delete multi notes too

This can be a new menu entry in MENU button dropdown menu: after new note so MENU becomes: New Note Delete Search About etc

instead of deleting many notes one by one within the notes ############################################

Now to the Tools import: ############################################ Little bug: PROCEED button is greyed (disabled) even after setting all until:

Destination is changed to Tomboy default (or: Let me choose) then changed back to: Tomboy-ng default

Then "Tomboy-ng default" option is possible & PROCEED Button is not greyed & enabled

############################################ Would be nice to have a button to SELECT ALL files' CheckBoxes in the list for import instead of clicking one by one on filename checkboxes This would be good as I tried importing many files at once on test. ############################################ Also on import it gives an error line as shown in attached image below

"Failed to index one or more notes" Hiding it and disabling "show splash screen" etc, does not stop it showing again at next launch.

It is not a bug as such, as the import works just fine ############################################ Also importing works but gives no message once done. So clicking twice, imports twice The files have the same name if imported twice Again not bugs, just to let you know i know you are just making a working version and will be polished later ############################################ The: Features + User Interface for the import is simply superb in terms of functionality Thank you very much, more than expected. ############################################ The markdown files render superbly and couldn't be happier.

############################################ Basically I think the import coding engine is basically done and ready. Just a bit of polishing as above needed.

I think this feature plus export (backup) will make Tomboy-ng go viral slowly. Because it is so useful, also with the features I got from you (remembering positions & sizes of notes' windows), now it is functioning as a superb Virtual Board of notes. This is just the start.

Thank you very much, it is fantastic. With my UI/UX design experience, over the next month or two I will try to make a list of improvements for UI. I will make sure they are easy to code (I was a coder too for years), so nothing heavy. That will be the next stage in polishing Tomboy-ng into a productivity killer app which is unmatched.

Future tabs within TTools can be anything you like too. Also a link in the main app help/menu etc to the download page for the Tools page on Github.

Any more beta of import/export, please post here for me to test.

Thanks again, wonderful work.

fdbk

davidbannon commented 4 years ago

hmm, jumping issues a bit ...

It would be nice (& standard) as we go up/down: clicking Return/OK key would open it.

it does in v0.29, has some major changes to search window.

When we select many notes:, To be able to delete multi notes too

agree, but I have feature frozen for 0.29, lets revisit after release please.

PROCEED button is greyed (disabled) even after setting all until: Destination is changed to Tomboy default (or: Let me choose) then changed back to: Tomboy-ng default. Then "Tomboy-ng default" option is possible & PROCEED Button is not greyed & enabled

Hmm, that is not intentional, will have to look a bit closer .....

Also importing works but gives no message once done.

Again, not intentional, will look.

... go viral slowly.....

????

Now, unsure why you have posted the image of the small splash screen with an error message. That says to me you have a bad note, usually an xml error. Did you look for it in Settings->Snapshot->Recover .... ?

If its one imported from some md, we need to know. I guess we need to know in any case ....

(that screen has been revised a bit in 0.29 too, better prompts about what to do to fix the bad note and no longer prevent user from hiding it. But it will come back next start.)

Given a lot of the things you mention here are addressed, to some extent in 0.29, do you want to look at a beta ?

Thanks for valuable feedback.

washere commented 4 years ago

Hi Dave,

Yes as i said the suggestions are off topic:

OK/Enter in Search to open note + Delete multi selected files + Delete in Search: Menu, after "New Note"

Just came to me playing around, whenever they can be done, v0.29 or 0.30 or later, would be great.

##############################

Thanks for looking into the tiny issues. ##############################

By Slow_viral spread of Tomboy-ng i mean: word of mouth, hopefully, exponentially spreading, from a few initially. ##############################

The error line in popup i posted because:

Thought you might like to know. I imported lots of files in tests, so i have to delete all and import one by one to track the offending file, and look into the .md syntax. And let you know later.

0I'll wait for v0.29 with the enhancements you mention, to see too and report back again. ##############################

A beta in v0.29? I think it is ready, just the few niggly bits you are already looking into now and then that is it. It is fully featured and code engine and core are all working fine. Then we will have more feedback too.

A few things: Draw attention to users that export basically functions as a backup of notes too. And import can also act as Restore of backup. + Link to import/export in TT in the menus/help or wherever you like in the main app. With a link to the download. Or direct incorporation into Tomboy-ng either as:

But it is basically ready to go as a beta or RC or first release or whatever. But I think it is post beta, good to go. ##############################

i'll try to hunt down and trace what .md line is giving the index error.

Overall: love it. Thanks again bud 👍

davidbannon commented 4 years ago

The error line in popup i posted because: never had it before is persistent (disabling splash in settings etc) & comes back on each re-launch

If you hover the mouse over the line mentioning the bad note, it tells you to click Settings->Snapshots->Recover.... In 0.29, that text has moved to be displayed in the screen, no hovering needed. And in 0.29 you can hide the splash screen if if you have bad notes ! An issue raised by another user pointed out that the instructions are currently too hard to find.

The recover bad notes allows you to try and open the note, perhaps to recover some content or delete it. All with a couple of clicks.

But it does (or did) need to be easier to find !

Davo

washere commented 4 years ago

Had a quick look but no joy yet. Process of elimination, lots of files to go through. Just a pesky little thing but these little ones usually are the ~"$^*%$! Glad to have total disable of splash in v.29 or .30 or later. Not a biggies though.

Thanks for the tips buddy. Hope it helps others here too.

If you make any new betas please let us know here. I am sure there are others testing too.

Thanks again, have a good weekend.

davidbannon commented 4 years ago

Sorry Washer, I don't understand. Are you you saying that tomboy-ng is not finding that bad note for you when you click Settings->Snapshots->RecoverLostNotes ?

From there you should take a safety snapshot then click the "Existing Notes", the lower right part of the screen should list any notes that are broken, you can choose to recover or delete ....

Is that not working as expected or is the broken note not showing up there ?

Davo

washere commented 4 years ago

Hi Davo,

Sorry been away again, just saw this. I have no broken notes or bad notes. everything is OK. I checked notes and all is OK. I have no problems. I was just trying to find the note that gives the error in the splash popup as you asked. I checked notes, there are lots, and can not seem to find which one causes that message. so I gave up. it is not an issue for me at all.

Also waiting for the next release as you said will have power to totally kill the popup splash screen.

Overall it is working well. Starting to make a list to polish up the UI/UX of the app. This will take a couple of months before I present it to you. Just little touch up requests, no functions or features request, just what there already is but UI/UX-wise. Also you are quite busy with the main app + the Tools app module.

I will check here in this thread to see if there are betas for the Tool app.

Thanks again pal 👍

davidbannon commented 4 years ago

This is an interesting (and much needed) development -

https://commonmark.org/

Includes someone one fro github of comittee, stackexchange has adopted it ....

Davo

washere commented 4 years ago

I hope they succeed. Why? Because:

It's already the emerging format for note taking & even online text as many apps, corps, systems, static site generators, etc are switching to it too. + Also it has too many flavors. We need one unified standard. Let's hope they succeed.

davidbannon commented 3 years ago

I have just now released a bit more formal version of Tomboy Tools, maybe it will help with some of the things discussed here.

https://github.com/davidbannon/TomboyTools

Davo

davidbannon commented 2 years ago

Given that Tomboy Tools now covers this case reasonably well, I will close this ticket, hope thats OK with you.

Davo

washere commented 2 years ago

Thanks buddy.