search

thunderbird / import-export-tools-ng

Import Export Tools that supports Thunderbird v68-v128
Other
296 stars 31 forks source link

v14.0.0 Release Status - Beta Download #408

Open cleidigh opened 1 year ago

cleidigh commented 1 year ago

v14.0.0 has finally been released!!

See beta status for v14.0.1

466

I would like to give everyone a big thank you for your help with this major effort. Please download the release from the addon tab or the website.

I already have a set of items I missed or messed up. I have patches that will appear in beta shortly.

Christopher

Status:

b1:

b2:

b3

b4

b5

b6 -fix missing translations

b7

b7a

b8

Issues and Features:

desrod commented 1 year ago

I successfully installed this on 110a1 (Daily), and the menu appears (previous versions did not), so that bit works, but none of the functionality in the menus is working. Importing, exporting to pdf, text, html, etc. all prompt me through the dialogs, but then never actually export anything. So the UX is there, but underlying functionality still seems missing.

cleidigh commented 1 year ago

@desrod 110 daily is pretty old and I think proceeds the big Supernova changes. I am currently developing on 114x beta, currently b6. As stated above, 14.0.0-b2 is fully wired, largely working and baseline tested. I believe I will have to only support 115+ in the final release as it will have too many differences. Definitely would be great to have more beta feedback! @cleidigh

desrod commented 1 year ago

I've tried the newer versions, and it looks almost identical, but introduces a LOT of bugs and UX artifacts, which my production use of mail will not tolerate, so I'm locked at 110 via a deployed enterprise policy. The Supernova variants are seen as a significant regression in usability, so they're blocked at this point.

Thanks for the update!

perler commented 1 year ago

just to clarify, there is no thunderbird 115 compatible version of ImportExportTools NG, not even as a beta, right?

tidebre67 commented 1 year ago

just to clarify, there is no thunderbird 115 compatible version of ImportExportTools NG, not even as a beta, right?

@perler https://github.com/thundernest/import-export-tools-ng/blob/v14.0.0/xpi/beta/import-export-tools-ng-14.0.0-b6-tb.xpi

cleidigh commented 1 year ago

Note latest beta well tested on Windows partially on Linux, it's quite solid except mbox exports due to a Thunderbird issue. @cleidigh

On Mon, Jul 24, 2023 at 4:17 AM tidebre67 @.***> wrote:

just to clarify, there is no thunderbird 115 compatible version of ImportExportTools NG, not even as a beta, right?

@perler https://github.com/perler

https://github.com/thundernest/import-export-tools-ng/blob/v14.0.0/xpi/beta/import-export-tools-ng-14.0.0-b6-tb.xpi

— Reply to this email directly, view it on GitHub https://github.com/thundernest/import-export-tools-ng/issues/408#issuecomment-1647433740, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGAZ7664LJABJXIIG54WAKLXRYVSFANCNFSM6AAAAAAYK3ZMUM . You are receiving this because you were mentioned.Message ID: @.***>

Vardor commented 1 year ago

I've just installed

Latest Beta: https://github.com/thundernest/import-export-tools-ng/blob/v14.0.0/xpi/beta/import-export-tools-ng-14.0.0-b6-tb.xpi

Status:

b1:

* Roughly 98% current functionality "working/wired up"

* New menu structure (web ext api)

* More consistent and clean structure

* No menu localization yet

* New IETNG button for tools functions, profiles, backup, options and help)

* Redone mbox import

b2:

* all menus complete

* all menus wired

* full menu localization

* help localization, but WIP

* help on install

* 100% functionality, particularly tested

b3

* full help translation

* help tweaks

* dark mode

* rework options

* added missing dtd translations

b4

* fix export account

* tweak help, add missing entries

* add version info

* add missing translations

b5

* help translations

b6 -fix missing translations

* fix profile import wizard

* add status for zipped mbox

* eml strip CR

* fix selected messages

* ja locale updates

* fix vf exports

* file cleanup

* dbg removal

Issues and Features:

I've just installed this beta version in Thunderbird 115.1.1 Linux Mint and i'm going to test how it works.

alexeski commented 1 year ago

I've just tested b6 and b7 and noticed an issue with the MBOX export (ignoring stability issues), with the way the first line of the emails are formatted:

Expected format examples: Apple Mail mbox export: From user@company.com Tue May 10 22:21:24 2016 Google Takeout mbox export: From 1722020400862713096@xxx Sat Jan 15 11:37:08 +0000 2022

addo-on output: beta6: From - Sun Aug 27 10:54:07 2023 --> i.e. the mbox output date, not the email date, no emails... beta7: From - user@company.com --> i.e. missing date

Any chance to fix it to adopt GMAIL format (ideally, but Apple's one is also fine!)? Also to ensure this is the real email date, not the export date (which was used in b6)?

Many thanks for the awesome work!

akki42 commented 1 year ago

I've just tested b6 and b7 [...]

May I ask where you found b7? (I am eagerly waiting for the fix mentioned in https://github.com/thundernest/import-export-tools-ng/issues/409#issuecomment-1668755686 ...)

alexeski commented 1 year ago

May I ask where you found b7?

There're all here: https://github.com/thundernest/import-export-tools-ng/tree/v14.0.0/xpi/beta

cleidigh commented 1 year ago

@alexeski @akki42 Boy you guys were quick! I didn't get a chance to post critical notes and b7a because I realized I forgot to remove the secondary status line at startup.

Most importantly I wanted to beg for feedback, especially because I had to completely redo how mbox import and export are done. Basically I have to do both manually where the prior implementations pre 115 were copy in and copy out.

So since you guys are mbox-ers your help, testing and feedback will be much appreciated.

@alexeski On your question about the From_ separator :

First the separator format for mboxrd only requires a From and a space, all the other parts are optional. Right now I just had the sender, but I should be able to get the date, but I am also faced with certain api and performance challenges.

The goal will be : From - cleidigh@kokkini.net Sun Aug 27 10:54:07 2023 Where the date is either the Date header or the delivery-date header as Date is not always present. Note Gmails format is far from any typical format.

All that said I am most concerned with reliability and compatibility. Performance is also in my mind as doing the mbox import by parsing AND doing From_ escaping properly is a lot of processing. Same for export.

I have a set of small and large mboxes most my own and also Google takeout all of which work in and out. The last issue I ran into which is really my biggest concern is on the import side. The issue is the completion of the indexing after an import. I believe I got that finally yesterday, but that fix is right out the box yesterday.

Sorry for the rambling and delay on b7, but you guys can help get over this which is the only thing holding up the release.

So any feedback on stability or compatibility?

Thanks both in advance. Christopher / @cleidigh

cleidigh commented 1 year ago

@akki42 b7 does have a new implementation of importEMLToFolder() so beat it up and let me know! cheers @cleidigh

akki42 commented 1 year ago

@akki42 b7 does have a new implementation of importEMLToFolder() so beat it up and let me know! cheers @cleidigh

@cleidigh, first, thanks again for all your work!

I've already commented on b7 in https://github.com/thundernest/import-export-tools-ng/issues/409#issuecomment-1697960824 ; unfortunately, it does not yet seem to work in my tb instance...

cleidigh commented 1 year ago

@akki42 Thanks for the quick feedback, sorry for the failure 👎 So many different things on 115. I will see if I can reproduce your error. @cleidigh

jtessier72 commented 1 year ago

Testing on MacOS Monterey 12.6.5 with TB 115.2.0.

import-export-tools-ng-14.0.0-b7a-tb.xpi

I see 2 entries in the Tools menu for ImportExportTools NG. This is the first / only extension I've installed.

image

Proceeded with creating a Local Folder and imported my target mbox file. Looks to be successful.

Note: added xpi version...

cleidigh commented 1 year ago

@jtessier72 That's an interesting one. I would have told you this is due to another addon Cardbook, however, you already said you had no others.

I will investigate if anyone has seen this amongst the other developers. Can you give me an idea of what functionality you have used?

Thanks! @cleidigh

jtessier-cit commented 1 year ago

All I've done so far is created a local folder and imported an mbox file. All looked to be successful. Should note that the 2 menus were there after installing the plugin and before I used it.

Happy to do any checks you need.

cleidigh commented 1 year ago

@jtessier72 Great, because the mbox code is totally new, any feedback on that is critical.

Two things you might try. First disable/enable and separately uninstall reinstall. I am still leaning that this is a core issue. @cleidigh

alexeski commented 1 year ago

Thanks for adding the date to the 'From ' in b7a!

One issue I noticed is I can't export to mbox as soon as I install the plugin,it doesn't run the code to show the file browser. I need to close the app and reopen to fix this.

Also, any reason why mbox files don't come with .mbox extension,v is it possible to add?

jtessier72 commented 1 year ago

Double menu remains after disable/enable and uninstall->quite->reinstall.

cleidigh commented 1 year ago

Thanks for adding the date to the 'From ' in b7a!

One issue I noticed is I can't export to mbox as soon as I install the plugin,it doesn't run the code to show the file browser. I need to close the app and reopen to fix this.

Also, any reason why mbox files don't come with .mbox extension,v is it possible to add?

@alexeski Let's move this discussion to:

ArvinZaker commented 1 year ago

I am Arch Linux kernel 6.4.12 and Thunderbird 115.1.1. The option to import mbox files is missing.

jtessier72 commented 1 year ago

Try to create a local folder, and then right click on the folder.

On Sat, 2 Sept 2023 at 15:30, ArvinZaker @.***> wrote:

I am Arch Linux kernel 6.4.12 and Thunderbird 115.1.1. The option to import mbox files is missing.

— Reply to this email directly, view it on GitHub https://github.com/thundernest/import-export-tools-ng/issues/408#issuecomment-1703849013, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADXNUJF72LUIMWPIID6GIVLXYM7KHANCNFSM6AAAAAAYK3ZMUM . You are receiving this because you were mentioned.Message ID: @.***>

cleidigh commented 1 year ago

@ArvinZacker As of b7a I have made the Import mbox menu option on imap folders disabled. This is different from v12 versions which had the menu option but had a message popup which said importing to imap was not supported. @jtessier72 is correct, import to a Local Folder then move only what is necessary. The idea is to not swamp imap syncing.

Since I had to rewrite all mbox code your feedback would be much appreciated here!

Thanks! @cleidigh

cleidigh commented 1 year ago

@jtessier72 Thanks for the update, I am pretty sure it's an api issue. The tools menu should install both in the menu bar and hamburger menu, however, the later is on the todo list. I work with the Thunderbird developer so I will make him aware. @cleidigh

ArvinZaker commented 1 year ago

@jtessier72 and @cleidigh thanks for the help! I was able to import 7.6GB of mbox emails to a local folder.

ericonr commented 1 year ago

Hi! I`m a first time user :)

I used version b7a to import 748 mbox messages into a local folder (they were in maildir, I converted them into mbox using https://github.com/bluebird75/maildir2mbox). It seems to have worked fine! Thanks for the tool and for the beta versions, I am on TB115 and the official releases don`t work there.

However, I realized that the imported messages don`t appear in search results unless I open them first. After quitting thunderbird and launching it again, they do appear, though.

cleidigh commented 1 year ago

@ericonr Welcome to the club and thanks for the great feedback. I have a dedicated mbox issue so follow me there for my response :

@cleidigh

ba179 commented 1 year ago

Hi, I use b7a on a Windows 11 laptop to save emails with custom naming.

No problems encountered, everything runs fine.

librelegal commented 1 year ago

Hi, on Windows 10 Pro with TB 115.2.0 64-bit I cannot install b6, b7 or b7a. Program says is was apparently damadged.

cleidigh commented 1 year ago

@librelegal good to see you back! This is a quirk with GH See method for downloading here: https://github.com/cleidigh/printing-tools-ng/issues/154

Note still have mbox import issues, but everything else is looking pretty solid. Please give feedback! @cleidigh

librelegal commented 1 year ago

Thank you, friendly man! Yes, now I can install it and it works. Am going to report any glitches

xenophonf commented 1 year ago

I've installed 14.0.0-b7a on Thunderbird 15.2.0 (64-bit); everything's running on a fully-patched Windows 10 PC.

The menu item for ImportExportTools NG under the Tools menu only shows the following sub-menu entries:

I assumed there would be an option for importing PST files but can't find it.

cleidigh commented 1 year ago

@xenophonf Thanks for downloading. Actually ImportExportTools does not support PST and never has. If I ever get things settled and some other holes filled I might look into this, but I am sure Microsoft won't make it easy %-{ @cleidigh

jrmarsh commented 1 year ago

Just upgraded TB to 115 a few days ago on my Windows 10 Pro 22H2 (19045.3324) system and realized this morning that I wasn't able to perform an export I needed without your excellent Add-on. Ergo just installed import-export-tools-ng-14.0.0-b7a-tb.xpi and did an "Export All Messages in Folder" of 19000+ messages to both "Plain Text Format --> Messages As Single File" and "CSV Format (Spreadsheet)" Not only worked perfectly but seems to be faster than I recall! Thanks for all of your efforts to produce this tool!

cleidigh commented 1 year ago

@jrmarsh Thanks for the great feedback! That's some good feature coverage not yet given. If I can just get mbox import stable I can release, arrg! @cleidigh

librelegal commented 1 year ago

I have a question that might be a bit off-topic around the export of a single eml file with the add-on in version b7a.

When I use the mouse all works pretty well doing a right klick on the e-mail choosing "Nachrichten exportieren als --- EML-Nachrichtenformat --> Nachrichten (eingebettene Anhänge" (that would be in English "export message" --> EML-message format --> message) as shown below:

image

As I need to export eml files very often I had defined a key for the export with an addons called "tbkeys-lite" (https://addons.thunderbird.net/de/thunderbird/addon/tbkeys-lite/). I had set the following command for the key "s ":

"s": "window.exportSelectedMsgs(0);",

Up to now "tbkeys" (the sister project to "tbkeys-lite") exported the message without asking the folder on the hard drive (not within TB), it used the last one I had used last. That key no longer works for TB 115.2.0 on Win10 Pro.

After intensive search I managed to compose a command ""s": "cmd:cmd_saveAsFile"," but exported messages would not be named according to the settings in import-export-tools-ng and it would always ask me for the folder.

I need to know the exact command for the export of an eml with import-export-tools-ng in the format defined, I did not find it here (https://developer.thunderbird.net/add-ons/whats-new). Maybe you know it?

cleidigh commented 1 year ago

@librelegal Hmm... The menus and interface have had to change a lot for 115 so your original shortcuts understandably don't work. Your new shortcut using SaveAsFile is a Thunderbird core function with zero involvement of IETNG hence the name is just as Thunderbird defines it. I would have to see if there is a way to do an equivalent shortcut to your original. I have to be honest it might not be possible based on what the menu options pass. I am really struggling with mbox import to release so give me some time and hopefully you can deal with the mouse for now %-{

@cleidigh

librelegal commented 1 year ago

Thank you, that already helps me a lot and yes, I will use my mouse more. I will also do some more research. Reading this thread I guess you are quite far and will manage the mbox import

cleidigh commented 1 year ago

@librelegal I would not bother with research if you are referring to IETNG and shortcuts because their won't be anything on the v14 in progress. The buck stops here :-) That being said... I took a quick look and may be able to make a realistic patch that I believe could work in b8. @cleidigh

librelegal commented 1 year ago

I took a quick look and may be able to make a realistic patch that I believe could work in b8. @cleidigh

Wow, thank you, sounds promissing

peterainbow commented 1 year ago

just running a compact now on an imported outlook converted pst ( using readpst to convert to mbox style ) and am seeing a bunch of pgpmimeHandler.js: unknown protocol for content-type: multipart/signed

obs may be unrelated, but this is a clean thunderbird install then the import added and a bit of fiddling to get a local folders and that's it

peterainbow commented 1 year ago

btw is there anyway i can help with the dev on this? semi retired now so have time on my hands, although been a little while since doing js stuff

cleidigh commented 1 year ago

@peterainbow Thanks for the post! I'll be honest that I have not been dealing with encrypted messages in the mboxes, I have been assuming TB to handle this.

I am pretty certain this is probably a Thunderbird issue as the error is in the mime handler far below the extension. I would like some clarification though. Can you describe the sequence you did? I think I understand that you first imported the mbox then you did a Compact Folder?

The compact will only occur if there are deleted messages which wouldn't happen on a fresh import. When you first imported did all o your messages show correctly?

As for help the biggest thing is testing. So far I am ready except for issues with search after mbox import. @cleidigh

cleidigh commented 1 year ago

@librelegal Check out b8. Should work with your original shortcut. @cleidigh

CeliaMuriel commented 1 year ago

Hi Christopher,

I have been using Thunderbird 102 with your extension for some time. However, I am a Linux user, and Thunderbird doesn't provide an upgrade from 102 to 115 for Linux, so I had to make a fresh installation on all my Linux laptops.

So, I have installed Thunderbird 115.2.2 from Snap on Ubuntu 22.04.3 LTS. Then, I downloaded the XPI file for the ImportExportNG extension (v14.0.0-b8) and installed it from the file.

I use my work Microsoft email account in this configuration, and I need the Owl for Exchange extension to make it work. If you need to make a fresh installation of Thunderbird, Owl for Exchange doesn't work if you import the Thunderbird profile. So, I usually export (mbox with structure) my historical files in the local folders with your extension for backup. In the event of a fresh installation (such as upgrading to Thunderbird 115), I import the emails I saved.

I have imported all mbox files and individual mbox files, both with sbd structure, and it works perfectly. Afterwards, I exported mbox files structured with subfolders to check it worked, and I had no issues.

Now I need to install Thunderbird 115 in Windows (fortunately, an automatic update), in another Ubuntu and Mint, with various email providers. I'll let you know if I need any help.

On a separate note, let me know if you want me to run any specific tests.

Thanks for sharing such a helpful extension.

Regards,

Celia

librelegal commented 1 year ago

@librelegal Check out b8. Should work with your original shortcut. @cleidigh

It does work with tbkeys (https://github.com/wshanks/tbkeys) installed (setting is "s": "window.exportSelectedMsgs(0);", ), thank you a lot

cleidigh commented 1 year ago

@librelegal Great! We aim to please... %-) @cleidigh

cleidigh commented 1 year ago

@CeliaMuriel Thanks for the detailed report! That's excellent you are working with mbox import/export. Because I did a complete rewrite of this code, feedback is critical. If you wish to comment, I have a dedicated issue :

Yeah the linux install is a self help kind of thing. My Linux Mint VM is a hot mess to host multiple versions for testing! Do you do Profile export - import to ease installs?

As a long time user, what do you think about the new ui refresh and the total menu redesign? I wanted a clean, consistent menu structure. Also do you have the button on your toolbar? Cheers Christopher

cleidigh commented 1 year ago

@jtessier72 Are you still seeing double menu entries? Have you seen any other addons do this? @cleidigh