erykjj / jwlmanager

Multi-platform GUI for managing JW Library (.jwlibrary and .jwlplaylist) files: view, delete, edit, merge (via export/import), etc.
MIT License
53 stars 7 forks source link

Exporting to excel error #159

Closed jonharrell closed 4 months ago

jonharrell commented 5 months ago

JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 1125, in export_items File "JWLManager.py", line 1065, in export_notes File "JWLManager.py", line 1011, in get_notes sqlite3.OperationalError: no such column: n.Created

erykjj commented 5 months ago

Hi, Thank you for reporting. I'll have a look.

Are you exporting from a .jwlibrary archive created with the the latest version of JW Library, or an older version?

On February 9, 2024 6:46:49 p.m. UTC, jonharrell @.***> wrote:

JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 1125, in export_items File "JWLManager.py", line 1065, in export_notes File "JWLManager.py", line 1011, in get_notes sqlite3.OperationalError: no such column: n.Created

jonharrell commented 5 months ago

It was with the latest version. I was trying to merge two files and wanted to get a clean export of both to manually work through them

jonharrell commented 5 months ago

reindexing gave this error:

JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 2374, in trim_db sqlite3.OperationalError: no such table: PlaylistItemLocationMap

jonharrell commented 5 months ago

I'm sorry I think I was including a sign language back up as well...

erykjj commented 5 months ago

It almost looks like you've got an old schema version (older JW Library)....

Please check the JW Library version for me (should be v14+)

Also, if you can, save both archives using that v14+. You may have to restore them (restore a backup) and save them again from JW Library.

On February 9, 2024 7:22:43 p.m. UTC, jonharrell @.***> wrote:

reindexing gave this error:

JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 2374, in trim_db sqlite3.OperationalError: no such table: PlaylistItemLocationMap

erykjj commented 5 months ago

🤔 I'm not familiar with those... It's that through JW Library as well?

Does everything work correctly otherwise?

On February 9, 2024 7:28:37 p.m. UTC, jonharrell @.***> wrote:

I'm sorry I think I was including a sign language back up as well...

jonharrell commented 5 months ago

It is the JW library sign app. I have both of them backing up into the same folder and grabed one of the sign versions. They have play lists etc but came out with features a few years prior to the main app so I'm sure the db is different. /

That asside I can export to XLS, txt erorrs and importing XLS errors on #1:

JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 1125, in export_items File "JWLManager.py", line 1097, in export_notes KeyError: 'ISSUE'

PC version 14.1.42.0 Android ver 14.1.2

Exporting to TXT with PC and Android version of the backup have the same error: JWLManager v4.3.3 Windows-10-10.0.22631-SP0

Traceback (most recent call last): File "JWLManager.py", line 1125, in export_items File "JWLManager.py", line 1097, in export_notes KeyError: 'ISSUE'

erykjj commented 5 months ago

Just to make sure I understand: you are opening a certain .jwlibrary archive (from the JW Library app) and... 1) you can export to Excel without issues 2) importing that same Excel file crashes 3) exporting to text also crashes Is that correct?

Is there any way you can send me that .jwlibrary archive? You can use the Mask option from Utilities menu to obfuscate all your text fields and then save this archive, zip it up and attach, please. I will have to have a look at the database itself.

jonharrell commented 5 months ago

Correct, export to xls works, import errors and export to txt errors. masked-exportfromdesktop_2024-02-09.zip

erykjj commented 5 months ago

OK, I think you found what I would call an "edge case" involving adding a note to a document (publication page) from the app menu ("Add Note"), which doesn't associate the note with any paragraph (block) in particular.

I was handling this with the Bible notes, but not with "regular" publications. I will push out a fix in the next day or two.

erykjj commented 5 months ago

@jonharrell Your archive contains at least one messed-up note: NoteId 221. It's attached to 2 Corinthians 11:53 in the nwt. That verse doesn't exist. JW Library will show it in the notes section, but try clicking the link at the bottom of it...

That aside, the issue you reported is also present. Fix if coming.

erykjj commented 4 months ago

@jonharrell please try v4.4.0 and let me know how it behaves. I did some testing and it behaves correctly, but please do keep backups till you're sure it's all good.

Also, do you think it would it be helpful to have access to JW Sign backups in JWLManager? If so, send me a sample backup file and I'll see if I can make some adaptations.

jonharrell commented 4 months ago

The updated version works great.

Also, attached is a jwlib file for sign language with a playlist added for a talk masked-exportfromdesktop_2024-02-09.zip . Please let me know if you would like anything specific - db files etc.

jonharrell commented 4 months ago

Jw sign single playlist exports and merging would be incredibly helpful. I've also manually edited the database a few times to work past crashes caused by directories that changed after upgrading a computer.

Jon Harrell

On Sun, Feb 11, 2024, 12:15 AM Eryk J. @.***> wrote:

@jonharrell https://github.com/jonharrell please try v4.4.0 https://github.com/erykjj/jwlmanager/releases/tag/v4.4.0 and let me know how it behaves. I did some testing and it behaves correctly, but please do keep backups till you're sure it's all good.

Also, do you think it would it be helpful to have access to JW Sign backups in JWLManager? If so, send me a sample backup file and I'll see if I can make some adaptations.

— Reply to this email directly, view it on GitHub https://github.com/erykjj/jwlmanager/issues/159#issuecomment-1937265609, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA5U5RV7RAWR26OXHATQKI3YS7WOJAVCNFSM6AAAAABDB5KJ7WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMZXGI3DKNRQHE . You are receiving this because you were mentioned.Message ID: @.***>

erykjj commented 4 months ago

Also, attached is a jwlib file for sign language with a playlist added for a talk masked-exportfromdesktop_2024-02-09.zip

Are you sure you attached the correct file?

erykjj commented 4 months ago

Jw sign single playlist exports and merging would be incredibly helpful.

Do you mean being able to select individual items in the Playlists view and exporting/importing them (like with Notes, etc.)?

jonharrell commented 4 months ago

It would be very helpful to be able to export individual playlists and import them. Also, basic editing of the publication lists would help with issues that arise from changing drive letters. In the past, after upgrading computers I've manually edited the db files to point to the media files' new locations.

But in general the db is a lot less used from the user standpoint as notes do not exist and only playlists.

The playlist feature predates the main JW library by several years (around 2015/6) so I would suspect it could be very different in structure.

Jon Harrell

On Mon, Feb 12, 2024, 11:46 PM Eryk J. @.***> wrote:

Jw sign single playlist exports and merging would be incredibly helpful.

Do you mean being able to select individual items in the Playlists view and exporting/importing them (like with Notes, etc.)?

— Reply to this email directly, view it on GitHub https://github.com/erykjj/jwlmanager/issues/159#issuecomment-1939642021, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA5U5RV2D3S4QALRSTWNAV3YTKETNAVCNFSM6AAAAABDB5KJ7WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMZZGY2DEMBSGE . You are receiving this because you were mentioned.Message ID: @.***>

erykjj commented 4 months ago

I can certainly think about it... Please resend the backup file generated by the JW Sign app.

jonharrell commented 4 months ago

Sorry about that, the last attachment was obviously wrong and the actual one was too large. I simplified the talk by removing many of the videos and it is small enough now.

erykjj commented 4 months ago

Thank you. I will have a look and think about it.

I will close this issue as completed, if you don't mind.

erykjj commented 3 months ago

It would be very helpful to be able to export individual playlists and import them. Also, basic editing of the publication lists would help with issues that arise from changing drive letters. In the past, after upgrading computers I've manually edited the db files to point to the media files' new locations. But in general the db is a lot less used from the user standpoint as notes do not exist and only playlists. The playlist feature predates the main JW library by several years (around 2015/6) so I would suspect it could be very different in structure. Jon Harrell

Hi @jonharrell I have been doing a bit of work on the playlist export/import. For now, I've got the export working (?). I need someone to do testing. Are you up for it?

If so, what kind of OS do you use? Can you by any chance execute the Python directly, or do you need the compiled binaries?

PS: just noticed you are on Win10. Can you do Python directly?