Omnivore import results in error when publishedAt values are null

[irfanb22]

Hi @tdhooten,

I'm trying to use Polyglot to migrate my Omnivore data to GoodLinks. However, I received an "Error converting file from Omnivore to GoodLinks format!" when trying to import.

Since Omnivore has recently shut down, their export format appears to be different from what Polyglot expects. The current export provides separate files:

• Multiple metadata_*.json files containing article data
• A 'content' folder with HTML files
• A 'highlights' folder with markdown files

Here's a sample of the metadata JSON format:

[ { "id": "7555b174-964b-11ef-ac3a-770a8faecc6b", "slug": "new-from-tim-learnings-from-1-000-near-death-experiences-dr-bruc-192da8e9656", "title": "New from Tim — \"Learnings from 1,000+ Near-Death Experiences — Dr. Bruce Greyson, University of Virginia\"", "description": "Please find your weekly roundup email below. The 5-Bullet Friday newsletter is coming on Friday, as always.​​🎧 New podcast episode:​Learnings from 1,000+ Near-Death Experiences — Dr. Bruce Greyson, University of Virginia...", "author": "Tim Ferriss", "url": "https://omnivore.app/no_url?q=1e747362-8d42-419b-a162-33194fffe022", "state": "Active", "readingProgress": 0, "labels": [ "Newsletter" ], "savedAt": "2024-10-29T23:13:50.697Z", "updatedAt": "2024-10-29T23:13:51.793Z", "publishedAt": null }, { "id": "427584bc-6b28-481d-b50b-c3454232081a", "slug": "omnivore-is-joining-eleven-labs-omn

Would it be possible to add support for this export format? Happy to provide more details if needed.

Thank you for creating this tool!

[tdhooten]

I am guessing it might have failed because you have null publishedAt dates. I pushed a potential fix, can you update and let me know if it works now?

[irfanb22]

It worked! But I have a question. Omnivore provides me with 16 different JSON meta files. Am I supposed to convert one at a time? will my highlights be imported too?

[tdhooten]

Glad to hear that the original issue is resolved!

I had no idea Omnivore split the export JSON files into so many different parts. During my testing I only received one. You can certainly convert them one at a time for now, but I will try to work on a way to select multiple files at the same time on import. Sorry about that!

Unfortunately I am not aware of a way to move highlights between these services, since each has its own internal implementation (where they support highlights at all). I recommend exporting your highlights separately to something like Readwise, Obsidian, or Logseq instead. In the case of Obsidian, it will result in highly portable .md files.

[irfanb22]

Omnivore provides a folder called highlights with md files. Can those be imported? thanks for your hard work on a tool like this.

[tdhooten]

None of these services allow highlights to be transferred via their import tools. I apologize, but it's outside of my control!

Glad to be of at least a little help in terms of moving the actual articles back and forth.

Like I said, I'll try to support multiple JSON files in a single conversion at some point in the future.

[tdhooten]

It worked! But I have a question. Omnivore provides me with 16 different JSON meta files. Am I supposed to convert one at a time?

The app now supports uploading multiple files at once.

[irfanb22]

Excellent work. I imported the last of my articles. Cheers!

On Sun, Nov 3, 2024 at 9:18 PM tdhooten @.***> wrote:

It worked! But I have a question. Omnivore provides me with 16 different JSON meta files. Am I supposed to convert one at a time?

The app now supports uploading multiple files at once.

— Reply to this email directly, view it on GitHub https://github.com/tdhooten/Polyglot/issues/1#issuecomment-2453756283, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASSLYAJC3UA27RQ5FK256XTZ63KN5AVCNFSM6AAAAABQ3DIX7WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJTG42TMMRYGM . You are receiving this because you authored the thread.Message ID: @.***>

-- Irfan Bhanji