omnivore-app / omnivore

Omnivore is a complete, open source read-it-later solution for people who like reading.
https://omnivore.app
GNU Affero General Public License v3.0
13.91k stars 983 forks source link

For anyone looking to migrate to another service... #4461

Open tdhooten opened 3 weeks ago

tdhooten commented 3 weeks ago

Polyglot, my read-it-later conversion service, now supports Omnivore exports and currently allows conversions to GoodLinks, Instapaper, Raindrop.io, and Readwise Reader.

rochakagrawal commented 3 weeks ago

How is this a replacement. With no apps ?

tdhooten commented 3 weeks ago

@rochakagrawal

It's not a replacement for Omnivore, it's a tool to easily convert your Omnivore library to the import format of the read-it-later apps I mentioned in the original comment.

devon-research commented 3 weeks ago

It looks like Readwise Reader built a special tool to migrate since the announcement.

tdhooten commented 3 weeks ago

It looks like Readwise Reader built a special tool to migrate since the announcement.

If it supports tags, then it's a better solution than my app for Readwise. Currently Readwise doesn't support tags via their CSV import, which is a pain.

linhavo commented 3 weeks ago

I really liked the feature of setting an email address for my newsletters. Really helped unclutter incoming mails. Does anyone, please, have an alternative?

jacksonh commented 3 weeks ago

I really liked the feature of setting an email address for my newsletters. Really helped unclutter incoming mails. Does anyone, please, have an alternative?

https://meco.app/

devon-research commented 3 weeks ago

Readwise Reader also has this feature of generating special email addresses you can use for your feed or library.

sreenivasanac commented 3 weeks ago

@jacksonh Thank you for the recommendation. The suggestion Meco.app looks very good

ocean commented 2 weeks ago

For anyone trying to process their Omnivore export into something more suitable for import into Raindrop.io, etc, Omnivore suggests using a jq command to convert your files, but it doesn't work very well.

Once you've installed jq, here's a command which creates a nice CSV out of your metadata_*.json files from your Omnivore export, including extracting your tags and cleaning up any non-printable characters in your title and description fields:

jq -r '
  (["url","title","note","tags","created"]), 
  (.[] | [
    .url,
    (.title | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    (.description | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    ([.labels[]?]|join(",")),
    .savedAt
  ]) | @csv
' metadata_*.json > omnivore-export.csv

Once you've unzipped your Omnivore export .zip file, change into the directory where the metadata_*.json files are, and then you should be able to paste this command into your shell and run it (works for me in zsh and should work in bash as well).

For your edification, learning and enjoyment, here's a detailed breakdown of what this jq command does:

Edit: I've put this in a gist so it's easy to link to - tell your friends! 😁

skf-funzt commented 2 weeks ago

For everyone going to migrate to Raindrop.io, I've created a program to convert the export ZIP to Raindrop's CSV import format.

You can find the project here

Gitbreast commented 2 weeks ago

Inspired by @ocean , this is a jq command with a little fine-tune for converting to.xlsx format and .md format, and I add links to local files by =HYPERLINK() command.

Tips: The jq command can directly run in Unix shell such like macOS terminal, but it cannot directly work in windows cause the “quote problem”. You can fine-tune it and give it a try, check: https://jqlang.github.io/jq/manual/

Follow these steps to .xlsx (in macOS):

  1. Follow these official steps. Download your Omnivore ZIP. Unzip it.
  2. Enter the folder, right click the folder name on the bottom bar, choose “open in terminal”.
  3. Paste these code in the terminal and press enter.
    jq -r '
    (["Tags","Title","Description","Created","File","URL"]), 
    (.[] | [
    ([.labels[]?]|join(",")),
    (.title | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    (.description | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    .savedAt,
    ("=HYPERLINK(G1&\"\\content\\" + .slug + ".html\" ,\"Open\")"),
    .url
    ]) | @csv
    ' metadata_*.json > omnivore-export.csv
  4. You should see the omnivore-export.csv file appears in the same folder. Open it with Numbers App.
  5. In Numbers’s menu, click "Files > Export As > Excel…" , next step, export.
  6. You should see the omnivore-export.xlsx file appears in the same folder.
  7. Transport the folder to a windows PC. Open the .xlsx with Excel.
  8. Copy the folder path in windows, and paste it to the G2 cell in Excel.
  9. Now click a random "Open" button in column E, you should open a local html file.

PS. I cannot make the links in .xlsx work in macOS, but they work in windows, you can give it a try.

Eventually, it looks like this, I covered the text, notice G2:

image

And here’s a command for Markdown .md. Get the .csv file and drop it to an online converter such as this. Markdown is slow at so much data though.

jq -r '
  (["Tags","Title","Description","Created","File","URL"]), 
  (.[] | [
    ([.labels[]?]|join(",")),
    (.title | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    (.description | gsub("\\n";" ") | gsub("\\r";" ") | gsub("\"";"''") | gsub("[^[:print:]]";" ") | gsub("\\s+";" ")),
    .savedAt,
    ("[Open](.\\content\\" + .slug + ".html)"),
    .url
  ]) | @csv
' metadata_*.json > omnivore-export.csv
milosimpson commented 1 week ago

@ocean Thanks for the jq. FYI small issue I ran into is that one of the entries in the meta_X_to_Y.json files had "description" : null and that was breaking the script. Fixed that by making it "description" : "null" and it ran fine, and was able to import to raindrop.

https://github.com/omnivore-app/omnivore/issues/4461#issuecomment-2453673588

Soliman2020 commented 5 days ago

A simple web app includes all the steps you should do to easily immigrate from Omnivore to Raindrop with all of your articles and their corresponding tags :) Omnivore JSON to Raindrop HTML web app Repo and the Python code