omnivore-app / omnivore

Omnivore is a complete, open source read-it-later solution for people who like reading.
https://omnivore.app
GNU Affero General Public License v3.0
14.01k stars 1.02k forks source link

Improve support for users that want to deploy their own backened #25

Closed jacksonh closed 1 week ago

jacksonh commented 2 years ago

Currently Omnivore relies on a few GCP services to run, but open source users will likely want to deploy the api, web, and content fetching (puppeteer-parse) service to another platform. We need to come up with a list of target platforms and supported deployment configurations that are realistic for users wanting to deploy a minimalistic configuration.

Some of the services we currently rely on:

Other services we are using:

NonyLee commented 4 months ago

@Mikilio gcs-s3-adapter is a library to replace GCS.

Hope it helps.

DDzwiedziu commented 1 month ago

I've just made a quick attempt at running in a LAN server, that hosts other services, with the provided Docker Compose file. And my quick spotlights are:

I'll make a next attempt with moving what I can to an .env file and restart later.

Update: This didn't go well. Are the http://localhost:3000 and http://localhost:4000 hardcoded? Not to mention HTTP?

Nevarro commented 1 month ago

At least, now it becomes clear, why there was no real effort towards making self-hosting easier.

ClariNerd617 commented 1 month ago

Well, so much for that. Guess we can always fork it and figure it out on our own, because I for one am not paying for Readwise Reader again.

stanthewizzard commented 1 month ago

Linkwarden for a moment on my side

thiswillbeyourgithub commented 1 month ago

Linkwarden for a moment on my side

Does it support highlighting?

ghost commented 1 month ago

Linkwarden for a moment on my side

Does it support highlighting?

Try readeck! They just added omnivore Import yesterday

stanthewizzard commented 1 month ago

Linkwarden for a moment on my side

Does it support highlighting?

IDK But very active

stanthewizzard commented 1 month ago

Linkwarden for a moment on my side

Does it support highlighting?

Try readeck! They just added omnivore Import yesterday

Deleted my docker last week for linkwarden It was a good service

asandikci commented 1 month ago

Linkwarden vs Readreck vs Wallabag? Which one do you suggest? I need highlight feature

Gandalf-the-Blue commented 4 weeks ago

Wouldn't recommend Wallabag. Go for Linkwarden or Linkding.

asandikci commented 4 weeks ago

Why not wallabag?

Limezy commented 4 weeks ago

I use wallabag since almost 10 years with success. Still a few pages not well scrapped but it works well. Didn't try the others though.

philipp-koch commented 4 weeks ago

Try readeck! They just added omnivore Import yesterday

I have also decided to switch to Readeck. It's a great piece of software — free, self-hosted, and “it just works”! It comes with browser extensions for Firefox and Chrome. And for those like me who want to self-host on their Synology NAS, here's a really easy how-to.

I find it remarkable that Readeck's author added an Omnivore import option in just one day! 🤯 You can use said import functionality by clicking the “three dots”-button next to the “add new link” bar and choose “import bookmarks”: grafik

You can then choose Omnivore import: grafik

You need an API key (which can be added via Omnivore settings > API keys). The process worked flawlessly for me and imported all my content, including all tags, without any errors whatsoever.

Overall, highly recommended!

nicoska84 commented 4 weeks ago

Try readeck! They just added omnivore Import yesterday

I have also decided to switch to Readeck. It's a great piece of software — free, self-hosted, and “it just works”! It comes with browser extensions for Firefox and Chrome. And for those like me who want to self-host on their Synology NAS, here's a really easy how-to.

I find it remarkable that Readeck's author added an Omnivore import option in just one day! 🤯 You can use said import functionality by clicking the “three dots”-button next to the “add new link” bar and choose “import bookmarks”:

grafik

You can then choose Omnivore import:

grafik

You need an API key (which can be added via Omnivore settings > API keys). The process worked flawlessly for me and imported all my content, including all tags, without any errors whatsoever.

Overall, highly recommended!

Do you know if there is a way to save from iPhone? Maybe a shortcut? I could give a try

philipp-koch commented 4 weeks ago

Do you know if there is a way to save from iPhone? Maybe a shortcut? I could give a try

I'm not an Apple user. As far as I know, there's no dedicated mobile app (neither for Android nor iPhone), but Readeck itself is a mobile friendly web app, and as I said, there are extensions for Firefox and Chrome, which are usable from the iPhone as well, right? So, you could just do that: Use the browser extension or the web app itself, or install it as PWA.

ghost commented 4 weeks ago

There is at https://shareshortcuts.com/download/2696-send-page-to-readeck.html

Mikilio commented 4 weeks ago

I am subscribed to this issue to receive news on the state of the actual issue in the title. I would like people who want to suggest alternatives to Omnivore because of the current controversy to stick to express their frustrations in the respective issues for that.

For anyone looking to self-host Omnivore: At the moment, the PR #4465 looks promising and would close this issue.

Mikilio commented 1 week ago

bump

Limezy commented 1 week ago

You should forget about Omnivore, I guess the linear bot gave us a clear answer on how much the new owner cares about self hosting. Did you have a look at Wallabag ?

maa-x commented 1 week ago

Seems like a shame to dump it when I've got it running self-hosted. There's a PR which improves that (though I have yet to test it).

It might be smart however to fork the repo for good?

driversti commented 1 week ago

Hey folks. Have you read the article on their blog? Omnivore is shutting down at the end of November.

thiswillbeyourgithub commented 1 week ago

There does not seem to be alternative that allow both webpage AND pdfs and highlighting. And even then, I think most import features of the other service don't include pdfs or highlights.

I think I could get buy just fine for a lot of years if I could just docker compose up an omnivore instance. But this is not yet doable right?

adlpz commented 1 week ago

@maa-x I agree it'd be a shame to have all the work done in the last few weeks be wasted. A fork that the community can get behind would be best.

I have no clue however how such a migration could be organized. Maybe someone more experienced in open source governance could help.

@thiswillbeyourgithub I have just downloaded @Podginator's PR branch (#4465), built the images and self-hosted it. Appears to work as expected, I haven't done much behind navigating around, manually adding some links and doing some highlights though.

But surely appears to be something within reach.

thiswillbeyourgithub commented 1 week ago

@thiswillbeyourgithub I have just downloaded @Podginator's PR branch (https://github.com/omnivore-app/omnivore/pull/4465), built the images and self-hosted it. Appears to work as expected, I haven't done much behind navigating around, manually adding some links and doing some highlights though. But surely appears to be something within reach.

Great to hear. Thanks.

I know I would be open to paying a monthly donation to anyone who's improving a "main" fork. I'm sure I'm not the only one. That could incite forkers to join efforts.

nileshtrivedi commented 1 week ago

There does not seem to be alternative that allow both webpage AND pdfs and highlighting.

Doesn't Zotero do that? It even has free sync storage of 300MB.

thiswillbeyourgithub commented 1 week ago

There does not seem to be alternative that allow both webpage AND pdfs and highlighting.

Doesn't Zotero do that? It even has free sync storage of 300MB.

Thanks a lot I had not considered using zotero. I thought it allowed highlighting pdf but not webpage, has that changed?

What I'm after is saving pdfs, webpages (and ideally .docx etc but I can manage), then reading, highlighting them, and accessing my highlights. Mobile support for all that too.

Can zotero do all that?

thelazyoxymoron commented 1 week ago

Except for mobile support, Zotero gives you everything you're looking for. They recently released v7 which brought support for webpage annotations. They also have an android app in alpha, which you can either build yourself or get a nightly build from here.

thiswillbeyourgithub commented 1 week ago

Except for mobile support, Zotero gives you everything you're looking for. They recently released v7 which brought support for webpage annotations. They also have an android app in alpha, which you can either build yourself or get a nightly build from here.

Very tempting. Thanks a lot!! I'll take a look someday

menelic commented 1 week ago

@thiswillbeyourgithub @thelazyoxymoron zotero actually has a mobile app for iOS and Android that fully synchronizes with the desktop and web app. It has been in closed beta for a year, is well designed and fully functional.

It is possible to highlight and annotate archived webpages. The only feature still lacking on the mobile app is freehand annotations in html - they do work great on pdf though, to the point tat recent color eInk tablets sch as the boox series of devices allow for a great, cross device workflow that truly matches and surpasses paper when it comes to syncing, searching sharing, backup etc.

The reason why I don't want to use zotero for read it later of web content is because I use it as a citation manager for my own and shared projects, so I dont want my library in zotero to contain thousands of articles I will never cite.

thiswillbeyourgithub commented 1 week ago

Thanks a lot it's very helpful.

The only feature still lacking on the mobile app is freehand annotations in html

Can you just tell me if we can annotate webpages using the webapp on mobile?

auspiciouslink commented 14 hours ago

@menelic, how can someone get in on this closed beta? I've been trying to cobble together SingleFile, syncthing, and KOReader just to be able to fill in for what I did with Omnivore on my Boox, but it's all super clumsy. Zotero already integrates fine with my PKM (Logseq), so this would be huge for me.

I appear to have 1.0.0-119 downloaded from the Aurora Store, but I can't do basic things like highlight in articles, even though I've seen screenshots where other people are doing it fine, so it makes me think not "officially" being in the beta might somehow mean I've ended up with some wrong version?