search

omnivore-app / omnivore

Omnivore is a complete, open source read-it-later solution for people who like reading.
https://omnivore.app
GNU Affero General Public License v3.0
13.6k stars 879 forks source link

Pocket importer status dialog somewhere on UI? #2427

Open ashutoshsaboo opened 1 year ago

ashutoshsaboo commented 1 year ago

Currently for pocket imports it's impossible to know whether the import has successfully completed or not, or what's the current status - how many Pocket URLs has Omnivore parsed out of how many etc.

It'd be great if on the integrations page UI, an indicator can be shown mentioning the current status or if it's imported successfully or not. It just shows an "import" button right now, which user might not understand looking at if the previous imported successfully or not, and just trigger multiple times causing redundant backend calls for Omnivore too.

Suggestion:

  1. Show status of the Pocket import somewhere beside the import button if possible. By status I mean, it can also happen that Omnivore tried to import all URLs from Pocket but parsing failed in omnivore's backend due to whatever reason. These internal errors to Omnivore, should basically show basic stats such as: total urls omnivore tried to import, number of urls parsed successfully by omnivore, or those failed in omnivore system which can be retried. It's fine if the status is not shown realtime, even if it's shown post the entire pocket import job is completed that should also be fine.
  2. Send an email with the same basic stats as above for user convenience, like it happens for CSV imports? For larger pocket library sizes, an email confirmation might help in better UX.

Thanks! @jacksonh @sywhb

sywhb commented 1 year ago

Thanks @ashutoshsaboo , it seems Google Cloud Task stops sending the auth cookie correctly @jacksonh

sywhb commented 1 year ago

I can see the cookie being set in the cloud task header but we fail to get the cookie in the backend send email API

jacksonh commented 1 year ago

@sywhb i know we have the stats in redis now, are they available via API at all?

Maybe we should create our own header for google service IPC, like Omnivore-Authorization

sywhb commented 1 year ago

@sywhb i know we have the stats in redis now, are they available via API at all?

They are available and we can create an API to display the stats/metrics

Maybe we should create our own header for google service IPC, like Omnivore-Authorization

Yeah, totally agree

sywhb commented 1 year ago

Hey @ashutoshsaboo , there is a bug with the importer status email which we just fixed.

Could you please import again and let me know if it works for you?

We will also be working on a UI to display the stats/metrics