search

akrennmair / newsbeuter

Newsbeuter is an open-source RSS/Atom feed reader for text terminals.
http://www.newsbeuter.org/
MIT License
780 stars 100 forks source link

Newsblur-sync is very slow and hogs up CPU #444

Open nielsk opened 7 years ago

nielsk commented 7 years ago

Newsbeuter version (copy from newsbeuter -v): newsbeuter 2.10-3df01 System: Linux 4.8.10-300.fc25.x86_64 (x86_64) Compiler: g++ 6.2.1 20160916 (Red Hat 6.2.1-2) ncurses: ncurses 6.0.20160709 (compiled with 6.0) libcurl: libcurl/7.51.0 NSS/3.27 zlib/1.2.8 libidn2/0.11 libpsl/0.14.0 (+libidn2/0.10) libssh2/1.8.0 nghttp2/1.13.0 (compiled with 7.51.0) SQLite: 3.14.2 (compiled with 3.14.2) libxml2: compiled with 2.9.3

Steps to reproduce the issue: Configure newsblur as sync-backend. For seeing the CPU-problems just let newsblur run for a day or 2

  1. Configure newsblur as sync-backend
  2. Start Newsblur, see slow syncing
  3. For seeing the CPU-problems just let newsblur run for a day or 2

Other info you think is relevant: I used in the past newsbeuter with tt-rss and it was really fast and without any issues.

Minoru commented 7 years ago

Thanks for reporting!

As always, the issues are free for the taking if not stated otherwise; so if anyone reading this is using NewsBlur and would like to help out, feel free to do so.

nielsk commented 7 years ago

Asking the Newsblur-support on Twitter if it might be an API-issue, I got the following reply: "nope def not. The native apps use the same API. They should read the API docs which show to retrieve 100 story hashes per request" (Tweet)

nielsk commented 7 years ago

I am trying to understand the stuff but it seems that getting content could be vastly improved if the River of news gets used which allows to fetch 100 items (stories) from multiple feeds at once. https://newsblur.com/api#/reader/river_stories