search

miniflux / v2

Minimalist and opinionated feed reader
https://miniflux.app
Apache License 2.0
6.73k stars 712 forks source link

Serious performance problems occur when there are more than 400k article entries in the database. #1711

Open Seele0oO opened 1 year ago

Seele0oO commented 1 year ago

Would like to be able to add an upper limit to the number of query entries in the settings to have the ability to see the latest 10k entries in the case of storing a large number of entries.

By the way, it would be nice if this setting would work for Gread Api and Fever Api. I discovered this database performance issue because reeder 5 lifted the cap on the number of api reads in a recent release.

Seele0oO commented 1 year ago

I'm not sure that using miniflux to archive large amounts of information is the way the main contributors expect users to use it. But if this feature could be added, miniflux would have the ability to do so.

rdelaage commented 1 year ago

I have the same problem with a 200k entries database (cleanup of the database is disabled because I want to be able to search for older entries). I think that it should be possible to add a limit to the number of entries to query. I'm afraid it can be confusing. IMO it should be a setting defined by the administrator as an environment variable.

Seele0oO commented 1 year ago

yes,I think it should be set as a environment variable,And the default variable should be 10k or less. And this option will affect the system performance, which should be decided by the administrator rather than the user.

I'm glad to have someone with the same needs as me. I can't modify this project at present. It's too big for me. I adopted an alternative solution. I started two minilux instances and postgres instances at the same time, and used minilux api and some simple python programs to synchronize the subscription source I used for reading to the archive instance.