aerotoad / Thud

Simple news reader that keeps the noise low.
GNU Affero General Public License v3.0
222 stars 11 forks source link

Provide an online accessible database via IPFS #55

Open sjehuda opened 10 months ago

sjehuda commented 10 months ago

Is your feature request related to a problem? Please describe. Currently, Thud does indeed provide the functionality to select feeds from an online database.

However, I suggest to make use of that functionality in a different way, which involves a decentralized protocol.

Describe the solution you'd like Adding support for protocol IPFS and selecting feeds from a database.

Describe alternatives you've considered The current mechanism used by Thud.

Additional context I'm working on a feeds database at Slixfeed. The database is at the public domain.

The reason I suggest IPFS (or any DHT fashion technology) is because the database is expected to grow larger, so it would be wiser to share that database with peers, when the only centralized (e.g. HTTP) factor would be the IPFS hash.

The above database amount ~3K feeds, and there is another database which amounts ~3K feeds too.

We are operating an RSS crawler which amount over 500K news feeds, excluding git, subvertion and wikis. The database resulted by the crawler wasn't reviewed yet. Reviewed feeds will be added slowly to the database.

See also https://github.com/lwindolf/liferea/discussions/974#discussioncomment-8195898


Warning! (Government)

Because this database is intended to be used with my project, and because it has less than 10K entries, I don't make any selection, which means that some sources might not be appropriate (i.e. nsfw).

Personally, I might have a legal issue with that database at the moment, because I also add sources of neighbouring countries. Some of these sources appear to be censored by the ISP providers here, and this is another reason of why I have an interest of making that database available via a decentralized mean (e.g. IPFS).

Suggestion to allocate feeds via IPFS

There would be several databases allocated by language code and country code.

Unrestricted

Restricted

Unrestricted databases (those that do not have country code), like de, will either be unavailable or would be available by enabling an option.