search

Pandora-IsoMemo / rss-data

ETL for RSS fetched texts
0 stars 0 forks source link

Estimate Storage Requirements for News Feed Archiving #4

Open arunge opened 1 month ago

arunge commented 1 month ago

@SarahWagner Please, check the document above for a list of sources. Let me know when you can roughly estimate how much storage will be needed if we want to save news feeds daily for a year for all the sources given in the document.

In the next step we can discuss options of storage and cleaning up. Thanks! :pray:

Originally posted by @arunge in https://github.com/Pandora-IsoMemo/rss-data/issues/3#issuecomment-2429182497

SarahWagner commented 3 days ago

@arunge Based on the feeds we have we will need roughly this: