ArchiveTeam / urls-grab

Archiving URLs (outlinks) from a variety of sources.
The Unlicense
15 stars 5 forks source link

Support periodically crawling RSS feeds #9

Closed Arkiver2 closed 3 years ago

Arkiver2 commented 3 years ago

Support for this is now in with custom: item support in commit https://github.com/ArchiveTeam/urls-grab/commit/1abe25f631d4c3debf42d9cd586899f9d487e905, lists for URLs to be periodically crawled will be created with issue https://github.com/ArchiveTeam/urls-sources/issues/2.