search

ArchiveTeam / urls-grab

Archiving URLs (outlinks) from a variety of sources.
The Unlicense
15 stars 5 forks source link

Allow URL to be requeued #4

Closed Arkiver2 closed 3 years ago

Arkiver2 commented 3 years ago

Currently duplicate URLs are filtered out. An URL could be requeued by appending a fragment with timestamp as <URL>#<TIMESTAMP>.

Arkiver2 commented 3 years ago

Support for this is implemented with the custom: item type at https://github.com/ArchiveTeam/urls-grab/commit/1abe25f631d4c3debf42d9cd586899f9d487e905.