issues
search
ArchiveTeam
/
urls-grab
Archiving URLs (outlinks) from a variety of sources.
The Unlicense
15
stars
5
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Extra docker container params
#14
imerr
closed
1 year ago
0
TikTok's webpages takes forever and end up failing the whole task
#13
CreaZyp154
closed
1 year ago
4
Urlteam workers crash after this url format with error 124 "20=301 https://vt.tiktok.com/ZSeTTFu3m/"
#12
kotenok2000
closed
2 years ago
1
Problem with an item
#11
kotenok2000
closed
2 years ago
2
Revive NewsGrabber
#10
Arkiver2
closed
2 years ago
2
Support periodically crawling RSS feeds
#9
Arkiver2
closed
3 years ago
1
Add https://fundraise.cancerresearchuk.org/ so we stop ddosing them
#8
ttq-ak
closed
3 years ago
1
Get all outlinks for URLs from certain domains.
#7
Arkiver2
closed
3 years ago
1
Optionally use hash for deduplication with the Wayback Machine
#6
Arkiver2
opened
3 years ago
0
Deduplicate files over certain size with the Wayback Machine
#5
Arkiver2
opened
3 years ago
1
Allow URL to be requeued
#4
Arkiver2
closed
3 years ago
1
Use wget-at installed in /usr/local/bin as well
#3
DaxServer
closed
3 years ago
1
report_bad_urls on Instagram login page
#2
OrIdow6
closed
3 years ago
0
Add more params to strip
#1
OrIdow6
closed
3 years ago
2