issues
search
atomicptr
/
crab
🦀 A versatile tool to crawl dozens of URLs from a given source, like a sitemap or an URL list.
MIT License
20
stars
6
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Package for Nix
#12
atomicptr
closed
2 months ago
0
feat: Printing the url list to txt file with `output-file`
#11
atomicptr
closed
4 months ago
0
feat: Printing the url list to txt file with `output-file`
#10
ramazansancar
closed
4 months ago
10
Consider re-adding snap support
#9
atomicptr
opened
1 year ago
3
Update go version to 1.19, move to github actions
#8
atomicptr
closed
1 year ago
1
sitemap request doesn't use --header flag
#7
Smadarl
closed
1 year ago
1
Add ability to stress test websites
#6
atomicptr
opened
4 years ago
0
Add tool to convert a sitemap into an URL list
#5
atomicptr
closed
4 years ago
0
Add ability to persist logs into a file instead of logging them
#4
atomicptr
closed
4 months ago
1
Add ability to filter crawl logs
#3
atomicptr
closed
4 years ago
1
Add support for Chocolatey or Scoop (Windows)
#2
atomicptr
closed
4 years ago
0
Add support for Homebrew (macOS)
#1
atomicptr
closed
4 years ago
0