issues
search
rivermont
/
spidy
The simple, easy to use command line web crawler.
GNU General Public License v3.0
334
stars
69
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Can't get Spidy to run on Fedora
#92
kz650rider
opened
3 weeks ago
0
Optimizations, bug fixes, command line arguments, out of scope paths and domaisn, and headless browser support
#91
lkotlus
opened
1 month ago
0
Fix/docker
#90
pbnj
opened
10 months ago
0
Update for Python 3.9+, deprecate Reppy dependency
#89
rivermont
opened
1 year ago
2
better code style
#88
Motzumoto
closed
2 years ago
0
THREAD_COUNT is repeated twice
#86
namelessperson0
closed
2 years ago
1
Fixing syntax issue
#85
namelessperson0
closed
2 years ago
0
Getting indent error when running on fresh install.
#84
namelessperson0
closed
2 years ago
2
bring dev up to master
#82
rivermont
closed
3 years ago
0
unusable
#81
T35R6braPwgDJKq
closed
1 year ago
2
GitHub Release last in 2017?
#80
jzabroski
closed
3 years ago
2
Cookie handling
#79
n0kovo
opened
3 years ago
1
Always download from wikipedia
#78
Jerry4013
closed
3 years ago
1
Fix relative paths
#77
lukavia
closed
3 years ago
3
Fixes crawling of relative url #73 and optimizes the process.
#76
lukavia
closed
3 years ago
0
Failed crawl for http://www.frankshospitalworkshop.com/
#75
brainstorm
closed
2 years ago
2
Fix Autosave errors
#74
Hrily
closed
3 years ago
0
Fail crawling relative url and protocol
#73
iboutillier
closed
3 years ago
1
Docker is unusable
#72
Enelar
opened
5 years ago
7
Updated robots.txt URL formatter
#71
dstjacques
closed
3 years ago
2
Fails to crawl certain sites
#70
PtrMan
closed
3 years ago
4
Merge dev into master
#69
rivermont
closed
6 years ago
0
tiny typo fixes
#68
mdaizovi
closed
6 years ago
0
2 typos in spidy/spidy/docs/CONTRIBUTING.md
#67
mdaizovi
closed
6 years ago
0
Update README.md
#66
iamvibhorsingh
closed
6 years ago
0
Fix typo
#65
enzosk8
closed
6 years ago
0
Write comparison of spidy and similar projects
#64
rivermont
closed
6 years ago
1
Robots file reader repaired
#63
stevelle
closed
6 years ago
1
Save robots.txt results
#62
rivermont
closed
6 years ago
1
Add shebangs, add missing "(y/n")
#61
syre
closed
6 years ago
0
Transitioned general and error logs to logging FileHandler
#60
kylesalk
closed
6 years ago
0
Platform Support
#59
rivermont
closed
6 years ago
0
Tests for multithreading
#58
rivermont
opened
6 years ago
0
No error raised for incorrect input
#57
rivermont
closed
3 years ago
4
Autosave triggered by single thread and not global.
#56
rivermont
opened
6 years ago
2
Fix Issue #54 and various other fixes
#55
Hrily
closed
6 years ago
0
String Index Error on perfectly normal URLs
#54
rivermont
closed
6 years ago
1
Updated Makefile.
#53
rivermont
closed
6 years ago
0
Merge dev into master.
#52
rivermont
closed
6 years ago
0
PR for Issue #29
#51
Hrily
closed
6 years ago
0
Add/docker
#50
pbnj
closed
6 years ago
2
Use HTTP headers in HEAD Request
#49
AwesomeMarioFan
closed
6 years ago
0
HEAD Request uses default Requests headers
#48
rivermont
closed
6 years ago
6
Create Windows Executable
#47
rivermont
opened
6 years ago
4
Command line arguments
#46
rivermont
opened
6 years ago
5
Updated config file error messages and init failure logic
#45
dstjacques
closed
6 years ago
1
Fixed README links
#44
psidex
closed
6 years ago
0
PyPI Description Formatting
#43
rivermont
opened
6 years ago
1
Issue #36 spidy Logo Design
#42
Cutwell
closed
6 years ago
2
Merge pypi-dev into master
#41
rivermont
closed
6 years ago
0
Next