issues
search
zrashwani
/
arachnid
Crawl all unique internal links found on a given website, and extract SEO related information - supports javascript based sites
MIT License
253
stars
60
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Typos
#40
spekulatius
closed
2 years ago
3
adding oxylabs sponsored logo
#39
zrashwani
closed
2 years ago
0
Pass options to chrome client
#38
flangofas
closed
2 years ago
1
PHP8 compatibility
#37
zrashwani
closed
3 years ago
0
update the readme file
#36
zrashwani
closed
4 years ago
1
Update package dependencies to support php 7.4
#35
zrashwani
closed
4 years ago
1
Fixing Breadth-First-Search crawling & some refactoring
#34
zrashwani
closed
4 years ago
0
Get anchor of link
#33
Djomobil
opened
5 years ago
1
Parent > Children > Grand Children
#32
asadrabbi
closed
5 years ago
1
filterLinks Issue
#31
asadrabbi
closed
5 years ago
1
Does not support js-rendered sites
#30
mkantautas
closed
5 years ago
2
filterLinks not work.
#29
dearste
closed
6 years ago
3
Sites like linkedin should be probably excluded
#28
mkantautas
closed
6 years ago
2
Undefined index: external_link
#27
davidpaulalbert
closed
7 years ago
4
404 error is hardcoded
#26
mkantautas
closed
7 years ago
2
Images treated as 404 - false positive
#25
mkantautas
closed
7 years ago
2
Absolute links and the actual urls in some cases is being rendered wrongly.
#24
mkantautas
opened
7 years ago
8
Adding a release
#23
thewinterwind
closed
7 years ago
6
How to find out from which url the url was crawled?
#22
mkantautas
opened
7 years ago
8
Crawler the whole site, page inside another page.
#21
pacmandv
closed
7 years ago
7
Named array keys
#20
butchewing
closed
7 years ago
2
Fix typos
#19
noplanman
closed
7 years ago
1
Abandoned?
#18
emilhauk
closed
7 years ago
7
Major refactoring and improvements
#17
zrashwani
closed
7 years ago
0
tel: links get crawled
#16
staabm
closed
7 years ago
3
Response 401 - Authentification
#15
merolhack
opened
8 years ago
0
fixed
#14
howtomakeaturn
closed
8 years ago
1
fix relative url
#13
howtomakeaturn
closed
8 years ago
1
Catchable fatal error
#12
ArYaNsH
closed
8 years ago
4
Timeout configuration for Goutte client
#11
ollietreend
closed
7 years ago
5
problems with some of my websites
#10
chiqui3d
closed
8 years ago
2
'Don't crawl external links' option
#9
ollietreend
closed
9 years ago
1
Update Goutte dependency version
#8
ollietreend
closed
9 years ago
1
Improvement suggestions
#7
wachterjohannes
opened
9 years ago
3
Moved fully qualified name to "use" declarations.
#6
onema
closed
9 years ago
1
Corrected typo, doc block and indentation.
#5
onema
closed
7 years ago
0
[Fixes #3] Update required php version to 5.4.0.
#4
onema
closed
9 years ago
1
The use of `$this` inside closures
#3
onema
closed
9 years ago
0
Update README.md
#2
msjyoo
closed
9 years ago
1
$statusCode is a string
#1
dyron
closed
10 years ago
1