issues
search
vezaynk
/
Sitemap-Generator-Crawler
PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
241
stars
92
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Prevented `which xmllint` on Windows
#51
miguelantoniosantos
closed
6 years ago
9
Why not a plugin?
#50
rsm23
closed
6 years ago
4
Bug #48
#49
ghost
closed
7 years ago
0
Dropping pound
#48
ghost
closed
7 years ago
9
Canonical URL
#47
ghost
opened
7 years ago
0
HTML base element
#46
Thyra
opened
7 years ago
1
Add version checks between the script and config file
#45
vezaynk
closed
6 years ago
0
sitemap-config.php
#44
ghost
closed
7 years ago
0
Sitemap limits checking is missing
#43
ghost
opened
7 years ago
6
Entity escaping is missing
#42
ghost
opened
7 years ago
5
sitemap-config.php
#41
ghost
closed
7 years ago
0
Index PDFs
#40
vezaynk
closed
7 years ago
0
Follow frames
#39
Thyra
closed
7 years ago
2
Fix the double slash url
#38
mbouchard
closed
7 years ago
1
Separate config file plus a few improvements and fixes
#37
ghost
closed
7 years ago
9
Standard output
#36
ghost
opened
7 years ago
9
Double entry
#35
ghost
closed
7 years ago
2
Indefinite loop
#34
ghost
closed
7 years ago
15
Domain root links append a needless /
#33
vezaynk
closed
7 years ago
0
Fixed double slash url.
#32
mbouchard
closed
7 years ago
3
Whitelist GET arguments
#31
vezaynk
opened
7 years ago
1
Option to ignore arguments
#30
vezaynk
closed
7 years ago
0
Empty urls found and displayed
#29
vezaynk
closed
7 years ago
0
Relative URLs fix
#28
anatolinicolae
closed
7 years ago
2
Do not overwrite sitemap.xml until complete
#27
vezaynk
closed
7 years ago
4
Performance Improvements
#26
vezaynk
opened
7 years ago
4
Google Parsing error
#25
mangaflux01
closed
7 years ago
8
$max_depth is broken
#24
vezaynk
closed
7 years ago
0
Ampersand encoding fails with multiple URL parameters
#23
Scott-G
closed
7 years ago
10
Break away url reformatting into a seperate function
#22
vezaynk
closed
7 years ago
2
mailto infinite recursion
#21
zhornovy
closed
7 years ago
2
Create composer.json file
#20
fitcoins
closed
7 years ago
5
Add optional support for image indexing
#19
vezaynk
opened
7 years ago
4
Improve CLI controls
#18
vezaynk
closed
7 years ago
0
Do not index redirects
#17
vezaynk
closed
7 years ago
0
Custom logging level
#16
vezaynk
closed
7 years ago
0
Validate headers and remove extension whitelisting
#15
vezaynk
closed
7 years ago
1
Fixing regex
#14
anatolinicolae
closed
7 years ago
4
Single-quote attribute error
#13
anatolinicolae
closed
7 years ago
1
How to exclude categories in Black List
#12
nickbazie
closed
7 years ago
1
Use composer
#11
ahoiroman
closed
7 years ago
3
License-File
#10
ahoiroman
closed
7 years ago
1
Add ability to exclude
#9
ztheory
closed
7 years ago
4
Support for URL's with query_string's
#8
mrl22
closed
7 years ago
0
Write test suite
#7
vezaynk
closed
6 years ago
3
Implemented $max_depth feature to allow a maximum depth when scanning…
#6
mrl22
closed
7 years ago
0
Does not crawl all pages.
#5
aedelgod
closed
7 years ago
5
Merging from improved code-base
#4
vezaynk
closed
8 years ago
0
Last-Modified in Single Request
#3
ghost
closed
8 years ago
2
Handle headers and body in a single request
#2
vezaynk
closed
7 years ago
5
Previous
Next