vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
241 stars 92 forks source link

Does not work with Real Estate FLOWFACT Wordpress Plugin generated Object Pages #98

Open Zorast opened 2 years ago

Zorast commented 2 years ago

Hi there, thanks for your crawler! But the generated Object Pages does not show in Sitemap. When using a online sitemap service it generated this sites correctly. Thanks Zorast

Zorast commented 2 years ago

I did see that they say: [+] Sitemap has been generated in 22.84 secondsand saved to sitemap-diw.xml [+] Scanned a total of 26 pages and indexed 16 pages. [+] Operation Completed

Is there a Filter that i can disable?

vezaynk commented 2 years ago

I have no idea what flowfact is. Could you show me what it is, your website, the pages that aren't being scanned, and your configuration?

Zorast commented 2 years ago

I write u an Email :)