search

vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
243 stars 93 forks source link

Memory leak reduction #62

Closed erandelax closed 6 years ago

erandelax commented 6 years ago

Freeing unnecessary variables before going for subsequent pages reduces memory leak since things like previous page's html don't need to wait until all subpages are surfed. Example chart: before.log, after.log.

26

vezaynk commented 6 years ago

Very nice catch! Sorry for the long delay, I will review and test this in the coming days.