This addition will allow the last-modified date for XML records to be stored in the harvest database, if the WAF server is based on nginx instead of apache. When no last-modified dates are stored in the database, every XML record is always reharvested, even if it was never changed. This can get very expensive if the WAF has thousands of records.
The HTML formatting for apache and nginx directory listings are, as far as I understand, identical with each other. But in case the formatting should ever change, it might make sense to have a separate (and currently identical) parser for nginx.
This addition will allow the
last-modifieddate for XML records to be stored in the harvest database, if the WAF server is based on nginx instead of apache. When nolast-modifieddates are stored in the database, every XML record is always reharvested, even if it was never changed. This can get very expensive if the WAF has thousands of records.The HTML formatting for apache and nginx directory listings are, as far as I understand, identical with each other. But in case the formatting should ever change, it might make sense to have a separate (and currently identical) parser for nginx.