Lake Macquarie City Council

mlandauer commented 9 months ago

This issue has been automatically created by PlanningAlerts. Only close this issue once the authority is working again on PlanningAlerts.

katska commented 7 months ago

scraper error as follows: lake_macquarie: ERROR: 403 => Net::HTTPForbidden for https://property.lakemac.com.au/ePathway/Production/Web/GeneralEnquiry/EnquiryLists.aspx?ModuleCode=LAP -- unhandled response

heading to their website, that links is available from a browser, as are the following links. @mlandauer the 403 suggests they're restricting access on purpose. I'm marking it blocked by authority but I don't know if it warrants the label 'anti-scraping technology' as well.

https://property.lakemac.com.au/ePathway/Production/Web/GeneralEnquiry/EnquirySummaryView.aspx https://property.lakemac.com.au/ePathway/Production/Web/GeneralEnquiry/EnquiryDetailView.aspx?Id=1750004

I also note as an aside that there are some further licensing notes on the enquiry lists page: _Getting Started

To access this website, you must click/press the Next button below, which confirms that you agree to the following terms and conditions: Copyright

The content of this website (which includes downloadable material) is subject to copyright and protected in Australia by law, and by international agreements in other countries. Laws

The laws of the State of New South Wales, Australia, and the Commonwealth of Australia, govern all matters relating to this service. Liability

To the maximum extent permitted by law, you agree to indemnify Lake Macquarie City Council for any loss, costs, or damages, arising from or relating in any way, to your use, reliance, or acceptance of information or other content on this website.

Whilst Council has made every effort to keep the contents of this website up to date, persons relying on this information, should confirm it by contacting Council to obtain a written response. Licence

Lake Macquarie City Council grants you a non-exclusive licence to reproduce the contents of this website in your web browser (and in any cache file produced by your web browser) for the sole purpose of viewing the content. Council reserves all other rights. Local Government Act

By accessing this information, I request to do so under Government Information (Public Access) Act 2009, and I understand that Council is making the information available under the provisions of Government Information (Public Access) Act 2009._

katska commented 7 months ago

@mlandauer based on what I found so far do you think I should try writing to them or is there a workaround to this first?

mlandauer commented 6 months ago

This is another one where they've put cloudflare in front of it. This is spectacularly boring.

mlandauer commented 6 months ago

By looking at https://securitytrails.com/domain/property.lakemac.com.au/history/a I can see that before they put cloudflare in front of the site DNS pointed at 103.148.240.5. I was hoping that firstly this is still the origin server and secondly that it still accepts requests from clients other than cloudflare. On an initial check this appears not to be the case.