search

planningalerts-scrapers / issues

Only for keeping track of all issues related to scraping
0 stars 0 forks source link

Bundaberg Regional Council #911

Closed mlandauer closed 2 months ago

mlandauer commented 7 months ago

This issue has been automatically created by PlanningAlerts. Only close this issue once the authority is working again on PlanningAlerts.

katska commented 3 months ago

Scraper returns quite a long error stream, beginning

bundaberg: ERROR: Net::ReadTimeout /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:inreaduntil'

katska commented 3 months ago

Most recent DA on Planning Alerts 10 days ago, but DA URL unavailable in a browser, returning a 502

"502 ERROR The request could not be satisfied. CloudFront wasn't able to connect to the origin. We can't connect to the server for this app or website at this time. There might be too much traffic or a configuration error. Try again later, or contact the app or website owner. If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by reviewing the CloudFront documentation.

Generated by cloudfront (CloudFront) Request ID: EmGXKN_eapCDepavt0AGeX-AuahvBxpENXnuXNdpVf7xMy655ZQcKw== "

katska commented 2 months ago

If I go to the top level https://da.bundaberg.qld.gov.au/ listed (line 5 of bundaberg.yaml or https://da.bundaberg.qld.gov.au/Home/Disclaimer these are both fine in a browser.

katska commented 2 months ago

On exhibition URL is https://da.bundaberg.qld.gov.au/Application/AdvancedSearchResult?RemoveUndeterminedApplications=False&ShowOutstandingApplications=False&ShowExhibitedApplications=True&IncludeDocuments=False

katska commented 2 months ago

last DA from 15 days ago, checking website - nothing more recent, only a DA from 2022 that's on exhibition til 12/07/24 So looking good for now. Closing