search

planningalerts-scrapers / issues

Only for keeping track of all issues related to scraping
0 stars 0 forks source link

City of Stirling #914

Closed mlandauer closed 5 months ago

mlandauer commented 7 months ago

This issue has been automatically created by PlanningAlerts. Only close this issue once the authority is working again on PlanningAlerts.

katska commented 6 months ago

scraper failed with error: stirling: ERROR: Couldn't find table /app/lib/technology_one_scraper/page/index.rb:23:in `scrape'

katska commented 6 months ago

However.... I could still get to it on github

so it looks potentially simple:

Looks like if we replace https://onlineservices.stirling.wa.gov.au/eProperty/ with https://stirling-web.t1cloud.com/T1PRDefault/WebApps/eProperty in line 127 of the technology one scraper authorities file, this gets us scraping their new location

Current URLs on the site: https://stirling-web.t1cloud.com/T1PRDefault/WebApps/eProperty/P1/eTrack/eTrackApplicationSearchResults.aspx?Field=S&Period=LW&f=%24P1.ETR.SEARCH.SLW https://stirling-web.t1cloud.com/T1PRDefault/WebApps/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=COP24%2f1284

Whereas we’re linking in “Read more information” to this location https://onlineservices.stirling.wa.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?ApplicationId=DA24%2F0161&f=%24P1.ETR.APPDET.VIW&r=P1.WEBGUEST

And if I bring those two elements together this does reach a live result in the browser https://stirling-web.t1cloud.com/T1PRDefault/WebApps/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?ApplicationId=DA24%2F0161&f=%24P1.ETR.APPDET.VIW&r=P1.WEBGUEST

I note I was unable to get to the scraper via the link provided on the morph.io page.

katska commented 5 months ago

someone just wrote in to ask about this one.