search

KitWallace / planningapplications

Stuff for analysing BCC planning applications
0 stars 0 forks source link

Scrape weekly lists #12

Open KitWallace opened 6 years ago

KitWallace commented 6 years ago

So that all relevant Planning applications can be included automatically - will alos help with problem of locating applications

KitWallace commented 6 years ago

can get weekly and monthly lists - urls not persistant and pages not valid xml so cant save and load -

see problem with automating the search.

KitWallace commented 6 years ago

the scrapper I wrote earlier for Mark also has a problem with malformed XHTML - not sure how to get round it - there must be a way since httpclient:get can do it. Could put the document directly into my server with filezilla but clumsy

KitWallace commented 6 years ago

leave this to humans ie Richard Buist