adrianshort / uk_planning_scraper

A Ruby gem to get planning applications data from UK council websites.
GNU Lesser General Public License v3.0
27 stars 19 forks source link

Catch duplicate authorities in authorities.csv #25

Open adrianshort opened 5 years ago

adrianshort commented 5 years ago

Tests should fail if there is a duplicate authority name.

Not sure about duplicate authority URLs. Do any authorities share the same planning website?

adrianshort commented 5 years ago

96ac906d57605c7f979e552d622f58ac61a5a469

dhilton commented 5 years ago

South hams and West devon is the only one I've found: http://apps.southhams.gov.uk/PlanningSearchMVC/

dhilton commented 5 years ago

With the local authorities it would be useful to reuse the UK Registers ID for the authority as a unique ID as you can then relate that to a url / boundary ish. The fun bit as mentioned elsewhere are the National parks and the other odd Planning authorities. Yet the Local Authorities covers the majority I would guess.