Data inconsistency: wrong region for multiple records

[tmfrnz]

records 245, 246, 247 should be "Taranaki" not "Waikato" I believe

https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/245 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/246 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/247

[tmfrnz]

records 131. 134 should be "Northland" not "Auckland" https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/131 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/134

[JamesGoff]

Dammit, dammit, dammit - too much tsunami and not enough geography. OK so Mangawhai was close - I thought ARC ended at the top end, my mistake. But the Taranaki ones are a bit obvious. Many many many apologies, those kind of mistakes infuriate me, so I have to take myself outside and beat myself up.

Sorry guys.

James

[tmfrnz]

@JamesGoff: to add to your infuration, unfortunately, I identified some more records apparently "tagged" with the wrong region:

114 should be Auckland not Northland https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/114 220 should be Marlborough not Canterbury https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/220 393, 116 should be Tasman not Marlborough https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/116 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/393 328 should be West Coast not Tasman https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/328 252,271 should be Canterbury not Otago https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/252 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/271 155 is technically outside of Northland https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/155 49, 53 should be Southland not Otago https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/49 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/53 310 should be Manawatu-Wanganui not Taranaki https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/310 193 should be Bay of Plenty not Waikato https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/193

Please note however: I only checked this using the current version of our tool that does not yet allow to identify overlapping records (so the above list may not include records of the same location)

I will add a more obvious and precise regional boundary layer to the basemap to facilitate using our tool for visual analysis.

[tmfrnz]

the latest version on https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/ now includes more obvious regional boundaries to easier identify the wrongly classified records

removed for now as it interfered with selecting records from the map

[JamesGoff]

Arghhhhhhhhhhhhhhhhhh – bloody student must have screwed up or something, I do not remember all of these being wrong…..

114 – OK, I’m wrong 220 – dammit again 116??? Is Marlborough, just I think, by about 50 metres – Oananga 393 – dammit, it’s Nelson City Council really, but TDC OK. 328 – Heaphy River is Tasman District, at least that is what my maps say 252, 271 - Dammit – thought Timaru was in Otago, apologies! 155 – hmmm, well not sure where it goes then? 49, 53 – Southland – dammittttttt 310 – grrrrrr 193 – screwed that one up somehow….. that was my mistake

So there are a couple I disagree about, sorry for this hassle Timo, no idea how these got mucked up.

J

[JamesGoff]

According to my web searches the West Coast/Tasman DC boundary is a tad wrong (the West Coast boundary goes just to the north of Karamea).

Also – the Oananga site is definitely in MDC even though the boundary you have here shows otherwise, just. I know someone who lives there!

J

[JamesGoff]

And now I look on the West Coast regional council website and it is like yours – ugh. This is silly, different boundaries on different websites – apologies……

J

[JamesGoff]

Oananga Bay may be in slightly the wrong place because of a simplification of the Long/Lat? Site is just to east of boundary!

J

[tmfrnz]

This should give you the latest council borders - not sure why these seem to change so much over time https://data.linz.govt.nz/layer/3347-regional-councils-clipped/

[tmfrnz]

Not sure about Oananga site 116 https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/116

Our tool plots location as returned from DB (latitude":-41.0666,"longitude":173.5806), rounding is applied only for text display.

Here a quick visualisation of location and regions outside of our tool http://geojson.io/#id=gist:anonymous/6d90d0d57e3f3c147234f9e7ae825edf&map=11/-41.0390/173.5442

[tmfrnz]

155 could be treated similar to record 418 and just give the geographic location instead, eg "Manawatawhi /Three Kings Islands"? Not my call...

[tmfrnz]

@JamesGoff btw I had to disable the additional regions layer again as it is prevents records to be selected from the map - now the map only shows the less accurate (and less visible) region boundaries that are part of ESRI's labels layer.

[JamesGoff]

Fine by me!

Sorry, can't check other stuff right now....

Will look later.

J

[JamesGoff]

Ah - what fun. Will check out Oananga later.. .

J

[tmfrnz]

Btw record 127 (with the same location as 116 = Oananga) is "correctly" classified a Tasman...

127 is actually Omokau Bay https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/127

[JamesGoff]

Dammit, looks like I'm going to use this one too.......

[tmfrnz]

@JamesGoff if you could coordinate with @Darren-Ngaru-King to make sure you are both working with the latest data

[tmfrnz]

@Darren-Ngaru-King if you you quickly want to check on the individual records you can use the interactive app and specify the record in the URL, eg for record 116 the URL will be as follows https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/record/116

[tmfrnz]

@Darren-Ngaru-King to check region by region simply use the region filter on our app (first filter on the left) https://tmfrnz.github.io/tsunami-db-zppUJsqvqRBMVvM/#!/explore?col_location_region[]=Auckland

[robbinsje]

update complete set LocationRegion='Taranaki' where [record id] in (245, 246, 247) and LocationRegion ='Waikato' update complete set LocationRegion='Northland' where [record id] in (131,134) and LocationRegion ='Auckland' update complete set LocationRegion='Auckland' where [record id] in (114) and LocationRegion ='Northland' update complete set LocationRegion='Marlborough District' where [record id] in (220) and LocationRegion ='Canterbury' update complete set LocationRegion='Tasman District' where [record id] in (393) and LocationRegion ='Marlborough District' update complete set LocationRegion='Canterbury' where [record id] in (252, 271) and LocationRegion ='Otago' Insert into locationregion values('Manawatawhi /Three Kings Islands') update complete set LocationRegion='Manawatawhi /Three Kings Islands' where [record id] in (155) and LocationRegion ='Northland' update complete set LocationRegion='Southland' where [record id] in (49,53) and LocationRegion ='Otago' update complete set LocationRegion='Manawatu-Wanganui' where [record id] in (310) and LocationRegion ='Taranaki' update complete set LocationRegion='Bay of Plenty' where [record id] in (193) and LocationRegion ='Waikato' Note: The following are not changed as there appeared to be no definite confirmation in the issue: 116, 328

Let me know if you need any of these reversed or if there is a conclusion on 116 and 328

[tmfrnz]

Thank you @robbinsje. I do not think that there is a conclusion yet for 116 and 328 however it is clear that the current region classification is onconsistent with the records' locations. So either the locations are wrong or the region but I would assume the latter. @JamesGoff @Darren-Ngaru-King could you please confirm? Again have a look here where I added the 2 markers in question as well as the latest regional council boundaries from Linz http://geojson.io/#id=gist:anonymous/80e36089a6c6e0fbd6e4bad907c4f862&map=9/-40.8055/172.8424

Linz regional councils https://data.linz.govt.nz/layer/3347-regional-councils-clipped/

[JamesGoff]

Ugh:

116 looks like Tasman (even though I don’t like it!) 328 looks like West Coast (I will wait for flak on that one when people start using the database!)

Cheers

James

[tmfrnz]

Excellent, so it looks like we have come to a conclusion then!

[robbinsje]

Done. update complete set LocationRegion='Tasman District' where [record id] in (116) and LocationRegion ='Marlborough District' update complete set LocationRegion='West Coast' where [record id] in (328) and LocationRegion ='Tasman District'

[tmfrnz]

Thank you @robbinsje, I can confirm that all changes appear to be correct in the current API request.

Only thing I noticed is a "rogue" whitespace for record 155: "Manawatawhi /Three Kings Islands" could be replaced with "Manawatawhi/Three Kings Islands"

Otherwise happy to close this issue