Getting data from Sweden automatically

[clau1313]

Hi @timlinux, @meomancer, @dimasciput, @ArnaudIGRAC

The platform from Sweden: https://www.sgu.se/grundvatten/grundvattennivaer/matstationer/ The Geological Survey of Sweden (SGU) is in charge of it. Here is some information about how to retrieve and download data from the system, but it is all in Swedish: https://www.sgu.se/produkter/geologiska-data/oppna-data/grundvatten-oppna-data/grundvattennivaer-tidsserier/ (automatic translation of the page via e.g. google translate works quite well) My contact at SGU is Bo Thunholm (Bo.Thunholm@sgu.se). He told me that the connection can be made via a system called ATOM but I don't know it...

Please let me know if you need anything else :)

[clau1313]

Hi everyone, is there any update?

[meomancer]

Child of https://github.com/kartoza/IGRAC-GGIS/issues/449

[meomancer]

NOTE for me: Data can be fetch using this: https://resource.sgu.se/oppnadata/grundvatten/api/grundvattennivaer/nivaer/lan/03?format=json but needs to use region code from table in : https://www.sgu.se/produkter/geologiska-data/oppna-data/grundvatten-oppna-data/grundvattennivaer-tidsserier/

[meomancer]

Could you help me understanding this data @clau1313 ?

{
  "omrade-_och_stationsnummer": "101_1",
  "stationens_namn": "Balsta_1",
  "startdatum_for_matning": "1998-09-29",
  "jordart": "sand",
  "akvifertyp": "berg , öppet magasin",
  "topografiskt_lage": "inströmningsområde",
  "referensniva_for_roroverkant_m_o.h.": 15.3100,
  "rorhojd_ovan_mark_m": 0.9500,
  "total_rorlangd_m": 32.0000,
  "metod_for_matning": "klucklod",
  "kommunkod": "0305",
  "stationsanmarkning": "nivån anses opåverkad",
  "Mätningar": [
    {
      "datum_for_matning": "1998-09-29",
      "grundvattenniva_cm_u._roroverkant": 1495.0000,
      "grundvattenniva_m_o.h.": 0.3600,
      "grundvattenniva_m_under_markyta": 14.0000,
      "nivaanmarkning": "ej kontrollerad"
    }
  ]
}

I don't know the meaning of the most keys on this json Already search but some can't be translated in google translate

[meomancer]

PR is here : https://github.com/kartoza/IGRAC-WellAndMonitoringDatabase/pull/90

Hi @clau1313 @ArnaudIGRAC could you confirm this is correct based on the data that returned?

stationens_namn = name
referensniva_for_roroverkant_m_o.h. = top_of_well_elevation (in meters)
rorhojd_ovan_mark_m = height_of_tube (in meters)
ground_surface_elevation = top_of_well_elevation - height_of_tube

and also what is the organisation for this one? I would like to test it on staging, what organisation is it?

[clau1313]

I don't recognize this station (101_1). We should retrieve from the swedish system the same stations that are already in the GGMN.

All wells from Sweden should be associated with the organisation: "Geological Survey of Sweden (Sweden)"

I just realised that there are some wells from Sweden that are not associated to the right organisation, for example https://ggis.un-igrac.org/groundwater/record/69/edit I saw this problem before with other wells, and I solved "by hand" (one by one, stations from Germnay and the Gambia).

If I give you a list of the stations that belong to Sweden, could you associate them to the right organisation all at once?

[meomancer]

HI @clau1313 That station 101_1 is coming from the API The name is Balsta_1 https://resource.sgu.se/oppnadata/grundvatten/api/grundvattennivaer/nivaer/lan/03?format=json So we need to just get the measurements data for the well/station that are already in our ggmn data? Is it same with Canada and Norway?

If I give you a list of the stations that belong to Sweden, could you associate them to the right organisation all at once?

Yes, please @clau1313

[clau1313]

With Canada and Norway we should get only the stations that are already in the system.

With Canada we can get all of them

Attached is the list with the stations from Sweden.

Wells Sweden.xls

[clau1313]

Hi @meomancer, is there any update?

[meomancer]

hi @clau1313 it is finished but need to test and deploy it on staging to be tested I will do it on my next igrac time

[clau1313]

hi @meomancer, thanks, please let me know how it goes

[meomancer]

Hi @clau1313 could you check the sweden? https://staging.igrac.kartoza.com/en/admin/gwml2/well/?organisation__id__exact=23

It is already pulled the latest data from https://www.sgu.se

[clau1313]

hi @meomancer I am not sure of what you want me to check via the link you copied... or do you mean the wells from Sweden in general? (so via https://staging.igrac.kartoza.com/view/ggmn)

Are all data coming from SGU or is there data coming from the old GGMN as well?

[meomancer]

hi @clau1313 yes, wrong link yes, could you check the sweden wells?

the data is coming from old ggmn as well as SGU should i do it like hydapi?

But i think the ggmn data is quite accurate (no jump data, and i check manually, it is quite accurate) meanwhile in here, the ggmn has the older data, but on SGU, some old data is not provided that why i keep the ggmn one

[clau1313]

yes, I didn't see strange jumps either. Let's then keep the older data from the GGMN.

One thing about the wells is that sometimes their graph shows in a different format. For example for this well I see the graph like this:

but if I start clicking around, I see like this:

The well is this one: https://staging.igrac.kartoza.com/groundwater/record/3172/

[meomancer]

hi @clau1313 the graph that shows different has been fixed

Could you check the sweden data?

[clau1313]

Hi @meomancer, thanks! everything looks in order.

About the decimal digits: Is it possible for the graph to show rounded off numbers here as well? (same question I just posted in the Norway thread)

Actually if this could be the default in all cases, it would be great. The raw data doesn't need to change, only the visualization.

[meomancer]

yes we can do that i will create ticket for that @clau1313

[clau1313]

ok thanks!

[meomancer]

hi @clau1313 Sweden data has been added on the production https://ggmn.un-igrac.org/

could you check it? if it is ok, could we close this ticket?

[clau1313]

It is ok! Thanks @meomancer