search

switchonproject / sip-html5

SIP Catalogue Access GUI HTML5 Application
http://switchonproject.github.io/sip-html5/
GNU Lesser General Public License v3.0
3 stars 0 forks source link

metadata misleading for selected data sets #101

Closed rcapell closed 8 years ago

rcapell commented 9 years ago

@duropa

In the public sip there are data sets, with Duro as contact person, which are derived from GRDC data, but contain some extracted data only (e.g. flood peaks). In the Description field, they are described as GRDC data, which is wrong, for instance:

Details of "AARUP (6934050)" Description: GRDC Station AARUP (6934050) at river AARUP in country DK covering 105km² catchment area.

Instead, description could read like: Monthly peak flows at GRDC station..., Open Data produced in the context of the SWITCH-ON (Sharing Water-related Information to Tackle Changes in the Hydrosphere - for Operational Needs) EU FP7 project. This project has received funding from the European Union's Seventh Programme for research, technological development and demonstration under grant agreement No 603587.

License should be "Creative Commons Attribution-ShareAlike 4.0 International"

We do not understand what "Access conditions" are in this context.

Meta-data documents are not readable, is this for machine to machine communication? Is this something which just we do not understand/use, but obvious for others? If not, please insert an explanation.

Berit, René

duropa commented 9 years ago

dear berit and rene..

sorry, i do not know the format, and i'm also not familiar with the the content...

  the data were imported by pascal or gerben...we provided it as a show case...to illustrate what type of data we will have as results of our experiment...

  i believe they are preparing some wizard for importing such data to sip....

so we are waiting for that (e.g. for adding some new results we have with yeshewa)...

  cheers

d.

 

  -----Original message----- From:rcapell notifications@github.com Sent:Tue 30-06-2015 18:44 Subject:[sip-html5] metadata misleading for selected data sets (#101) To:switchonproject/sip-html5 sip-html5@noreply.github.com; CC:Juraj Parajka parajka@hydro.tuwien.ac.at;

@duropa

In the public sip there are data sets, with Duro as contact person, which are derived from GRDC data, but contain some extracted data only (e.g. flood peaks). In the Description field, they are described as GRDC data, which is wrong, for instance:

Details of "AARUP (6934050)" Description: GRDC Station AARUP (6934050) at river AARUP in country DK covering 105km² catchment area.

Instead, description could read like: Monthly peak flows at GRDC station..., Open Data produced in the context of the SWITCH-ON (Sharing Water-related Information to Tackle Changes in the Hydrosphere - for Operational Needs) EU FP7 project. This project has received funding from the European Union's Seventh Programme for research, technological development and demonstration under grant agreement No 603587.

License should be "Creative Commons Attribution-ShareAlike 4.0 International"

We do not understand what "Access conditions" are in this context.

Meta-data documents are not readable, is this for machine to machine communication? Is this something which just we do not understand/use, but obvious for others? If not, please insert an explanation.

Berit, René

— Reply to this email directly or view it on GitHub.

 

p-a-s-c-a-l commented 9 years ago

@duropa No, there will no automated wizard for importing such data since developing such a generic tool that can import any data format in the the correct SIP Meta-Data format is simply not possible. If you need to import further datasets, please contact me and I'll develop the respective import tool.

@rcapell OK. I'll change the description and the license. Regarding the meta-data documents, this is a well-known standardized machine readable format (JSON and ISO19115 XML) of the meta-data and a very common feature of data catalogues (download the meta-data for further processing).

duropa commented 9 years ago

dear pascal, we have some new results to our experiment (i'm enclosing an example). we have such text files for more than 700 grdc stations. i do not know the best way to import and store it in sip and also how to make it clear that these are results of our experiment... please give some advice...

cheers d.

At 07:21 1.7.2015, you wrote:

https://github.com/duropa@duropa No, there will no automated wizard importing such data since developing such a generic tool that can import any data format in the the correct SIP. Meta-Data format is simply not possible. Id you need to import further dataset, please contact me and I'll develop the respective import tool.

https://github.com/rcapell@rcapell OK. I'll change the description and the license. Regarding the meta-data documents, this is a well-known standardized machine readable format (JSON and ISO19115 XML) of the meta-data and a very common feature of data catalogues (download the meta-data for further processing).

­ Reply to this email directly or https://github.com/switchonproject/sip-html5/issues/101#issuecomment-117438350view it on GitHub.

Assoc. Prof. Juraj Parajka Institute of Hydraulic Engineering and Water Resources Management Vienna University of Technology Karlsplatz 13/222, A-1040 Vienna, Austria www.hydro.tuwien.ac.at

start end tmax start_sm tmax_sm prec rainfall snowfall evap SW deficit SM as % pore Snow WEQ Smelt API(1) API(3) API(5) API(7) API(10) 1980-01-22 1980-01-26 1980-01-24 1980-01-22 1980-01-26 17.90 5.53 12.37 2.93 0.09 0.78 88.96 18.40 0.73 2.58 7.11 17.94 19.42 1980-01-31 1980-02-02 1980-02-01 1980-02-00 1980-02-02 9.36 4.93 4.43 1.68 1.03 0.79 82.42 3.00 0.04 0.04 0.05 2.36 7.88 1980-02-06 1980-02-08 1980-02-06 1980-02-04 1980-02-06 7.31 2.24 5.08 2.50 2.20 0.79 88.89 7.79 2.70 5.87 9.28 9.28 9.59 1980-03-13 1980-03-29 1980-03-23 1980-03-11 1980-03-15 76.36 49.02 27.34 4.50 8.31 0.73 94.11 2.33 0.00 1.53 5.48 5.84 5.84 1980-05-05 1980-05-20 1980-05-16 1980-05-02 1980-05-15 67.26 62.88 4.38 35.27 18.92 0.74 104.14 20.47 0.09 1.08 2.61 2.85 3.02 1980-05-24 1980-06-02 1980-05-30 1980-05-22 1980-05-30 61.95 60.61 1.34 30.73 11.60 0.80 82.22 10.48 3.31 8.24 13.08 17.38 25.50 1980-06-09 1980-06-18 1980-06-10 1980-06-07 1980-06-10 68.12 67.86 0.26 14.03 14.24 0.78 57.49 4.43 0.40 1.56 1.63 2.46 13.04 1980-07-09 1980-07-12 1980-07-10 1980-07-06 1980-07-09 37.25 37.00 0.25 10.03 19.56 0.74 23.92 1.83 0.11 0.14 1.84 2.35 4.52 1980-08-16 1980-08-20 1980-08-17 1980-08-15 1980-08-16 33.22 33.22 0.00 3.12 27.47 0.69 0.07 0.03 0.00 1.97 3.11 5.96 6.47 1980-08-28 1980-09-01 1980-08-29 1980-08-25 1980-08-28 38.54 38.50 0.03 7.95 24.41 0.69 0.00 0.03 0.01 0.01 0.23 5.31 18.14 1980-10-15 1980-10-21 1980-10-17 1980-10-15 1980-10-18 90.12 87.06 3.06 5.37 17.08 0.72 5.05 3.32 0.00 2.00 15.57 17.68 18.73 1980-10-25 1980-10-26 1980-10-25 1980-10-24 1980-10-26 36.49 30.38 6.11 3.36 7.36 0.79 6.83 2.72 0.81 0.81 1.93 31.78 44.16 1980-11-27 1980-11-29 1980-11-28 1980-11-26 1980-11-28 12.49 10.40 2.09 1.15 5.50 0.75 10.98 0.77 0.02 0.02 0.02 0.02 0.74 1981-03-30 1981-04-06 1981-04-02 1981-03-28 1981-04-02 154.31 138.19 16.12 11.51 18.12 0.74 41.76 5.23 0.00 2.95 4.22 5.57 6.38 1981-04-26 1981-04-29 1981-04-28 1981-04-23 1981-04-27 35.39 26.53 8.86 10.18 13.69 0.75 42.02 1.05 0.04 9.86 11.86 13.18 13.18 1981-05-03 1981-05-05 1981-05-04 1981-05-02 1981-05-04 21.07 18.39 2.68 6.77 12.49 0.76 45.31 0.30 0.00 0.00 2.04 12.93 17.71 1981-05-11 1981-05-16 1981-05-12 1981-05-09 1981-05-12 52.29 49.21 3.08 10.76 14.17 0.76 42.83 2.12 1.36 1.36 3.64 13.00 13.00 1981-05-25 1981-06-04 1981-05-27 1981-05-24 1981-05-27 61.53 57.30 4.23 11.72 13.83 0.78 31.78 1.31 0.06 9.52 9.54 12.33 16.96 1981-06-28 1981-07-06 1981-06-29 1981-06-26 1981-06-29 47.51 47.38 0.13 15.51 15.89 0.75 10.67 1.18 8.51 13.52 17.94 19.82 20.05 1981-07-18 1981-07-21 1981-07-19 1981-07-17 1981-07-19 54.72 54.29 0.44 9.12 19.93 0.74 1.11 0.30 0.17 1.18 4.65 14.60 23.62 1981-07-24 1981-07-26 1981-07-24 1981-07-22 1981-07-24 31.63 31.52 0.11 10.13 14.37 0.77 0.52 0.26 0.01 4.05 36.15 36.25 38.90 1981-08-11 1981-08-13 1981-08-11 1981-08-10 1981-08-12 16.65 16.64 0.01 8.84 22.28 0.71 0.00 0.01 3.37 11.03 15.94 16.22 16.53 1981-09-03 1981-09-08 1981-09-05 1981-09-00 1981-09-04 76.96 76.88 0.08 11.22 25.03 0.68 0.00 0.08 2.62 3.97 3.97 4.00 4.92 1981-09-10 1981-09-13 1981-09-11 1981-09-09 1981-09-10 30.31 30.31 0.00 5.38 12.11 0.75 0.00 0.00 0.14 0.16 6.17 38.99 41.86 1981-09-23 1981-10-04 1981-09-29 1981-09-21 1981-09-29 110.79 110.46 0.33 23.03 14.24 0.76 0.00 0.23 2.09 10.20 10.28 10.72 18.49 1981-10-27 1981-10-28 1981-10-27 1981-10-25 1981-10-27 61.08 41.07 20.00 1.75 14.65 0.74 1.24 1.31 0.00 0.82 8.46 9.06 9.57 1981-12-29 1982-01-08 1981-12-31 1981-12-29 1982-01-02 35.93 18.16 17.77 2.10 1.25 0.76 86.99 27.81 4.71 7.40 8.95 13.91 21.38 1982-02-15 1982-02-23 1982-02-18 1982-02-15 1982-02-18 36.37 28.86 7.51 2.48 6.02 0.72 87.40 4.54 1.31 1.38 1.38 1.38 1.38 1982-05-05 1982-05-16 1982-05-06 1982-05-07 1982-05-09 11.93 11.08 0.85 7.10 11.02 0.77 94.93 1.48 8.03 29.85 29.89 30.20 30.28 1982-06-11 1982-06-15 1982-06-13 1982-06-09 1982-06-13 33.38 33.25 0.12 15.40 21.34 0.74 19.39 3.44 3.60 5.28 7.61 9.49 11.39 1982-07-23 1982-08-10 1982-08-04 1982-07-24 1982-08-07 116.33 116.29 0.04 57.89 17.01 0.73 0.00 0.04 1.60 3.84 7.16 11.08 12.33 1982-08-27 1982-09-14 1982-09-08 1982-08-25 1982-09-08 88.99 88.87 0.13 37.31 25.65 0.69 0.00 0.13 3.84 3.86 7.00 7.40 11.48 1982-09-27 1982-10-03 1982-09-27 1982-10-00 1982-10-02 16.94 16.87 0.07 5.76 14.62 0.75 0.01 0.08 0.01 4.14 22.11 22.90 26.79 1982-10-05 1982-10-10 1982-10-06 1982-10-04 1982-10-07 86.70 76.43 10.28 5.98 15.73 0.74 0.00 0.91 0.00 1.26 11.25 13.96 25.76 1982-10-23 1982-10-26 1982-10-24 1982-10-22 1982-10-25 57.57 55.84 1.73 5.65 0.61 0.84 5.19 1.29 0.00 4.33 20.20 21.26 28.13 1982-11-09 1982-11-16 1982-11-13 1982-11-07 1982-11-10 69.20 57.78 11.42 2.82 6.88 0.76 4.79 4.93 0.30 0.30 0.30 0.30 0.30 1982-11-27 1982-12-04 1982-11-28 1982-11-25 1982-11-28 56.34 47.79 8.55 2.85 1.33 0.80 12.07 1.95 3.37 4.63 4.63 4.75 8.17 1983-03-01 1983-03-22 1983-03-17 1983-02-27 1983-03-17 70.02 51.35 18.67 18.34 5.38 0.73 66.42 14.39 6.07 7.03 7.12 7.12 7.12 1983-03-25 1983-03-26 1983-03-25 1983-03-24 1983-03-26 21.63 15.97 5.66 3.45 5.67 0.77 66.34 1.45 0.00 0.10 0.10 0.40 24.98 1983-03-28 1983-04-04 1983-03-29 1983-03-27 1983-03-30 35.06 26.49 8.57 5.17 3.28 0.78 70.82 2.39 0.62 17.15 17.22 17.22 17.44 1983-04-22 1983-05-12 1983-04-27 1983-04-20 1983-04-27 81.72 73.21 8.51 22.02 7.73 0.80 82.31 8.42 7.60 16.45 16.45 16.50 19.43 1983-05-15 1983-05-26 1983-05-17 1983-05-20 1983-05-23 60.77 56.68 4.09 13.08 9.43 0.83 60.33 2.05 2.01 7.61 45.65 54.63 58.52 1983-06-19 1983-06-20 1983-06-20 1983-06-17 1983-06-19 40.76 39.15 1.61 7.74 20.41 0.72 26.13 0.85 0.00 0.03 6.18 6.93 7.56 1983-08-24 1983-09-06 1983-08-27 1983-08-21 1983-08-26 37.12 37.12 0.00 17.75 25.41 0.69 0.00 0.00 1.85 3.27 11.33 11.77 15.63 1983-09-11 1983-09-18 1983-09-12 1983-09-15 1983-09-17 17.21 16.96 0.26 3.61 25.36 0.71 0.00 0.09 0.00 0.23 12.22 13.79 13.81 1983-12-17 1983-12-27 1983-12-21 1983-12-16 1983-12-22 99.69 53.62 46.07 1.84 22.20 0.66 28.02 25.85 0.36 0.92 1.37 1.95 1.95 1984-03-25 1984-04-06 1984-03-30 1984-03-28 1984-04-03 73.41 51.67 21.74 10.27 8.06 0.75 108.92 3.00 0.23 13.95 16.44 17.01 18.53 1984-05-03 1984-05-29 1984-05-21 1984-05-02 1984-05-22 240.01 221.22 18.79 63.75 13.80 0.75 100.18 24.38 0.00 5.71 5.71 7.29 7.29 1984-06-04 1984-06-07 1984-06-05 1984-06-02 1984-06-05 49.45 47.26 2.18 12.79 8.15 0.82 82.95 3.33 0.00 0.67 4.59 18.72 25.02 1984-08-09 1984-08-18 1984-08-10 1984-08-06 1984-08-09 53.26 53.24 0.02 10.02 26.62 0.69 0.00 0.02 2.93 3.30 7.50 7.50 7.65 1984-09-05 1984-09-11 1984-09-07 1984-09-02 1984-09-06 27.30 26.98 0.32 10.42 19.70 0.72 0.00 0.03 0.00 0.15 5.01 7.80 19.59 1984-09-15 1984-09-25 1984-09-20 1984-09-17 1984-09-24 53.21 52.15 1.05 17.65 18.32 0.74 0.00 0.49 2.18 19.72 19.72 20.97 20.97 1984-10-02 1984-10-09 1984-10-05 1984-10-00 1984-10-05 99.54 92.94 6.60 11.06 10.92 0.79 0.00 1.40 2.24 3.71 4.76 10.25 12.92 1984-11-15 1984-11-19 1984-11-17 1984-11-13 1984-11-17 42.41 31.68 10.73 3.05 5.34 0.75 0.35 0.53 0.04 0.04 0.60 13.76 14.81 1984-12-01 1984-12-06 1984-12-02 1984-12-01 1984-12-04 38.90 32.43 6.47 2.19 0.87 0.78 9.83 3.20 0.36 0.36 5.97 6.03 6.78 1985-01-19 1985-01-27 1985-01-23 1985-01-19 1985-01-25 24.94 10.06 14.87 2.15 0.39 0.74 79.33 16.45 2.26 23.11 38.77 41.55 41.62 1985-02-03 1985-02-13 1985-02-10 1985-02-00 1985-02-04 0.03 0.00 0.03 3.27 0.55 0.78 80.31 16.76 0.01 0.33 8.16 9.38 17.62 1985-03-01 1985-03-11 1985-03-08 1985-02-26 1985-03-07 117.77 86.31 31.46 9.79 3.88 0.75 69.77 7.14 0.00 0.00 0.00 0.02 2.14 1985-05-06 1985-05-22 1985-05-14 1985-05-04 1985-05-14 169.19 143.37 25.83 28.11 16.67 0.74 79.60 10.27 0.02 0.43 0.52 1.65 3.77 1985-06-07 1985-06-08 1985-06-08 1985-06-06 1985-06-08 10.86 10.80 0.07 10.58 14.70 0.79 32.23 2.92 3.84 9.97 20.58 22.77 27.01

p-a-s-c-a-l commented 9 years ago

@duropa

1) The files have to be put online, e.g. uploaded to the SWITCH-ON SVN Repository. The file names have to include the GRDC Station id!

2) I need the meta-data of the files, e.g. a description like "Monthly peak flows at GRDC station..., ", some X-CUAHSI keywords, etc. If you have an excel sheet (like the one you sent me for the 1st import) that would be good, otherwise I have to "invent" some meta-data by myself.

p-a-s-c-a-l commented 9 years ago

waiting for https://github.com/switchonproject/sip-html5/issues/103