search

aodn / content

Tracks AODN Portal content and configuration issues
0 stars 0 forks source link

CSV download thingey is empty in Step 3 for SOOP ASF - Met & SST layer (123) #29

Closed atkinsn closed 10 years ago

atkinsn commented 10 years ago

After filtering the SOOP ASF Met & SST layer by both ship and geographical extent, and being notified that the estimated NetCDF size was 9.9MB, I was surprised to see that my CSV download was empty.

Filters: Filter applied: INTERSECTS(geom,POLYGON((98.8330078125 -27.9501953125,98.8330078125 -21.9736328125,104.8974609375 -21.9736328125,104.8974609375 -27.9501953125,98.8330078125 -27.9501953125))) AND platform_code LIKE 'VLHJ' AND vessel_name LIKE 'Southern Surveyor'

atkinsn commented 10 years ago

This may be happening as I had selected Southern Surveyor in both filter options: platform code and vessel name.

smancini commented 10 years ago

The column "platform_code" is missing from the WFS table. @lbesnard Can you fix the two SOOP ASF talend harvesters?

lbesnard commented 10 years ago

@smancini done ! I put a PR https://github.com/aodn/harvesters/pull/81 https://github.com/aodn/harvesters/pull/80

ggalibert commented 10 years ago

Merged.

lbesnard commented 10 years ago

@dnahodil It seems like there is still an issue because of missing metadata information. see https://imos.aodn.org.au/imos123/download?url=http%3A%2F%2Fgeoserver-123.aodn.org.au%2Fgeoserver%2Fows%3FtypeName%3Dsoop_asf_mt_trajectory_data%26SERVICE%3DWFS%26outputFormat%3Dcsv-with-metadata-header%26REQUEST%3DGetFeature%26VERSION%3D1.0.0%26CQL_FILTER%3DINTERSECTS(geom%252CPOLYGON((132.5390625%2520-48.12109375%252C132.5390625%2520-43.7265625%252C146.42578125%2520-43.7265625%252C146.42578125%2520-48.12109375%252C132.5390625%2520-48.12109375)))&downloadFilename=IMOS_-_SOOP-Air_Sea_Flux_(ASF)_sub-facility_-_Meteorological_and_SST_Observations.csv

doesn't work. BUT This works

https://imos.aodn.org.au/imos123/download?url=http%3A%2F%2Fgeoserver-123.aodn.org.au%2Fgeoserver%2Fows%3FtypeName%3Dsoop_asf_mt_trajectory_data%26SERVICE%3DWFS%26outputFormat%3Dcsv%26REQUEST%3DGetFeature%26VERSION%3D1.0.0%26CQL_FILTER%3DINTERSECTS(geom%252CPOLYGON((132.5390625%2520-48.12109375%252C132.5390625%2520-43.7265625%252C146.42578125%2520-43.7265625%252C146.42578125%2520-48.12109375%252C132.5390625%2520-48.12109375)))&downloadFilename=IMOS_-_SOOP-Air_Sea_Flux_(ASF)_sub-facility_-_Meteorological_and_SST_Observations.csv

dnahodil commented 10 years ago

We had a bit of a look at this on Thursday afternoon and Friday. It seems that the soop_asf_mt layer has problems when you try to do a CSV download. As @lbesnard notes, if you "turn off" the csv-with-metadata plugin there is no problem.

Tracking this down the problem comes from here in the csv-with-metadata plugin code. It seems the SQL select * from parameters_mapping.soop_asf_mt_metadata_summary returns null in the first row, first column. However, there is data available in the view.

@lbesnard let me know when you want to look at this and we can investigate some more.

xhoenner commented 10 years ago

@dnahodil I've fixed up the view 'parameters_mapping.soop_asf_mt_metadata_summary', see if that fixes up the issue you were having.

lbesnard commented 10 years ago

@xhoenner well now if I click on the first link above (csv-with-metadata), it seems like it works fine

dnahodil commented 10 years ago

I just tried it in the Portal and the download worked correctly. :+1:

lbesnard commented 10 years ago

solved