internetofwater / geoconnex.us

URI registry for https://geoconnex.us based URIs
Other
23 stars 14 forks source link

Update reference.geoconnex.us CI/CD to CloudSQL backend #176

Closed webb-ben closed 1 year ago

webb-ben commented 1 year ago

Update pygeoapi-ci.yml, pygeoapi.config.yml to serve geoconnex.us over GCP with Cloud SQL

dblodgett-usgs commented 1 year ago

@webb-ben where is the postgres loading code that creates the tables referenced in the configuration here?

webb-ben commented 1 year ago

@dblodgett-usgs cgs-earth/hydrodump-action@0.3.0 github action creates a .sql.gz backup of the result of posting (ogr2ogr) files from a Hydroshare resource

dblodgett-usgs commented 1 year ago

ok -- so how do we know what valid table names are? Just through knowledge of what's over there?

webb-ben commented 1 year ago

Table name is the name of the file without the filetype. This is the ogr2ogr invocation

Have only tried using GPKG so I am not quite sure how it looks for other files. I'm trying to keep the Hydrodump action as generic as possible but there is also a world where it could be passed a pygeoapi configuration file and then use the provider information to inform the table name. Could even get the source file to download from the resource links section which could be anywhere...

ksonda commented 1 year ago

That's not a bad idea, then people only need to edit the config file

ksonda commented 1 year ago

I wonder why the checks are failing

ksonda commented 1 year ago

I think for the sake of our CI/CD we should merrge this now. However, I take @dblodgett-usgs point that we need a registry for where source files live and what the table name in postgis is. I also take @webb-ben point that we either need to clean up the hydroshare resource or implement a system where reference features source files can live at any URL, which can exist in the aforementioned registry or be part of pygeoapi config.yml TBD. I will an open an issue to address this.