search

AtlasOfLivingAustralia / spatial-service

Spatial web services and layer administration console
https://spatial.ala.org.au/ws
2 stars 11 forks source link

Spatial Ansible Update #224

Open sat01a opened 10 months ago

sat01a commented 10 months ago

Issue Raised by Vicente (@vjrj) & @djtfmartin

Slack note from Dave: I’ve had this message from Vicente We have issues with recent versions of spatial for many months. After discovering the ala-install spatial not merged branch, and merged it, the problems persist. I notice that ALA is using in production, for instance, a different up-to-date version of geoserver than the one in ala-install or previous versions of ala-install. So I can imagine that someone in ALA is maintaining your service with a different fork or a local ala-install or ... I don’t know. Can anyone comment on the state geoserver/ala-install ? Is what is in production merged into master for ala-install ? cc (https://atlaslivingaustralia.slack.com/team/UCW5JU5J8)

Note from adamcollins: (https://atlaslivingaustralia.slack.com/archives/C03EJ7ARZQW/p1686884086144969?thread_ts=1686815866.296319&cid=C03EJ7ARZQW) ansible for spatial has been broken for a while (years) ALA is managing spatial test and prod manually. e.g. dropping in a new geoserver war and plugins. Fixing ala-install for spatial is on the list of activities but not much progress has been made recently.

vjrj commented 10 months ago

If I can help here somehow...

vjrj commented 8 months ago

Any update on this?

qifeng-bai commented 8 months ago

@vjrj I think The ansible script for Spatial has been merged into master branch.

Pleas check if those vars are in your inventory:

db_remote=false pg_service=postgresql-12 pg_version=12 postgis_version=3 postgis_scripts_version=3.4

layers_db_host= layers_db_port= layers_db_name= layers_db_username= layers_db_password=

vjrj commented 7 months ago

Thanks indeed @qifeng-bai I'll test in a new server.

vjrj commented 7 months ago

Hi again. I recently set up a spatial instance using the upstream ala-install script and noticed that still there seems to be a discrepancy in the versions of GeoServer being used. According to the ala-install defaults, GeoServer version is set to 2.19.2 (source). However, I observed that the ALA production environment is currently utilizing 2.21.1.

image

This issue has tangible impacts; for instance, in our last test, we faced difficulties even creating a layer due to such discrepancies.

This variation raises a concern regarding the reproducibility of the ALA spatial service setup, especially for other LA portals looking to upgrade their spatial services. If there are any additional or alternative steps, possibly manual or undocumented, being employed to achieve the production setup, it would be immensely helpful for the community to have access to this information.

I appreciate your attention to this matter and look forward to any guidance you can provide to help ensure consistent and reproducible deployments across the LA community.

Thank you in advance.

qifeng-bai commented 7 months ago

@vjrj Ansible uses GeoServer 2.19.2 as default. It has been deployed on spatial-dev and spatial-test, the layers function works well. Spatial prod was managed manually, so the GeoServer is updated to 2.21.1.

You mentioned that the creation of layer failed may related to Postgres setup. We can have a quick check on the GeoServer to identify issue

Meanwhile, can you please check if the folder '/data/geoserver_data_dir/gwc' exists?

vjrj commented 7 months ago

Thanks for your help as usual. I was expecting the same deployment result as in ALA production. Are you expecting to upgrade or downgrade the geoserver in future updates of your spatial.

qifeng-bai commented 7 months ago

@vjrj I would say 'upgrade'. I would update ansible on Monday

vjrj commented 1 month ago

Hi @qifeng-bai. Any update on this?

ALA Prod and Testing: image ala-install test site: image

I wonder if there are other differences from a current ala-install deployed spatial server to yours.

adam-collins commented 1 month ago

Update is that ALA is running 2.25.2. Created another issue for tracking https://github.com/AtlasOfLivingAustralia/ala-install/issues/821

vjrj commented 1 month ago

I still get some 400 error trying to access to some parts of the web ui of the geoserver (with previous and new version). Any extra step we should do or should be documented? Sounds like a nginx or similar issue.

For instance when I press a tab:

image

Edit: Sounds like this.

vjrj commented 1 month ago

I solved it adding to web.xml

<context-param>
  <param-name>GEOSERVER_CSRF_WHITELIST</param-name>
  <param-value>example.org</param-value>
</context-param>

should be add this to ala-install ? I think so...

vjrj commented 1 month ago

Anyone can share with me the aloc.jar https://github.com/AtlasOfLivingAustralia/ala-install/issues/826 in other to do a PR similar to https://github.com/AtlasOfLivingAustralia/ala-install/pull/828? I only find references in the documentation.

/data/spatial-data/modelling/ did not exist in an new spatial deployment. Any files that we should also take into consideration and add them to ala-install tasks?