search

bcgov / MFIN-Data-Catalogue

The Finance Data Catalogue enables users to discover data holdings at the BC Ministry of Finance and offers information and functionality that benefits consumers of data for business purposes. The product is built using Drupal and adheres to the Government of BC's Core Metadata Standard.
Other
6 stars 0 forks source link

504 time out issues on all openshift environments #374

Closed CraigClark closed 2 months ago

CraigClark commented 4 months ago

OP timer

https://openplus.monday.com/boards/4092908516/pulses/6186888544

We are experiencing 504 gateway time out issues when working with large taxonomies.

This can be seen at https://cat.data.fin.gov.bc.ca/admin/structure/taxonomy/manage/information_schedule/overview

It also happens when we try to import the taxonomy.

I'm not sure if it is relevant, but you can get to the vocabulary using the taxonomy_manager module https://cat.data.fin.gov.bc.ca/admin/structure/taxonomy_manager/voc/information_schedule

NicoledeGreef commented 4 months ago

dv14 handled the load just fine but our Openshift environments timed out after 30 seconds and manifested the Gateway error. Thankfully the loads did complete in our environments. It just took a lot longer and we had to review to ensure all the records made it.

In dev: ARCS details loads in about 6 minutes ORCS details loads in about 20 minutes

In dv14, we don’t get a Gateway timeout error. ARCS details loads in about 46 seconds ORCS details loads in about 2 minutes 29 seconds

NicoledeGreef commented 2 months ago

This has been optimized as much as possible in the OCP environments. Information Schedule taxonomy page (>2200) dies because it hits the database that many times. It's an edge case; this is documented in the Info taxonomy page and the workaround is to use the Taxonomy Manager instead of the default Taxonomy editor page.

Quota resources need to be increased in Production as noted in the Tech Walkthrough.