search

CredentialEngine / CredentialRegistry

Repository for development of the Credential Registry
Apache License 2.0
12 stars 10 forks source link

Missing description sets for new Competency Frameworks on Production #707

Closed siuc-nate closed 3 months ago

siuc-nate commented 3 months ago

We recently had a partner publish a large number of Competency Frameworks on production. However, none of them are returning description sets.

Compare competency frameworks that we've had in the system for a while: image

To newly-published ones: image

This seems to affect all recently-published Competency Frameworks. We need this working ASAP so that we can go back to the partner that published the data and show them that it works.

This has been a recurring problem for a long time. What can we do to keep this from continuing to happen?

excelsior commented 3 months ago

Yesterday, 500+ envelopes were publishished, containing ≈5,000 resources it total. Pre-calculating description sets for all them took a bit a long time. Unfortunately, we don't track time of description sets creation, so it's impossible to tell how much time passed between the publishing and pre-calculation.

I'll try to optimize this process the similar way other recent slow queries were handled.

siuc-nate commented 3 months ago

This appears to be working now, thanks.