search

biosimulations / biosimulations

A platform for sharing and reusing biomodeling studies including models, simulations, and visualizations of their results
https://biosimulations.org
MIT License
38 stars 13 forks source link

🐛: Api repeatedly crashes on submitting BiGG projects #4146

Closed bilalshaikh42 closed 2 years ago

bilalshaikh42 commented 2 years ago

Contact Details

No response

Location

BioSimulations API

What happened?

Something about the Bigg Projects is causing the API to crash repeatedly. This happens even if the biosimulations-bigg python package first simulates each project locally, so it does not seem to be caused by submitting too many simulations at a time. The major difference between the Bigg Projects and the example runs is the size of the results, so I suspect that the large results are causing some issue either with Redis or the validation endpoint

What made it happen?

Running the biosimulations-bigg submit script

Version

Production (Deployed on a .org domain)

What browsers are you seeing the problem on?

No response

Relevant log output

No response

Code of Conduct

jonrkarr commented 2 years ago

The results are a little larger, but not particularly large since theres no time dimension.

jonrkarr commented 2 years ago

You could try removing the caching of simulation results.

The validation could be refactored so that it's moved into the dispatch service and it's result is stored to the database. This would avoid rechecking this later and allow more control over the computational load.

jonrkarr commented 2 years ago

Sounds like this doesn't appear to be a significant issue. @bilalshaikh42 can we close this, or mark this as future?

Refactoring calculation of summaries is captured by #4220.

bilalshaikh42 commented 2 years ago

With the additional issues this is probably good to close