search

nih-cfde / cfde-deriva

Collaboration point for miscellaneous CFDE-deriva scripts
Other
2 stars 3 forks source link

202201 ingest very slow for new input #297

Closed karlcz closed 2 years ago

karlcz commented 2 years ago

A new LINCS submission experienced timeouts in prod and also shows very slow ingest timings under test in dev environment.

The core fact keywords ETL query seems to be the standout query which is running much slower than on older submissions.

karlcz commented 2 years ago

@ACharbonneau this is a blocker for release

karlcz commented 2 years ago

A fix for this has been pushed to master and is under manual testing in dev environment to rebuild a previously broken submission.