Open arteymix opened 4 months ago
We spend a significant amount of time updating ranks on freshly created vectors that could be cut down by inserting vectors with ranks.
We could also compute ranks with SQL without retrieving data altogether
Once that is done, we can make vectors immutable like we did for analyses.
This might help mitigate transaction timeout errors curators are experiencing when running makeProcessedData.
makeProcessedData
We spend a significant amount of time updating ranks on freshly created vectors that could be cut down by inserting vectors with ranks.
We could also compute ranks with SQL without retrieving data altogether