search

StatCan / aaw

Documentation for the Advanced Analytics Workspace Platform
https://statcan.github.io/aaw/
Other
67 stars 12 forks source link

JFROG: Upgrade disk IOPS #1574

Open Jose-Matsuda opened 1 year ago

Jose-Matsuda commented 1 year ago

Follow up to https://github.com/StatCan/daaas/issues/1520

It was determined that we are on an E40 which is insufficient for the XRAY database. This impacts users who are trying to install packages that don't already exist in the Artifactory cache (as it is trying to scan and the database is struggling to update the vulnerability db)

We can move to a P40 to solve this, and possibly downgrade to P30 as well.

Note that we may move to cloud main artifactory in the future, so this ticket may just end up being closed.

StanHatko commented 1 year ago

I wonder if Artifactory supports using multiple disk types for the cache? So you could have commonly accessed objects on a smaller P30 disk or so, and have large pretrained models and other rarely accessed objects on a relatively slow 10 TB HDD.

Jose-Matsuda commented 1 year ago

@StanHatko this should specifically be for the XRAY component which itself is just responsible for holding the database of vulnerabilities, and for keeping the results of the packages.

Artifactory itself seems to be on an E20 disk, though I'm not 100% sure on how the caching works with that (ie if all of / the majority of the disk is just caching artifacts)