Closed dloy closed 3 years ago
Also consider: research if it is possible to stream content into a zip while writing to S3.
Related to #421
Items:
uc3-mrtstore01x2-stg.cdlib.org uc3-mrtstore02x2-stg.cdlib.org
https://github.com/CDLUC3/mrt-store/commit/7b37db8fdab5420a8e9a32098e0c6507d21e63a8 https://github.com/CDLUC3/mrt-store/commit/37efc2a1e9e47c37078e289d1a547ee993ebc1c4 https://github.com/CDLUC3/mrt-store/commit/8fb777d3acacd0a6e8fddcdb9083642e25c0918c https://github.com/CDLUC3/tomcat8_catalina_base/commit/e8f6df9cbd4a31a4b34a0e424eebb5efb4195bfc
http://builds.cdlib.org/job/mrt-store-pub/142/console
I made a docker-compose change to support this in our docker stack: https://github.com/CDLUC3/merritt-docker/commit/5120c86378e326cbd2d324971b80c0ccb56c440a
Changes to Ingest in place on branch "efs-storage"
Docker environment test okay.
Stage environment fails due to permission issue with Storage.
Our umask in Ingest for user "dpr2" is correct, but Tomcat must overrule this.
I'll ask IAS to explicitly set the UMASK in the Systemctl file to 002
Update: May be able to set as an environment variable. Will test
Added umask to Tomcat startup
export UMASK=0022
Deployed to Ingest stage workers 1/2
Description
This issue is an umbrella project for a number of earlier issues.
The purpose of the overall project is to apply a number of changes to improve overall storage performance. Currently these changes include: