search

CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository
8 stars 4 forks source link

Storage microservice optimize/research changes #686

Closed dloy closed 3 years ago

dloy commented 3 years ago

Description

This issue is an umbrella project for a number of earlier issues.

The purpose of the overall project is to apply a number of changes to improve overall storage performance. Currently these changes include:

  1. share EFS storage with Ingest to reduce content replication: Research: Shared EFS ingest storage with Merritt Storage #421
  2. use ENV variable to identify log location. Currently this is handled as an SSM variable that does not easily fit with generalized server docker applications for microservices. Change store, replic, inventory configurations for log from SSM to ENV #679
  3. Optimize the confirmation reread of content for fixity to use the optimized cloud audit mechanism. This will eliminate the full download of the file.
  4. research whether a different approach can be used for the generation of container files for customers. Several approaches have been proposed. Possibly Investigate - if container file downloads by Dryad users can be handled by javascript #656 or possibility of stream generation in cloud.
  5. Changes indicated by admin consistency reports
terrywbrady commented 3 years ago

Also consider: research if it is possible to stream content into a zip while writing to S3.

elopatin-uc3 commented 3 years ago

Related to #421

dloy commented 3 years ago

stage deploy

Items:

Servers:

uc3-mrtstore01x2-stg.cdlib.org uc3-mrtstore02x2-stg.cdlib.org

Code

https://github.com/CDLUC3/mrt-store/commit/7b37db8fdab5420a8e9a32098e0c6507d21e63a8 https://github.com/CDLUC3/mrt-store/commit/37efc2a1e9e47c37078e289d1a547ee993ebc1c4 https://github.com/CDLUC3/mrt-store/commit/8fb777d3acacd0a6e8fddcdb9083642e25c0918c https://github.com/CDLUC3/tomcat8_catalina_base/commit/e8f6df9cbd4a31a4b34a0e424eebb5efb4195bfc

Jenkins

http://builds.cdlib.org/job/mrt-store-pub/142/console

Install

terrywbrady commented 3 years ago

I made a docker-compose change to support this in our docker stack: https://github.com/CDLUC3/merritt-docker/commit/5120c86378e326cbd2d324971b80c0ccb56c440a

mreyescdl commented 3 years ago

Changes to Ingest in place on branch "efs-storage"

Docker environment test okay.

Stage environment fails due to permission issue with Storage.
Our umask in Ingest for user "dpr2" is correct, but Tomcat must overrule this.

I'll ask IAS to explicitly set the UMASK in the Systemctl file to 002

Update: May be able to set as an environment variable. Will test

mreyescdl commented 3 years ago

Added umask to Tomcat startup

export UMASK=0022

Deployed to Ingest stage workers 1/2