Mount HECC stage-out results to MAAP AWS ADE workspaces

[wildintellect]

Description

MAAP users should be able to see results of HECC job outputs in the regular MAAP [ADE workspaces](https://auth.ops.maap-project.org/ It should be similar to how the current DPS output works.

This is related to #65 which created the MAAP HEC bucket.

Questions

There are open questions about how much the user should control the path within AWS. For now we should set the directory in HEC AWS bucket (maap-hec-ades-out-dev) to include the same username?

Definition of Done

• [x] MAAP Ops AWS Account can read from MAAP HEC AWS account bucket (#65) - MSFC/JPL
• [x] MAAP ADE workspace have MAAP HEC AWS stage-out bucket mounted (in a similar manner to DPS output) - JPL
• [ ] MAAP regular user can access HEC outputs in a MAAP workspace
• [ ] Documentation provided
• [ ] Github repo commits provided

[wildintellect]

Backup plan is to use the getresults api end point with a jobid to allow users to find their results and then manually access with s3fs or boto3

[wildintellect]

I've verified that MAAP OPS and UAT can read from the HEC bucket:

[cloudshell-user@ip-10-0-134-255 ~]$ aws s3 ls s3://maap-hec-ades-out-dev
                           PRE docker-on-desktop-k8s-via-ades/
                           PRE jplzhan/
                           PRE zhan/
2022-10-20 00:27:14          5 test_from_eks.txt
[cloudshell-user@ip-10-0-134-255 ~]$ aws s3 cp s3://maap-hec-ades-out-dev/test_from_eks.txt .
download: s3://maap-hec-ades-out-dev/test_from_eks.txt to ./test_from_eks.txt

[wildintellect]

@marjo-luc we think this is ready for you to try s3fs/mounting access from the MAAP ADE. If I can recall the info for logging into the DEV ADE, maybe @jjfrench and I can try s3fs to verify it works.

[marjo-luc]

Thanks @wildintellect and @jjfrench -- I've confirmed MAAP DIT can read the HEC bucket as well.

[wildintellect]

I've triple verified on https://ade.dit.maap-project.org/

import s3fs
fs = s3fs.S3FileSystem()
fs.ls('maap-hec-ades-out-dev')
with fs.open('maap-hec-ades-out-dev/test_from_eks.txt', 'rb') as f:
    print(f.read())

[marjo-luc]

MAAP HEC stage out bucket has been mounted to the DIT venue and access to the bucket from the ADE has been confirmed. Waiting on trial job run from @jjacob-jpl for final validation.

[jjacob7734]

I'll be validating this by running a job end to end and ensuring the output is available in the MAAP workspace.

[moronidav]

@jjacob7734 , We are awaiting your blessing on the validation of this.