unity-sds / unity-project-management

Container repo for project management (projects, epics, etc)
Apache License 2.0
0 stars 2 forks source link

Data Staging Documentation and Demonstration #205

Open brianlee731 opened 1 month ago

brianlee731 commented 1 month ago

Objective is to document what the Users should expect in regards to data staging process. -stage-in/stage-out variables -potential conflicts based on Data Source (what variables are required, conflicting variables that cannot co-exist?) and when to use what. -stage large data onto JupyterHub environment that's either located in personal laptop or somewhere else other than the DAAC (EMIT Use Case - unable to load their 5GB file directly so had to break it into chunks and upload separately)

Acceptance Criteria

GodwinShen commented 1 month ago

Please add to this ticket the stage-out documentation ticket that was recently created here: https://github.com/unity-sds/unity-data-services/issues/439

GodwinShen commented 2 weeks ago

U-DS CWL examples provided to SPS, SPS tried it out and it looks good. This is very specific to what SPS needs.