search

radical-collaboration / hpc-workflows

NSF16514 EarthCube Project - Award Number:1639694
5 stars 0 forks source link

EnTK script for Year 2 PSU usecase #77

Closed vivek-bala closed 5 years ago

vivek-bala commented 5 years ago

I have added an initial script at https://github.com/radical-collaboration/hpc-workflows/blob/master/scripts/application_AnEn/year_2/entk_scripts. We have two configuration files: one for resource related parameters, other for workflow related parameters.

@Weiming-Hu and @vivek-bala to work for fill up remaining parts of the config file and entk script. Test on Cheyenne.

mturilli commented 5 years ago

@Weiming-Hu to try this on Cheyenne after populating the yml. Note: currently there are only placeholders for data movement. In case it is needed, the script will have to be amended.

Weiming-Hu commented 5 years ago

Renewable simulator is complete.

Weiming-Hu commented 5 years ago

EnTK + AnEn py script is complete. It is successfully run on local machine Sapphire.

Weiming-Hu commented 5 years ago

Set up personal local endpoint using personal globus connect. Uploading observations (1.9T) at a speed of ~80 MB/s.

Weiming-Hu commented 5 years ago

Data uploaded to Cheyenne.