Update "ScpBufrToRaijin" so that it can run from embery

ACCESS-NRI / accessdev-Trac-archive

Archive accessdev Trac contents as issues

Apache License 2.0

0 stars 0 forks source link

Update "ScpBufrToRaijin" so that it can run from embery #305

Closed penguian closed 7 years ago

penguian commented 7 years ago

keyword_APS3_Bufr_remote_copy_sam_MARS resolution_fixed | by jtl548@nci.org.au

Bufr files used in APS3 global suites used to be copied from Ngamai to Raijin on an on-demand basis. The set of scripts used are known as "ScpBufrToRaijin". With the decommissioning of Ngamai we need to update the scripts so that they can be run from embery. This ticket describes the changes.

For a background see the previous tickets, #240 and #271.

Issue migrated from trac:305 at 2024-01-31 18:27:43 +1100

penguian commented 7 years ago

@jin.lee@bom.gov.au commented

My development branch is,

https://access-svn.nci.org.au/svn/nwp/branches/dev/jtl548/da/utilities/odb/scripts/r522_ScpBufrToRaijin

penguian commented 7 years ago

@jin.lee@bom.gov.au commented

Hi Chris,

I made 2 minor changes to "cycle_generate_bufr.ksh":

a change to set a temporary working directory on embery
a change to take into account the changes in the paths to archived files on sam

If you can review the changes that will be great.

Cheers,

Jin

penguian commented 7 years ago

cit548@nci.org.au commented

Hi Jin,

I've checked the changes to "cycle_generate_bufr.ksh"

Some comments:

I don't have permission to create a subdirectory under embery:/data and other users are probably in the same boat. Consider letting users set their prefered location for DATADIR via an external export command and prompting them to do so if they haven't.
RemHostTwo shouldn't be set to "raijin" - it needs to be @raijin.nci.org.au
Users may not have the mars module already loaded in their environment, so consider doing this in the script.

With workarounds for these issues I was able to run the command and set up bufr file tarballs under raijin:/g/data/dp9/da/access-g/ops/bufr/20170201*/

-- Chris.

penguian commented 7 years ago

cit548@nci.org.au changed _comment0 which not transferred by tractive

penguian commented 7 years ago

@jin.lee@bom.gov.au commented

Replying to ACCESS-NRI/accessdev-Trac-archive#305 (comment:3):

Hi Jin,

I've checked the changes to "cycle_generate_bufr.ksh"

Some comments:

I don't have permission to create a subdirectory under embery:/data and other users are probably in the same boat. Consider letting users set their prefered location for DATADIR via an external export command and prompting them to do so if they haven't. DATADIR is now specified in input.lst

RemHostTwo shouldn't be set to "raijin" - it needs to be @raijin.nci.org.au Done

Users may not have the mars module already loaded in their environment, so consider doing this in the script. Done

With workarounds for these issues I was able to run the command and set up bufr file tarballs under raijin:/g/data/dp9/da/access-g/ops/bufr/20170201*/

-- Chris.

penguian commented 7 years ago

@jin.lee@bom.gov.au changed status from assigned to closed

penguian commented 7 years ago

@jin.lee@bom.gov.au set resolution to fixed

penguian commented 7 years ago

@jin.lee@bom.gov.au commented

The development branch, https://access-svn.nci.org.au/svn/nwp/branches/dev/jtl548/da/utilities/odb/scripts/r522_ScpBufrToRaijin at ![596] merged into the trunk at ![597].