search

USF-IMARS / erddap-config

Content dir for docker-erddap incl setup.xml & dataset.xml
0 stars 1 forks source link

7D MEAN files not rsynced to dune #46

Closed dotis closed 1 year ago

dotis commented 1 year ago

I'm not sure when/how the GOM 7D MEAN files are supposed to rsync to dune. I have updated all the 7D mean files on my end, but I don't see them in the /mnt/sdb on dune.

/srv/imars-objects/gom/MEAN_7D_MODA/OC; SST4; SST

and

/srv/imars-objects/gom/MEAN_7D_VSNPP/OC; SSTN; SST

7yl4r commented 1 year ago

rsync is not working b/c file permissions from root_squash NFS settings.

gom served from cozumel, cozumel is not using puppet v3 yet.

Steps to fix:

7yl4r commented 1 year ago

I was unable to get this fixed easily because cozumel is too old for puppet_v3 to be configured easily. We should switch the files served on cozumel over to tpa_pgs or the USF RC /work directories, then I can upgrade cozumel.

7yl4r commented 1 year ago

I would like to try using a new location for the GoM files:

/srv/imars-objects/tpa_pgs/rois/gom

Let me know if you notice any performance differences vs the previous location (/srv/imars-objects/gom) or if you get permissions errors.

dotis commented 1 year ago

Ok. I'll move things over.

From: Tylar @.> Sent: Sunday, April 16, 2023 2:42 PM To: USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

I would like to try using a new location for the GoM files:

/srv/imars-objects/tpa_pgs/rois/gom

Let me know if you notice any performance differences vs the previous location (/srv/imars-objects/gom) or if you get permissions errors.

— Reply to this email directly, view it on GitHubhttps://github.com/USF-IMARS/erddap-config/issues/46#issuecomment-1510455914, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGKS3DOK5WUBF5PFTF7PZIDXBQ4R3ANCNFSM6AAAAAAWZL4HSI. You are receiving this because you were assigned.Message ID: @.***>

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

7yl4r commented 1 year ago

If all goes according to plan the new gom OC files will show up in ERDDAP Monday morning. Check the fgnms dashboard's OC maps to see if they are updated; currently they are ~30days out of date.

dotis commented 1 year ago

3.90M bytes/sec is the rate.

From: Tylar @.> Sent: Friday, April 21, 2023 2:35 PM To: USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

If all goes according to plan the new gom OC files will show up in ERDDAP Monday morning. Check the fgnms dashboard's OC maps to see if they are updated; currently they are ~30days out of date.

— Reply to this email directly, view it on GitHubhttps://github.com/USF-IMARS/erddap-config/issues/46#issuecomment-1518201867, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGKS3DO2CVZH5NL6DHF3J7TXCLHNJANCNFSM6AAAAAAWZL4HSI. You are receiving this because you were assigned.Message ID: @.***>

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

dotis commented 1 year ago

Up to 17.75M bytes per sec now

From: Daniel Otis @.> Sent: Friday, April 21, 2023 4:39 PM To: USF-IMARS/erddap-config @.>; USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.***> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

3.90M bytes/sec is the rate.

From: Tylar @.> Sent: Friday, April 21, 2023 2:35 PM To: USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

If all goes according to plan the new gom OC files will show up in ERDDAP Monday morning. Check the fgnms dashboard's OC maps to see if they are updated; currently they are ~30days out of date.

— Reply to this email directly, view it on GitHubhttps://github.com/USF-IMARS/erddap-config/issues/46#issuecomment-1518201867, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGKS3DO2CVZH5NL6DHF3J7TXCLHNJANCNFSM6AAAAAAWZL4HSI. You are receiving this because you were assigned.Message ID: @.***>

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

dotis commented 1 year ago

This dropped to just under 2M bytes per sec for one directory that I rsynced overnight over the weekend.

From: Daniel Otis @.> Sent: Saturday, April 22, 2023 2:59 PM To: USF-IMARS/erddap-config @.>; USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.***> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

Up to 17.75M bytes per sec now

From: Daniel Otis @.> Sent: Friday, April 21, 2023 4:39 PM To: USF-IMARS/erddap-config @.>; USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.***> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

3.90M bytes/sec is the rate.

From: Tylar @.> Sent: Friday, April 21, 2023 2:35 PM To: USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

If all goes according to plan the new gom OC files will show up in ERDDAP Monday morning. Check the fgnms dashboard's OC maps to see if they are updated; currently they are ~30days out of date.

— Reply to this email directly, view it on GitHubhttps://github.com/USF-IMARS/erddap-config/issues/46#issuecomment-1518201867, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGKS3DO2CVZH5NL6DHF3J7TXCLHNJANCNFSM6AAAAAAWZL4HSI. You are receiving this because you were assigned.Message ID: @.***>

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

7yl4r commented 1 year ago

I don't know how these speeds compare to what we were getting when running on IMaRS servers.

The cause of slowdowns could be due to network bandwidth or limitations on the physical disks in TPA. We will need to contact USF-RC to debug.

The network connection is capped at 40Gb/s (or 10Gb/s?) and we can reasonably expect a disk speed topping at 6Gb/s.

dotis commented 1 year ago

I ran some things yesterday and the processing seemed to be moving at a normal speed. I think it may just be the i/o that was slow there. I'll have to test a bit more.

From: Tylar @.> Sent: Thursday, April 27, 2023 12:55 PM To: USF-IMARS/erddap-config @.> Cc: dotis @.>; Assign @.> Subject: Re: [USF-IMARS/erddap-config] 7D MEAN files not rsynced to dune (Issue #46)

I don't know how these speeds compare to what we were getting when running on IMaRS servers.

The cause of slowdowns could be due to network bandwidth or limitations on the physical disks in TPA. We will need to contact USF-RC to debug.

The network connection is capped at 40Gb/s (or 10Gb/s?) and we can reasonably expect a disk speed topping at 6Gb/s.

— Reply to this email directly, view it on GitHubhttps://github.com/USF-IMARS/erddap-config/issues/46#issuecomment-1526031351, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AGKS3DJGNZJKCGSOAX25I7DXDKQHVANCNFSM6AAAAAAWZL4HSI. You are receiving this because you were assigned.Message ID: @.***>

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.