expanding Gannet

[shellywanamaker]

Opening this issue to discuss expanding Gannet to be able to support storage needs for the USDA shellfish omics meta-analysis project.

We budgeted for 6 x 16TB HDDs and an expansion unit to expand Gannet.

I saw on the purchasing log @kubu4 ordered 3 x 16TB HDDs - Seagate ST16000NEZ00 for Gannet expansion (cat: B07SLPTK17) last November and a Synology RX1217 12 Bay expansion for Gannet (cat: 4292258) last July.

Are these the drives and expansion unit I should order?

[kubu4]

We cannot expand Gannet beyond the single expansion unit that's already installed.

However, we might be able to upgrade all of the HDDs to 20TB (28 drives x (20TB - 16TB) = 112TB of additional space), which would be similar to the 6 x 16TB HDDs budgeted for... Also, I'd have to check to see if the Synology can accept 20TB HDDs.

[shellywanamaker]

gotcha. That would be great if you can check on the 20TB HDDs. Is there open space for more 16TB HDDs or is the expansion unit completely filled?

[kubu4]

Completely filled.

[shellywanamaker]

This isn't an urgent need (we should need to much space just yet), just wanted to get it in the queue

[kubu4]

20GB HDDs are compatible.

Price range is ~$500 - $900/ea, depending on brand.

[shellywanamaker]

ok. Do all 28 drives need to be the same size?

[sr320]

Remind us the dollar amount budgeted?

On Wed, Sep 25, 2024 at 2:40 PM Shelly Wanamaker @.***> wrote:

ok. Do all 28 drives need to be the same size?

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/RobertsLab/resources/issues/1967*issuecomment-2375313521__;Iw!!K-Hz7m0Vt54!mArEyd8qtQVcffRsVz5fCIeCl5qEh_0whqF66BIGDxdzXvYff41RUyD6r09Mq10a_vWgD0DrbySi6-syoa1poIE$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABB4PN6PKMMBFIBQ6STBGYDZYMUWNAVCNFSM6AAAAABO3MI2ZOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZVGMYTGNJSGE__;!!K-Hz7m0Vt54!mArEyd8qtQVcffRsVz5fCIeCl5qEh_0whqF66BIGDxdzXvYff41RUyD6r09Mq10a_vWgD0DrbySi6-sy9cliyWU$ . You are receiving this because you were assigned.Message ID: @.***>

[shellywanamaker]

"A total of $3,300 in year 1 is requested to cover the cost for 6 x 16TB ultra high performance storage drives at $300 each and the cost for an expansion unit for data volume expansion at $1500."

[sr320]

So $4800 ?

On Wed, Sep 25, 2024 at 2:58 PM Shelly Wanamaker @.***> wrote:

"A total of $3,300 in year 1 is requested to cover the cost for 6 x 16TB ultra high performance storage drives at $300 each and the cost for an expansion unit for data volume expansion at $1500."

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/RobertsLab/resources/issues/1967*issuecomment-2375335793__;Iw!!K-Hz7m0Vt54!nNqulnIfbbBSpxkHLqC8NrBPIRcXd2HjdvS2MBz3xbIKgRc4AbyIFOfrjDO_ECWVj_-KsrYtCvQUHFdddw1Gm4s$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABB4PN2KAB4S3D6SUZZ3XDDZYMWWNAVCNFSM6AAAAABO3MI2ZOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZVGMZTKNZZGM__;!!K-Hz7m0Vt54!nNqulnIfbbBSpxkHLqC8NrBPIRcXd2HjdvS2MBz3xbIKgRc4AbyIFOfrjDO_ECWVj_-KsrYtCvQUHFddkSGmSS0$ . You are receiving this because you were assigned.Message ID: @.***>

[kubu4]

ok. Do all 28 drives need to be the same size?

Don't think so, as long as they're >= to existing drives.

[shellywanamaker]

$3,300 total. 3300 = (6 *$300) + $1500

[sr320]

@kubu4 - maybe give her a recommendation for $3300 that makes sense for our system set-up

On Wed, Sep 25, 2024 at 3:07 PM Shelly Wanamaker @.***> wrote:

$3,300 total. 3300 = (6 *$300) + $1500

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/RobertsLab/resources/issues/1967*issuecomment-2375350183__;Iw!!K-Hz7m0Vt54!j9b0IvqzSU5x0qjzz6nY7HCWPSo-VeU8RURYNslYAH-4DQZH223W8nHN2iRrYBR2SOrvo8MFBe80gTS6aYGoZcM$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/ABB4PN5Q3RXXLRAZM6Z2IALZYMX2BAVCNFSM6AAAAABO3MI2ZOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZVGM2TAMJYGM__;!!K-Hz7m0Vt54!j9b0IvqzSU5x0qjzz6nY7HCWPSo-VeU8RURYNslYAH-4DQZH223W8nHN2iRrYBR2SOrvo8MFBe80gTS6xglnecs$ . You are receiving this because you were assigned.Message ID: @.***>

[sr320]

I would like to get @kubu4 confirmation - but I think this is proper product to support your effort that fits within your budget. https://eshop.macsales.com/item/OWC/TB3TBL8X16/

[kubu4]

Have confirmed that Raven should be able to handle that external drive:

(base) sam@raven:~$ cat /sys/bus/thunderbolt/devices/0-0/device_name 
Dell Precision Thunderbolt 3 Add-in Card

[shellywanamaker]

That's great. This is significantly less space than initially proposed (16TB vs. 96TB), and I realize I underbudgeted. But it's possible to divert some funding from support staff salary to supplies if that makes more sense. I'm wondering if it makes sense to get a 32 TB ($6100) or if get the 16TB one for now and see how that goes. And if needed, but another one down the line? @kubu4 would it be possible to connect multiple drives like these to Raven?

[kubu4]

Yep.

[shellywanamaker]

I'm thinking ahead for sharing data with collaborators, @kubu4 does Raven have the same interface as Gannet for viewing/sharing files like https://gannet.fish.washington.edu/metacarcinus/Pgenerosa/analyses/?

[sr320]

Sharing will be done on gannet.

[shellywanamaker]

ok so save data on Raven and link it through Gannet?

[sr320]

If working on raven - yes rsync output to gannet... same when you are using klone.

[shellywanamaker]

OH!! got it. So we will still be syncing everything to Gannet. I will go ahead and purchase the drive

[shellywanamaker]

It's ordered and will be shipped to:

Sam White University of Washington 1122 NE Boat Street Seattle, WA 98105

Carrier: UPS Method: UPS Ground Service

ETA end of next week. Tracking Number: 1Z92X7X84275904143

[kubu4]

Received the HDD today.

No packing slip included.

I'll report back later today with how to access on Raven.

[kubu4]

HDD came in this bad boy, LOL!

[kubu4]

Also, I probably won't be able to get this setup on Raven today. Looks like I'm going to need to fuss around with partitions/mounting/formatting junk...

[kubu4]

New external HDD has been configured and is ready to roll.

Can be accessed at: /home/shared/16TB_HDD_01