search

MAAP-Project / Community

Issue for MAAP (Zenhub)
2 stars 1 forks source link

EIS Needs a Larger Queue Instance (RAM and DiskSpace) #1012

Open ranchodeluxe opened 3 weeks ago

ranchodeluxe commented 3 weeks ago

Is your feature request related to a problem? Please describe. Yes, the current EIS queue maap-dps-eis-worker-64gb is for 64GB with 8CPUs and has max disk space size of 100GB. We've been running out of space when writing locally before the job is done

Describe the solution you'd like

  1. could we increase the disk space for maap-dps-eis-worker-64gb to ~250GB please?
  2. could we get a new queue with a 128GB machine with 14 CPUs and max disk space ~500GB please?

Describe alternatives you've considered None 😉 Please advise

Additional context Thanks for fielding our annoying questions

sujen1412 commented 2 weeks ago

How many maximum parallel instances do you envision running for the new 128gb queue ?

ranchodeluxe commented 2 weeks ago

How many maximum parallel instances do you envision running for the new 128gb queue ?

10 parallel workers @sujen1412

sujen1412 commented 1 week ago

Could you please test out the new queue and let me know how its working out for you. Thanks