search

IUSCA / sca-issues

1 stars 0 forks source link

ODI: Possible to add more memory (RAM) on Q compute nodes (q13-16) #2

Closed agopu closed 5 years ago

agopu commented 5 years ago

Mike reports that he is having to throttle QR-based processes to use fewer than available cores on q13-16 so the processes don't run out of RAM. We would like to explore the possibility of adding more memory (RAM) on those nodes. Granted, ODI already has the benefit of our providing dedicated compute nodes but I am thinking we may be able to swap out RAM chips from unused Q nodes (until we run into needing those nodes).

agopu commented 5 years ago

Will discuss this with @rperigo later today.

agopu commented 5 years ago

Ray & I stopped by the data center yesterday and bumped the RAM on q14 from 32 to 64GB, @youngmd to report back on how useful this is for the Illum. Correction process' efficiency (as well as overall improvements to QR and SWarp process execution times). We will adjust the other nodes as useful based on the feedback.

agopu commented 5 years ago

While the improvements were marginal in our tests last month, we figured more RAM would enable firing up an additional ODI worker node process as/when necessary so we decided to go ahead with upgrading all 4 ODI compute nodes.

After being backburnered for a while, @informaticianme & I knocked this out today when we were already at the data center for another reason.

pketienne commented 5 years ago

Relates to https://github.com/IUSCA/int-issues/issues/49.