trendscenter / coinstac

Collaborative Informatics and Neuroimaging Suite Toolkit for Anonymous Computation

MIT License

47 stars 19 forks source link

Improve shareability of computations using containers #1424

Open praeducer opened 2 years ago

praeducer commented 2 years ago

Outcomes

Reduce software dependency
Reduce average image size
Manage and maintain containers of computations more easily
Increase visibility and understanding of what containerized computations are available

Learning Resources

Introduction to Singularity: A Container Platform for Scientific and High-Performance Computing

Open Source Tools To Consider

Singularity HPC is optimized for managing containers in an HPC environment
naked-singularity: A repository of definition files for building Singularity containers around the software applications, frameworks, and libraries you need to run on high-performance computing systems.
Singularity Registry Server is a server to provide management and storage of Singularity images for an institution or user to deploy locally. It does not manage building but serves endpoints to obtain and save containers.

praeducer commented 2 years ago

@rssk and @spanta28: Found some open source tools that may help with Singularity implementations.

praeducer commented 2 years ago

We need to solve this for COINSTAC's core microservices as well. Let's make sure to integrate this effort with the deployment strategy for the system as a whole: https://github.com/trendscenter/coinstac/issues/1420

praeducer commented 2 years ago

@dylanmartin and @rssk thoughts on the value of this issue? It seems more like a mega-task or architecture task if antyhing. This came from Vince and Sandeep's roadmap earlier in the year and I'm unsure of its relevance after your latest work.

dylanmartin commented 1 year ago

There are some good thoughts here but I think it needs to be broken down more to take action on it.