amusecode / amuse

Astrophysical Multipurpose Software Environment. This is the main repository for AMUSE
http://www.amusecode.org
Apache License 2.0
158 stars 99 forks source link

Containerized workers #567

Open ipelupessy opened 4 years ago

ipelupessy commented 4 years ago

Is your feature request related to a problem? Please describe. basically its a solution to the "you need to be able to compile and have all the prerequisites" for code packages

Describe the solution you'd like it would be good to have the build system for community codes have the option to generate the worker inside a container (docker/ singularity/ ..). This would allow a package install w/o compile, pulling instead a containerized executable from an online repository (most container frameworks have such repos)..

Note that the changes in the framework to start an wrapped executable are limited, since the docker images can be made executable with proper forwarding of command line flags..

Note that this probably works best with socket channel..MPI is something to be researched..

Describe alternatives you've considered

this is somewhat related to #215 - however this wraps the whole AMUSE installation in a container..

Additional context

HyMUSE has the option to use BMI wrapped codes natively or through a docker container. Note that a major difference with the wrapped BMI is the fact that these are supposed to conform to the same interface...

rieder commented 4 years ago

It sounds like it would be a useful feature, but I don't see this working with MPI tbh. If that could work, I would be more interested in adding this.