search

CARTAvis / carta

To CARTA users, this repo holds the CARTA release packages. Please use this repo to log bugs and feature requests. These will be triaged by the development team and prioritised as necessary in the development cycles.
19 stars 0 forks source link

feature idea: allow triggering of hdf5 converter on fits files from within the CARTA filebrowser #149

Open lh-astro opened 2 years ago

lh-astro commented 2 years ago

When the file browser is opened to look at whether a .fits output file looks sensible and if it does also allow for triggering the hdf5 conversion within CARTA.

kswang1029 commented 2 years ago

There are performance concerns about this feature and potentially this can disrupt a controller-based CARTA server hosting multiple active users. Even with the -s flag (lower memory usage), the conversion may take a while. So it is more sensible to use fits2idia tool for the conversion outside CARTA instead.

lh-astro commented 2 years ago

Would the two following concepts also disrupt multiple users?

1) Submit a slurm job for each individual .fits to hdf5 conversion (triggered from CARTA). 2) Setup a dedicated .fits to hdf5 converter node which takes care of the resource management and conversion priority.