esg-epfl-apc / tools-astro

0 stars 3 forks source link

Galaxy Tool Linting and Tests for push and PR

European Galaxy server

Astropy tools

astropy is a python package comprising a collection of libraries serving as a basis for much of the modern research in astrophysics.

Here we add some of the basic operations implemented in astropy as galaxy tools:

These tools provide scientifically meaningful outputs, but serve primarily as proof-of-concept for introducing astrophysical tools into galaxy.

TODO: GammaPy simulation

This tool collection allows to produce synthetic gamma-ray observations with Cherenkov Telescope Array data. The tools rely on GammaPy and uses relatively little input data to yield scientifically useful outputs suitable for building further data analysis pipelines designed to assess telescope performance.

TODO: ODA tool

we can either generate a tool for each product, or

uses type interpretation to match to oda-api python classes types

ODA-annotated nb

TODO: remote data, gammapy responses, astro archives TODO: complex operations to be expressed as tools? publish package every time? TODO: understand how to deal with containers TODO: add gammapy TODO: supporting generic notebooks

https://training.galaxyproject.org/training-material/topics/galaxy-interface/tutorials/get-data/slides.html#4

Big data issue

when we compute on data, compute should have access to it deferred data approach, oakridge group

separate tool class for fetching data?

filesources where we can search for folders

datasources are directories

puslar arc is doing job staging and data staging

https://www.pyfilesystem.org/

may need to have admin training features on datasources

join WP4 for big data case, see chat