Project lead and collaborators:
Lead: Dipankar Bachar @dipankarb
Lead: David Meunier @davidmeunier79
Collaborator: Aissam Rahmani @aissamr
Description:
Large scale image processing demands a standardized way of not only storage but also a method for job distribution and scheduling. The eXtensible Neuroimaging Archive Toolkit (XNAT) is one of several platforms that seeks to solve the storage issues. Distributed Automation for XNAT (DAX) is a job control and distribution manager. DAX allows to store analyzed imaging data on XNAT (datatypes), extract information from XNAT via scripts (Xnat_tools), run pipelines on the data in XNAT via a cluster ( processors ). We are working towards the integration of DAX pipeline to our XNAT datamanagement tools.
Reference:
DAX - The Next Generation: Towards One Million Processes on Commodity Hardware
Stephen M Damon, Brian D Boyd , Andrew J Plassard , Warren Taylor , Bennett A Landman
PMID: 28919661 PMCID: PMC5596878 DOI: 10.1117/12.2254371
The goals of this BrainHack project are :
to discuss the working of DAX pipeline and if possible with a live demo
to understand the working of Spyder in DAX, how to configure it
to test the DAX command lines
to try to solve the technical challenges of installations
to understand/learn the DAX processors
to understand/learn how to write the YAML scripts
to learn how to prepare a YAML script for DAX processor in RedCAP.
Skill Required :
Basic understanding of any image data management tools like xnat ( 40% -100% )
Basic understanding of python and shell scripts ( 50% -100% )
Understanding of scientific calculations in super computer ( 50% - 100% )
Project info
Title: Integration of DAX pipeline with XNAT
Project lead and collaborators: Lead: Dipankar Bachar @dipankarb Lead: David Meunier @davidmeunier79 Collaborator: Aissam Rahmani @aissamr
Description: Large scale image processing demands a standardized way of not only storage but also a method for job distribution and scheduling. The eXtensible Neuroimaging Archive Toolkit (XNAT) is one of several platforms that seeks to solve the storage issues. Distributed Automation for XNAT (DAX) is a job control and distribution manager. DAX allows to store analyzed imaging data on XNAT (datatypes), extract information from XNAT via scripts (Xnat_tools), run pipelines on the data in XNAT via a cluster ( processors ). We are working towards the integration of DAX pipeline to our XNAT datamanagement tools.
External links : xnat : https://www.xnat.org/ DAX : https://dax.readthedocs.io/en/latest/index.html
Reference: DAX - The Next Generation: Towards One Million Processes on Commodity Hardware Stephen M Damon, Brian D Boyd , Andrew J Plassard , Warren Taylor , Bennett A Landman PMID: 28919661 PMCID: PMC5596878 DOI: 10.1117/12.2254371
The goals of this BrainHack project are :
Skill Required :
Project Image:![DAX_Workflow](https://user-images.githubusercontent.com/9570817/100084332-edfa6600-2e4a-11eb-98d7-5058eb4bed8a.jpg)