BrainhackMTL / informatics2018

website for the INCF Congress 2018 Hackathon
GNU General Public License v3.0
0 stars 2 forks source link

CBRAIN workflow builder GUI #7

Open mcin-armintaheri-archive opened 6 years ago

mcin-armintaheri-archive commented 6 years ago
Field Value
Project Name CBRAIN workflow builder GUI
Description We will define a GUI in ReactJS representing the task dependency graph of a particular workflow. This GUI will create a serialisable representation of the task dependencies. Each time a workflow is invoked, we will get CBRAIN to traverse the representation and internally model tasks dependencies before executing the tasks as described.
URL(s) CBRAIN
Contributors' Brainhack Slack handle @armin, @Serge, @cczech
Image cbrain-blue-alpha
gkiar commented 6 years ago

https://github.com/TimVanMourik/Porcupine

MontrealSergiy commented 6 years ago

I reviewed bunch of wf, liked Scufle, it is not very relevant to CBrain task dependencies but looks sharp. We working though on a lighter notation

MontrealSergiy commented 6 years ago

here is draft of architecture http://www.plantuml.com/plantuml/svg/TOz1IyD048NlyoiUSyy_aDAq21P1YXKLGWvBTYDBDZDnTnOFqlzkGouUT8xp-1xVsnTpsUgSQ773v3u2-7XuRazFZ6y2Nj_He7lJF8r9lt3lesdk2UXUsilZfSVTt_6eoOSCZh9KWtVccAuqwBoe137mGQl5pneAp9K9FenHeaMLmYJgLmsNvoYRHdi-eTdTR0YWAr7tFzutkusasmr9gmVuuNp4a6gna9csVMjVz-lVqpw8htFw0G00

MontrealSergiy commented 6 years ago

toz1iyd048nlyoiusyy_adaq21p1yxklgwvbtydbdzdntnofqlzkgouut8xp-1xvsntpsugsq773v3u2-7xurazfz6y2nj_he7ljf8r9lt3lesdk2uxusilzfsvtt_6eoosczh9kwtvccauqwboe137mgql5pneap9k9fenheamlmyjglmsnvoyrhdi-etdtr0ywar7tfzutkusasmr9gmvuunp4a6gna9csvmjvz-lvqpw8htfw0g00

MontrealSergiy commented 6 years ago

when github project is ready I can commit the source

MontrealSergiy commented 6 years ago

Potential pitch, descriptor or readme file

The collaborative scientific data processing should be auditable, reproducible, even when variety of tools, servers and distributed datasets are useds. Workflow techniques ensure that automated procedures are undertaken in the correct sequence, according to a defined set of rules, delivering better reproducibility and provenance. Due complexity of workflow user friendly GUI tools are considered the better solution than purely textual ones. Not all the workflow drag and drop tools are equally popular among the users/ It even sometimes thought that a text based workflow language might be better than buggy or difficult to master visual tool. In fact Yaml based Common Workflow Language is one better attempts to came up with universal languages, supported by many popular tools (Tavern, Apach Airflow...). Of course even text languages can be complemented by visualization (non-editable), bulders or wizards. A popular pipeline platforms CBrain offer basic task dependecies control, yet do not have dependency visualization not to mention the visual editors. This project aims to complement Cbrain with modern but still intuitive enough visual workflows tools. As goal of CBrain to releave end users from any coding, we aim ultimately at completely visual workflow editor, though might fall back on a visualization of some text or yaml based language/dependencies descriptor depending on user feedback.

CWL -> boutiques converter was just created during hackaton (by CWL author)

MontrealSergiy commented 6 years ago

Scufl workflow for comic strip capture ( do not do on work) http://www.myexperiment.org/workflows/824.html

candicecz commented 6 years ago

task-dependency-draft-new

mcin-armintaheri-archive commented 6 years ago

https://slides.com/armintaheri/cbrain-workflows