search

yesworkflow-org / yw-prototypes

Research prototype with tutorial. Start here to learn about and try YesWorkflow.
http://yesworkflow.org/wiki
Other
33 stars 13 forks source link

Simple visualization tool for YW data flow graphs #7

Closed swanskysong closed 9 years ago

sycao5 commented 9 years ago

what is the format of the YW data flow graphs? are we continue to use DOT format with .gv extension?

ludaesch commented 9 years ago

I'm not sure whether we've nailed down a format.

My suggestion would be to think of .gv (=dot) files as "presentation formats" (almost... there's still actually pre-layout).

So having a simple JSON, YAML, or even CSV format for the edges would probably be preferred. E.g. in the Euler project we have a little stylesheet processor that takes a graph (in YAML format) and generates a dot file from it (while applying a stylesheet).

Having said that, I think any format that can be easily translated to dot will do. Even native dot isn't so bad (but maybe not see easy to postprocess as the other formats)

On Wed, Dec 24, 2014 at 11:40 AM, yang notifications@github.com wrote:

what is the format of the YW data flow graphs? are we continue to use DOT format with .gv extension?

— Reply to this email directly or view it on GitHub https://github.com/yesworkflow-org/yw-prototypes/issues/7#issuecomment-68061083 .

sycao5 commented 9 years ago

Can anyone show me examples in the Euler project for the visualization? I checked the .gv files definition. To me, the visualization class will have JSON, YAML, CSV methods. I would like to work for this task or work with the team together.

tmcphillips commented 9 years ago

I'm going to start out with a simple rendering of the java object model for a workflow graph as a dot file (issue #12) just so I can be sure things are working.

sycao5 commented 9 years ago

Hi Tim,

I write a main function for the DefaultExtractor.java, a toString() function for DelimiterComment.java and PortComment.java. I use src/main/resources/example.py as input. I am studying how to use extractWorkflow() . Some outputs are attached.

Yang

--- extracted comment lines are: ---

@begin main @in LandWaterMask_Global_CRUNCEP.nc @in NEE_first_year.nc @out result_simple.pdf @begin fetch_mask @in "LandWaterMask_Global_CRUNCEP.nc" @as input_mask_file @out mask @as land_water_mask @end fetch_mask @begin load_data @in "CLM4_BG1_V1_Monthly_NEE.nc4" @as input data file @out data @as NEE_data @end load_data @begin standardize_with_mask @in data @as NEE_data @in mask @as land_water_mask @out data @as standardized_NEE_data @end standardize_mask @begin simple_diagnose @in np @as standardized_NEE_data @out pp @as result_NEE_pdf @end simple_diagnose @end main

+++ extracted comments are: +++

@begin main null @in LandWaterMask_Global_CRUNCEP.nc null null @in NEE_first_year.nc null null @out result_simple.pdf null null @begin fetch_mask null @in "LandWaterMask_Global_CRUNCEP.nc" input_mask_file null @out mask land_water_mask null @end fetch_mask null @begin load_data null @in "CLM4_BG1_V1_Monthly_NEE.nc4" input data file @out data NEE_data null @end load_data null @begin standardize_with_mask null @in data NEE_data null @in mask land_water_mask null @out data standardized_NEE_data null @end standardize_mask null @begin simple_diagnose null @in np standardized_NEE_data null @out pp result_NEE_pdf null @end simple_diagnose null @end main null

On Dec 28, 2014, at 4:26 PM, Timothy McPhillips notifications@github.com wrote:

I'm going to start out with a simple rendering of the java object model for a workflow graph as a dot file (issue #12 https://github.com/yesworkflow-org/yw-prototypes/issues/12) just so I can be sure things are working.

— Reply to this email directly or view it on GitHub https://github.com/yesworkflow-org/yw-prototypes/issues/7#issuecomment-68220068.