search

plynx-team / plynx

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
https://plynx.com
Apache License 2.0
301 stars 37 forks source link

Bug: some DAGs keep being in progress after finishing #57

Closed khaxis closed 4 years ago

khaxis commented 4 years ago

Example: https://platform.plynx.com/runs/5ee1a118062e5ffea3c9bda4

here are the logs from the worker:

INFO:root:Tick
INFO:root:Uploading output `out` - `/tmp/6050af8a-ab91-11ea-9ef5-d29c4d162f03/o_out`
INFO:root:path exists
INFO:root:/tmp/6050af8a-ab91-11ea-9ef5-d29c4d162f03/o_out
INFO:root:{'name': 'out', 'file_type': 'file', 'values': ['654e6004-ab91-11ea-9ef5-d29c4d162f03'], 'is_array': False, 'min_count': 1}
INFO:root:Pop jobs
INFO:root:Tick
INFO:root:Node 5ee1a118062e5ffea3c9bda5 `Kubernetes: numbers 1 to N` finished with status `SUCCESS`
INFO:root:Pop jobs
INFO:root:Node running status SUCCESS Kubernetes: numbers 1 to N
INFO:root:Pop jobs
INFO:root:New node found: 5ee1a118062e5ffea3c9bda7 RUNNING Only numbers 9
INFO:root:Pop jobs
INFO:root:New node found: 5ee1a118062e5ffea3c9bda6 RUNNING Sum of numbers 1 to N
INFO:root:Uploading output `filtered` - `/tmp/66e52de4-ab91-11ea-b8a9-d29c4d162f03/o_filtered`
INFO:root:path exists
INFO:root:/tmp/66e52de4-ab91-11ea-b8a9-d29c4d162f03/o_filtered
INFO:root:Uploading output `sum` - `/tmp/66e5c376-ab91-11ea-a2f8-d29c4d162f03/o_sum`
INFO:root:path exists
INFO:root:/tmp/66e5c376-ab91-11ea-a2f8-d29c4d162f03/o_sum
INFO:root:{'name': 'filtered', 'file_type': 'file', 'values': ['66f3af4a-ab91-11ea-b8a9-d29c4d162f03'], 'is_array': False, 'min_count': 1}
INFO:root:Tick
INFO:root:Node 5ee1a118062e5ffea3c9bda7 `Only numbers 9` finished with status `SUCCESS`
INFO:root:Pop jobs
INFO:root:Node running status SUCCESS Only numbers 9
INFO:root:Pop jobs
INFO:root:Tick
INFO:root:New node found: 5ee1a118062e5ffea3c9bda8 RUNNING Sum of numbers ending 9
INFO:root:{'name': 'sum', 'file_type': 'file', 'values': ['66f6575e-ab91-11ea-a2f8-d29c4d162f03'], 'is_array': False, 'min_count': 1}
INFO:root:Uploading output `sum` - `/tmp/677f41fe-ab91-11ea-b2e3-d29c4d162f03/o_sum`
INFO:root:path exists
INFO:root:/tmp/677f41fe-ab91-11ea-b2e3-d29c4d162f03/o_sum
INFO:root:Node 5ee1a118062e5ffea3c9bda6 `Sum of numbers 1 to N` finished with status `SUCCESS`
INFO:root:{'name': 'sum', 'file_type': 'file', 'values': ['6796b87a-ab91-11ea-b2e3-d29c4d162f03'], 'is_array': False, 'min_count': 1}
INFO:root:Tick
INFO:root:Node 5ee1a118062e5ffea3c9bda8 `Sum of numbers ending 9` finished with status `SUCCESS`
INFO:root:Pop jobs
INFO:root:Node running status SUCCESS Sum of numbers ending 9
INFO:root:Pop jobs
INFO:root:Pop jobs
INFO:root:Pop jobs
INFO:root:Pop jobs
khaxis commented 4 years ago

will be fixed in 1.2.5