turbot / flowpipe

Flowpipe is a cloud scripting engine. Automation and workflow to connect your clouds to the people, systems and data that matters.
https://flowpipe.io
GNU Affero General Public License v3.0
361 stars 13 forks source link

No subscribers to send message #327

Closed judell closed 10 months ago

judell commented 10 months ago

I'm seeing this intermittently in both WSL2 and vanilla Ubuntu, running flowpipe both in server and local modes.

2023-11-27T10:46:05.707-0800    INFO    No subscribers to send message  {"pubsub_uuid": "ePLGahbJ3xweUAB5ARu4q3", "message_uuid": "1178aaa2-b122-4098-9de2-6ff800ebbdf9", "topic": "event.PipelineQueue"}
[Execution] exec_clie7rann1ts03r7q1k0

It happens even on the simplest pipeline, e.g.

mod "local" {
  title = "fptest"
}

pipeline "hello" {

  step "transform" "hello_out" {
    value = "ok"
  }

  output "hello_out" {
    value = step.transform.hello_out
  }

}
judell commented 10 months ago

Sounds similar to https://github.com/turbot/flowpipe/issues/323: a pipeline nondetermistically fails to complete. But @cbruno10 does not see the "No subscribers" message I am seeing on Linux.

vhadianto commented 10 months ago

I believe the issue is caused by Flowpipe trying to run pipelines before Watermill full starts. I've changed the starting sequence in:

https://github.com/turbot/flowpipe/commit/090c69475cd1b9ad40436fb7ddf6658812c17e17 and https://github.com/turbot/flowpipe/commit/090c69475cd1b9ad40436fb7ddf6658812c17e17

judell commented 10 months ago

👏