Closed alexec closed 1 year ago
@alexec we would love to start testing dataflow, do you maybe have some insights in what the changes will be? and how fundamental :dancers:
We're currently working a new version:
With that in mind, any testing you do with old dataflow, will be extremely instructive and helpful.
Already excited to see this unfold! Are you looking for contributors?
Also another question: Is there any aspiration to allow for batch jobs, ie reading a bounded source including fan-out and -in? Use case is finite data processing jobs, along ETL lines really.
Hello, Why is it not built in the opensource, isn't argo a CNCF project?
Hey, is this still in the works? I'm wondering if Nats streaming will still be supported?
Hey, is this still in the works? When this can be used in production?
Hey guys, any update on the re-launch date yet?
Argo 3.4 rc1 has removed dataflow pipelines from the codebase
https://github.com/argoproj/argo-workflows/issues/8998
From earlier in the thread, the idea was that it should be possible to upgrade easily .
It should be an easy migration from the older version to this version.
Will that still be the case @alexec
@edlee2121 can I please ask you to comment on this issue to give users insight into the future.
Hi all, dataflow is being reworked as part of a new project focused on operational analytics. Please check it out. https://github.com/numaproj/numaflow
Now that we have open-sourced numaflow - https://github.com/numaproj/numaflow, shall we close this issue?
~We've put Dataflow on hold as we are planning on some significant changes and redesign. Stay tuned.~
Dataflow has been rewritten and is now available as Numaflow