search

data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
229 stars 82 forks source link

Add pooling / webhook similar logic for places where status updates occur ( e.g. stacks, share verification, reapply, etc) #1377

Open TejasRGitHub opened 2 months ago

TejasRGitHub commented 2 months ago

Is your idea related to a problem? Please describe. When updating stacks ( e.g. dataset stack, environment stack ) the status of each stack is polled to see if the stack is completed with its deployment.

But for shares, when a share is processed, the UI has to be manually refreshed to get the current status. Similarly for the share verification, share reapply

Describe the solution you'd like Add common logic wherever possible to keep on fetching the current status of the task. Either keep on polling the ECS tasks which are responsible for the processes Or use someother methods

P.S. Don't attach files. Please, prefer add code snippets directly in the message body.

SofiaSazonova commented 2 months ago

@TejasRGitHub thanks, it should be a nice improvement! We need to take a closer look, how much effort it will take.