Is maestro planning to introduce ES to enhance search capabilities? Or use corkroach to support retrieval? - Githubissues

Netflix / maestro

Maestro: Netflix’s Workflow Orchestrator

Apache License 2.0

3.33k stars 201 forks source link

Is maestro planning to introduce ES to enhance search capabilities? Or use corkroach to support retrieval? #68

Closed bearlly closed 3 months ago

bearlly commented 3 months ago

Is maestro planning to introduce ES to enhance search capabilities? Or use corkroach to support retrieval?

jun-he commented 3 months ago

@bearlly If it is free text search, it's better to use ES. As maestro publishes a change event for any status changes of step and workflow, it is straightforward to build an ES ingestion pipeline to create a search index for those cases.

Additionally, Maestro DB is highly optimized for the execution. It is efficient to do a point query and some range queries to support some key search features related to the execution.

jun-he commented 3 months ago

@bearlly let me know if you have any additional questions before I close the issue. Thanks.