Open dbwiddis opened 5 months ago
This is a great start @dbwiddis. Lets keep incrementing on this one and add more features/functionalities as we enhance. Thanks
Implement steps for external REST APIs (similar to ML Connectors but more general/non-ML)
Moving this step in the backlog to 2.13.0 to support https://github.com/opensearch-project/observability/issues/1805
Flow Framework Objective:
We want to introduce our customers to a new no-code/low-code builder experience (Backend RFC and Frontend RFC) that empowers users to compose AI-augmented query and ingestion flows, integrate ML models supported by ML-Commons, and streamline the OpenSearch app development experience through a drag-and-drop designer.
Builders will continue to gain the benefits of OpenSearch Machine Learning (ML) offerings with out-of-the-box AI integrations that eliminate the need for custom middleware. Builders will further benefit from unbounded AI use case support and their limitless variations through this new builder paradigm. They will be empowered to innovate faster through automations and a low-to-no-code experience. While the initial focus is on ML offerings, the framework is intended to be generic to support non-ML workflows as well.
Key to the coordination between frontend and backend are use case templates. Frontend users will use a no-code/low-code builder to generate these, but they are also accessible to backend users to automate API calls in complex workflows.
Incremental Development Plan:
With above objective in mind, we are taking an incremental approach in terms of delivery, wherein, in the first phase we are providing automated templates which would help users to create a connector, register a model, deploy it, register agents, tools etc through one API call rather than doing the complex setup of calling multiple APIs and waiting for their responses.
This issue documents current and future development plans for Flow Framework. Note that features, priorities, and milestones do frequently change, and this issue will be kept updated. We welcome community input to prioritize backlog features and participate in all phases of development.
2.12.0
2.13.0
CreateSearchPipeline
Workflow Step integrating with Search Pipelines https://github.com/opensearch-project/flow-framework/issues/545Active development priorities
CreateSearchPipeline
Workflow Step integration with Search PipelinesProcessor
interfaces for the Search Pipeline steps (pre-, post-, search phase)Processor
types as needed. Specifically there are some processors used in the Ingest Pipeline (including but not limited to conditional, etc.) that we want to add equivalent versions of.CreateIngestPipeline
Workflow StepProcessor
interface implementationsBacklog