search

FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
29.77k stars 15.33k forks source link

[FEATURE] OpenSearch Credentials #1049

Open kobeisfree94 opened 11 months ago

kobeisfree94 commented 11 months ago

Hi, my team and I are trying to implement Flowise for our GenAI projects primarily on AWS environments, and was wondering if you guys have any plans to add Amazon OpenSearch Service (with AWS credentials) as a Vector Store option. The current OpenSearch Vector Store option lacks credentials as an input option, but considering the demand for Amazon OpenSearch for RAG-based projects, I figured the addition will be helpful for not just our team, but for all those trying this out.

Much Thanks!

danieldabate commented 3 months ago

I just realised I created a duplicate issue. Here is the context I got so far to help work on this issue:

How to add AWS auth is described here.

Enabling AWS authentication should be optional and access key/secret should also be optional to allow for other authentication methods as listed in AWS docs.

I have 3 possible solutions in mind:

  1. Modify currently existing component and its credentials by adding 4 optional settings: AWS Region, AWS Service, AWS Access Key and AWS Secret. If both AWS Region and AWS Service are set, AWS authentication is added to the initialisation of the OpenSearch client (with or without credentials, depending if access key and secret are set). If AWS Region or AWS Service are not set, AWS authentication is not used, leading to the same behaviour as today.

  2. Create a new component called AWS OpenSearch with 2 mandatory settings: AWS Region and AWS Service; and 2 optional settings: AWS Access Key and AWS Secret. It would be a duplicate of the current component, but with AWS authentication always mandatory (with or without credentials, depending if access key and secret are set).

  3. Two types of credentials for the existing component: OpenSearchURL and AWSOpenSearchURL. The first one will stay the same as today. The second one will have the mandatory region and service parameters, and optional access key and secret.

I like option 3.

SudhaGarimella commented 1 month ago

@danieldabate : The options that you described - which phase of development phase are they in? as of the latest Flowise release, I still can't see a way to connect to AWS Open Search using the Flowise canvas.

danieldabate commented 1 month ago

I don't think anyone is working on this at the moment.

You can anyways connect to AWS Open Search using basic credentials (username and password) with the Flowise vector store component that is called Open Search. I don't remember the necessary steps to configure AWS Open Search to do that, but you can probably find it in AWS Docs.