[FEATURE] SageMaker Endpoint Model

[kobeisfree94]

Hi, my team and I are trying to implement Flowise for our GenAI projects. We are wondering if there is a way to invoke ChatModels/LLMs/Embeddings through AWS SageMaker Endpoints similar to how HuggingFaceInference Endpoints operate.

For example, we have subscribed to a Cohere Embedding Model via AWS Marketplace and wish to use it as our embedding model as deployed as a SageMaker Endpoint.

Thanks!

[HenryHengZJ]

welcome any contributions! docs - https://js.langchain.com/docs/modules/model_io/models/llms/integrations/aws_sagemaker

[marcelcastrobr]

Anyone working with this implementation?

[HenryHengZJ]

@marcelcastrobr nope, feel free to take a stab!