search

SylphAI-Inc / AdalFlow

AdalFlow: The library to build & auto-optimize LLM applications.
http://adalflow.sylph.ai/
MIT License
2.25k stars 202 forks source link

AWS Bedrock integration improvement #283

Open liyin2015 opened 6 days ago

liyin2015 commented 6 days ago

Outline & Motivation

The previous integration from the community lacks these points

  1. This client needs a lot more work to be fully functional.
  2. Setup the AWS credentials instruction is unclear
  3. Access to the modelId (where to find these modelId)
  4. Convert the modelId to standard model parameter that is required by model_client with a unified interface

multi-providers

Pitch

No response

Additional context

You can refer aisuite's aws provider . This can quickly get you up to speed on the experience that we want to create

ajithvcoder commented 3 days ago

Some of the TODOs in future are

  1. Add tests for aws integration
  2. Add embedder model
  3. Add model streaming functionality