Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
27.47k stars 2.77k forks source link

feat: support for iam roles for bedrock client #2632

Open dannysteenman opened 1 week ago

dannysteenman commented 1 week ago

Pull Request Type

Relevant Issues

resolves https://github.com/Mintplex-Labs/anything-llm/issues/2588

What is in this change?

This feature includes the ability to authenticate with bedrock on aws using your iam role instead of using long term iam credentials. It should be backwards compatible with people who have setup:

AWS_BEDROCK_LLM_ACCESS_KEY_ID=
AWS_BEDROCK_LLM_ACCESS_KEY=

Additional Information

In the UI it looks like this now, default:

SCR-20241114-jaaq

when you enable the iam role:

SCR-20241114-jacj

Please verify it and let me know if you have some feedback, so I can improve it, then I can also update the docs once you're happy with the result.

Developer Validations