search

aws-samples / bedrock-claude-chat

AWS-native chatbot using Bedrock + Claude (+Mistral)
MIT No Attribution
698 stars 240 forks source link

[QUESTION] List of dependencies when using docker to deploy #267

Closed jeremylatorre closed 2 months ago

jeremylatorre commented 2 months ago

Just a question, when we deploy the project using cdk, we always have to download a huge amount of libraries. Since we are using only servless infrastructure and Bedrock API's, why do we need for example to download nvidia cuda library which is ~700MB or even openai lib ?

statefb commented 2 months ago

It's due to the unstructured package used for embedding ecs task. The package might want to include the minimum things to parse documents.