search

aws-amplify / docs

AWS Amplify Framework Documentation
https://docs.amplify.aws
Apache License 2.0
485 stars 1.05k forks source link

It would be great for Amplify to support LLM in Predictions #5637

Open OperationalFallacy opened 1 year ago

OperationalFallacy commented 1 year ago

Describe the solution you'd like I want simple abstractions build-in in Amplify to work with LLM models like ChatGPT or AWS one when they release it.

Describe alternatives you've considered There are open source projects, they are roller coasters.

Additional context Even though LLM models have very simple APIs for inference, making useful apps is not very easy undertaking. If Amplify can offer such integration, it would be a huge boost to the ecosystem, I believe.

abdallahshaban557 commented 1 year ago

Hi @OperationalFallacy - what types of use cases are you looking to build with LLM models? We'd love to get a bit more insights into that.

OperationalFallacy commented 1 year ago

Pretty standard stuff: embeddings search, docs retrieval, chat completion calls, maintaining chat history would be super helpful.