search

aws-samples / amazon-kendra-langchain-extensions

Samples to build Generative AI applications with LangChain and Amazon Kendra
https://aws.amazon.com/blogs/machine-learning/quickly-build-high-accuracy-generative-ai-applications-on-enterprise-data-using-amazon-kendra-langchain-and-large-language-models/
MIT No Attribution
159 stars 103 forks source link

response from Llama2 and Falcon40B are truncated #37

Closed yogishpa closed 1 year ago

yogishpa commented 1 year ago

When tried with Llama2 and Falcon40B are truncated for all questions. Tried several different hyperparameters like

[model_kwargs={"max_new_tokens":1024,"max_length":512,"top_k": 50, "top_p": 0.95,"temperature":0.6,"repetition_penalty":1.2},

but this doesn't seem to be getting fixed. Please check.

MithilShah commented 1 year ago

Fixed with the latest release