randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
834 stars 118 forks source link

Feature Request - Ways to add context to conversation from beginning. #24

Closed bradgillap closed 1 year ago

bradgillap commented 1 year ago

Some way to input contextual data within the web interface. Maybe through uploading documents, json files, providing lists of weblinks.

I'm not sure what's possible with the py library so please ignore if this is ridiculous as an ask.

randaller commented 1 year ago

@bradgillap ctx = """ ... here goes any text data up to 2048 tokens and your query for model to continue generation ... """