search

amaiya / onprem

A tool for running on-premises large language models with non-public data
https://amaiya.github.io/onprem
Apache License 2.0
692 stars 35 forks source link

feat: Add optional argument to specify custom path to download LLM #10

Closed rabilrbl closed 1 year ago

rabilrbl commented 1 year ago

Resolves #5

This PR will enable to pass an optional argument model_download_path for LLM and LLM.download_model to set custom path location for model download.

amaiya commented 1 year ago

In your PR, the check_model method is still always loading the model from ~/onprem_data. So, the model is never loaded from the supplied custom download location.

rabilrbl commented 1 year ago

@amaiya Fixed ✅

amaiya commented 1 year ago

Great - thanks a lot, @rabilrbl. The default download location is checked even when supplying a custom download path in the constructor. I can make these adjustments after merging. Thanks again!