Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
19.39k stars 982 forks source link

Porting "Inplace Upgrading Of Llamafiles Engine Bash Script" to llamafile for general usage #411

Closed mofosyne closed 4 months ago

mofosyne commented 4 months ago

Written a bash script in https://briankhuu.com/blog/2024/04/06/inplace-upgrading-of-llamafiles-engine-bash-script/ to help upgrade in place older llamafiles with newer llamafile engines. We may want to port and adapt this into something more robust for common usage in llamafile repo.

Impulse for this issue

jart made a quick tutorial in https://github.com/Mozilla-Ocho/llamafile/issues/24 to do something similar. Alerted about this script, she suggested to add it to llamafile repo. Suggested to place into build directory. Suggest to use llamafile-convert as inspiration on coding style and approach. (Preference to be compatible with almquist (posix) shell).


Status: