search

unslothai / unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
12.4k stars 805 forks source link

Offline installation of unsloth library #612

Open ogozcelik opened 4 weeks ago

ogozcelik commented 4 weeks ago

Problem

I want to install the unsloth library locally on my computer. Is there a way to do that?

Details

I have a computer that doesn't have any internet connection. I'm looking for a solution to compile this library in my venv from source such as using python setup.py install. However, the recommended command (pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git") requires a git connection to download the source code, which is unavailable on my machine.

Environment

Atomheart-Father commented 4 weeks ago

download zip and pip install the zip file

danielhanchen commented 3 weeks ago

Ye zip - weird why is there no internet connection? Company policies?