modal-labs / llm-finetuning

Guide for fine-tuning Llama/Mistral/CodeLlama models and more
MIT License
539 stars 84 forks source link

Red lines for `download_and_unload_peft` #7

Closed stangirala closed 10 months ago

stangirala commented 1 year ago

Hello, I'm wondering if I missed a dependency here. I cloned the repo and imported it into pycharm and got the following red lines. Screenshot 2023-10-06 at 10 26 18 AM

gongy commented 1 year ago

To get completions you would have to install the module locally on your computer (which is not necessary).

This import works because it executes remotely (where the package is installed via the image).

mwaskom commented 10 months ago

This is something that we'd eventually like to be smoother in modal! As @gongy says for now if you wanted your local IDE to know about these libraries you'd need to install them locally — but that's not necessary to run the code on modal.