search

microsoft / Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.
MIT License
2.25k stars 226 forks source link

Missing requirements.txt from the fine-tune .md #166

Closed rdzotz closed 2 weeks ago

rdzotz commented 3 weeks ago

It appears the reference to a requirements.txt in this .md file is missing or poorly defined

md/04.Fine-tuning/FineTuning_Vision.md

`# create a new conda environment conda create -n phi3v python=3.10 conda activate phi3v

install pytorch

conda install pytorch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 pytorch-cuda=12.1 -c pytorch -c nvidia

other libraries needed to run the example code

pip install -r requirements.txt

(optional) flash attention -- Ampere+ GPUs (e.g., A100, H100)

pip install ninja MAX_JOBS=32 pip install flash-attn==2.4.2 --no-build-isolation

(optional) QLoRA -- Turing+ GPUs (e.g., RTX 8000)

pip install bitsandbytes==0.43.1`

I only find two requirements.txt in the entire repo which appear specific to other examples

leestott commented 3 weeks ago

Hi @rdzotz the requirements.txt for 4 Fine Tuning Phi-3.5 Vision is available at https://github.com/microsoft/Phi-3CookBook/tree/main/code/04.Finetuning/vision_finetuning

leestott commented 3 weeks ago

@ChenRocks please see issue above

rdzotz commented 3 weeks ago

Thanks, I don't know how I missed that.