search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.4k stars 1.29k forks source link

Problem with installing packages and dependencies (triton in particular) #1253

Closed AllenY687 closed 2 weeks ago

AllenY687 commented 2 weeks ago

Command: pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git" Results in the following error: ERROR: Could not find a version that satisfies the requirement triton (from unsloth-zoo) (from versions: none) ERROR: No matching distribution found for triton

I tried installing triton directly with pip with the command: pip install git+https://github.com/openai/triton.git

but it resulted in the following error message:

error: subprocess-exited-with-error error: Multiple top-level packages discovered in a flat-layout: ['lib', 'cmake', 'include', 'unittest', 'third_party']. The following error message: To avoid accidental inclusion of unwanted files or directories, setuptools will not proceed with this build.

  If you are trying to create a single distribution with multiple packages
  on purpose, you should not rely on automatic discovery.
  Instead, consider the following options:

  1. set up custom discovery (`find` directive with `include` or `exclude`)
  2. use a `src-layout`
  3. explicitly set `py_modules` or `packages` with a list of names

  To find more information, look for "package discovery" on setuptools docs.

I also tried pip install triton: ERROR: Could not find a version that satisfies the requirement triton (from versions: none) ERROR: No matching distribution found for triton

AllenY687 commented 2 weeks ago

Resolved with the following thread: https://github.com/triton-lang/triton/issues/2881 There seems to be an issue between Windows and triton. In addition, I had Python 3.11 which could have contributed to dependency issues.