search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
17.88k stars 1.24k forks source link

create conda env follow Conda Installation fail #1138

Closed lastrei closed 3 weeks ago

lastrei commented 3 weeks ago 
conda create --name unsloth_env \
    python=3.11 \
    pytorch-cuda=11.8 \
    pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers \
    -y
Collecting package metadata (current_repodata.json): done
Solving environment: unsuccessful attempt using repodata from current_repodata.json, retrying with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

==> WARNING: A newer version of conda exists. <==
  current version: 23.7.2
  latest version: 24.9.1

Please update conda by running

    $ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

     conda install conda=24.9.1

## Package Plan ##

  environment location: /environment/miniconda3/envs/unsloth_env

  added / updated specs:
    - cudatoolkit
    - python=3.11
    - pytorch
    - pytorch-cuda=11.8
    - xformers

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    blas-1.0                   |              mkl           6 KB
    bzip2-1.0.8                |       h5eee18b_6         262 KB
    ca-certificates-2024.9.24  |       h06a4308_0         130 KB
    cuda-cudart-11.8.89        |                0         197 KB  nvidia
    cuda-cupti-11.8.87         |                0        25.3 MB  nvidia
    cuda-libraries-11.8.0      |                0           1 KB  nvidia
    cuda-nvrtc-11.8.89         |                0        19.1 MB  nvidia
    cuda-nvtx-11.8.86          |                0          57 KB  nvidia
    cuda-runtime-11.8.0        |                0           1 KB  nvidia
    cudatoolkit-11.7.0         |      hd8887f6_10       831.6 MB  nvidia
    filelock-3.13.1            |  py311h06a4308_0          24 KB
    gmp-6.2.1                  |       h295c915_3         544 KB
    gmpy2-2.1.2                |  py311hc9b5ff0_0         191 KB
    intel-openmp-2023.1.0      |   hdb19cb5_46306        17.2 MB
    jinja2-3.1.4               |  py311h06a4308_0         360 KB
    ld_impl_linux-64-2.40      |       h12ee557_0         710 KB
    libcublas-11.11.3.6        |                0       364.0 MB  nvidia
    libcufft-10.9.0.58         |                0       142.8 MB  nvidia
    libcufile-1.9.1.3          |                0         1.0 MB  nvidia
    libcurand-10.3.5.147       |                0        51.8 MB  nvidia
    libcusolver-11.4.1.48      |                0        96.5 MB  nvidia
    libcusparse-11.7.5.86      |                0       176.3 MB  nvidia
    libffi-3.4.4               |       h6a678d5_1         141 KB
    libnpp-11.8.0.86           |                0       147.8 MB  nvidia
    libnvjpeg-11.9.0.86        |                0         2.4 MB  nvidia
    llvm-openmp-14.0.6         |       h9e868ea_0         4.4 MB
    markupsafe-2.1.3           |  py311h5eee18b_0          25 KB
    mkl-2023.1.0               |   h213fc3f_46344       171.5 MB
    mpc-1.1.0                  |       h10f8cd9_1          90 KB
    mpfr-4.0.2                 |       hb69a4c5_1         487 KB
    mpmath-1.3.0               |  py311h06a4308_0         1.0 MB
    networkx-3.3               |  py311h06a4308_0         3.1 MB
    openssl-3.0.15             |       h5eee18b_0         5.2 MB
    pip-24.2                   |  py311h06a4308_0         2.8 MB
    python-3.11.10             |       he870216_0        32.9 MB
    pytorch-2.4.1              |py3.11_cuda11.8_cudnn9.1.0_0        1.54 GB  pytorch
    pytorch-cuda-11.8          |       h7e8668a_5           3 KB  pytorch
    pytorch-mutex-1.0          |             cuda           3 KB  pytorch
    pyyaml-6.0.2               |  py311h5eee18b_0         223 KB
    setuptools-75.1.0          |  py311h06a4308_0         2.2 MB
    sqlite-3.45.3              |       h5eee18b_0         1.2 MB
    sympy-1.13.2               |  py311h06a4308_0        15.4 MB
    tbb-2021.8.0               |       hdb19cb5_0         1.6 MB
    tk-8.6.14                  |       h39e8969_0         3.4 MB
    torchtriton-3.0.0          |            py311       233.7 MB  pytorch
    typing_extensions-4.11.0   |  py311h06a4308_0          73 KB
    tzdata-2024b               |       h04d1e81_0         115 KB
    wheel-0.44.0               |  py311h06a4308_0         145 KB
    xformers-0.0.28.post1      |py311_cu11.8.0_pyt2.4.1         6.6 MB  xformers
    xz-5.4.6                   |       h5eee18b_1         643 KB
    yaml-0.2.5                 |       h7b6447c_0          75 KB
    zlib-1.2.13                |       h5eee18b_1         111 KB
    ------------------------------------------------------------
                                           Total:        3.85 GB

The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main 
  _openmp_mutex      pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu 
  blas               pkgs/main/linux-64::blas-1.0-mkl 
  bzip2              pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6 
  ca-certificates    pkgs/main/linux-64::ca-certificates-2024.9.24-h06a4308_0 
  cuda-cudart        nvidia/linux-64::cuda-cudart-11.8.89-0 
  cuda-cupti         nvidia/linux-64::cuda-cupti-11.8.87-0 
  cuda-libraries     nvidia/linux-64::cuda-libraries-11.8.0-0 
  cuda-nvrtc         nvidia/linux-64::cuda-nvrtc-11.8.89-0 
  cuda-nvtx          nvidia/linux-64::cuda-nvtx-11.8.86-0 
  cuda-runtime       nvidia/linux-64::cuda-runtime-11.8.0-0 
  cudatoolkit        nvidia/linux-64::cudatoolkit-11.7.0-hd8887f6_10 
  filelock           pkgs/main/linux-64::filelock-3.13.1-py311h06a4308_0 
  gmp                pkgs/main/linux-64::gmp-6.2.1-h295c915_3 
  gmpy2              pkgs/main/linux-64::gmpy2-2.1.2-py311hc9b5ff0_0 
  intel-openmp       pkgs/main/linux-64::intel-openmp-2023.1.0-hdb19cb5_46306 
  jinja2             pkgs/main/linux-64::jinja2-3.1.4-py311h06a4308_0 
  ld_impl_linux-64   pkgs/main/linux-64::ld_impl_linux-64-2.40-h12ee557_0 
  libcublas          nvidia/linux-64::libcublas-11.11.3.6-0 
  libcufft           nvidia/linux-64::libcufft-10.9.0.58-0 
  libcufile          nvidia/linux-64::libcufile-1.9.1.3-0 
  libcurand          nvidia/linux-64::libcurand-10.3.5.147-0 
  libcusolver        nvidia/linux-64::libcusolver-11.4.1.48-0 
  libcusparse        nvidia/linux-64::libcusparse-11.7.5.86-0 
  libffi             pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1 
  libgcc-ng          pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1 
  libgomp            pkgs/main/linux-64::libgomp-11.2.0-h1234567_1 
  libnpp             nvidia/linux-64::libnpp-11.8.0.86-0 
  libnvjpeg          nvidia/linux-64::libnvjpeg-11.9.0.86-0 
  libstdcxx-ng       pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1 
  libuuid            pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0 
  llvm-openmp        pkgs/main/linux-64::llvm-openmp-14.0.6-h9e868ea_0 
  markupsafe         pkgs/main/linux-64::markupsafe-2.1.3-py311h5eee18b_0 
  mkl                pkgs/main/linux-64::mkl-2023.1.0-h213fc3f_46344 
  mpc                pkgs/main/linux-64::mpc-1.1.0-h10f8cd9_1 
  mpfr               pkgs/main/linux-64::mpfr-4.0.2-hb69a4c5_1 
  mpmath             pkgs/main/linux-64::mpmath-1.3.0-py311h06a4308_0 
  ncurses            pkgs/main/linux-64::ncurses-6.4-h6a678d5_0 
  networkx           pkgs/main/linux-64::networkx-3.3-py311h06a4308_0 
  openssl            pkgs/main/linux-64::openssl-3.0.15-h5eee18b_0 
  pip                pkgs/main/linux-64::pip-24.2-py311h06a4308_0 
  python             pkgs/main/linux-64::python-3.11.10-he870216_0 
  pytorch            pytorch/linux-64::pytorch-2.4.1-py3.11_cuda11.8_cudnn9.1.0_0 
  pytorch-cuda       pytorch/linux-64::pytorch-cuda-11.8-h7e8668a_5 
  pytorch-mutex      pytorch/noarch::pytorch-mutex-1.0-cuda 
  pyyaml             pkgs/main/linux-64::pyyaml-6.0.2-py311h5eee18b_0 
  readline           pkgs/main/linux-64::readline-8.2-h5eee18b_0 
  setuptools         pkgs/main/linux-64::setuptools-75.1.0-py311h06a4308_0 
  sqlite             pkgs/main/linux-64::sqlite-3.45.3-h5eee18b_0 
  sympy              pkgs/main/linux-64::sympy-1.13.2-py311h06a4308_0 
  tbb                pkgs/main/linux-64::tbb-2021.8.0-hdb19cb5_0 
  tk                 pkgs/main/linux-64::tk-8.6.14-h39e8969_0 
  torchtriton        pytorch/linux-64::torchtriton-3.0.0-py311 
  typing_extensions  pkgs/main/linux-64::typing_extensions-4.11.0-py311h06a4308_0 
  tzdata             pkgs/main/noarch::tzdata-2024b-h04d1e81_0 
  wheel              pkgs/main/linux-64::wheel-0.44.0-py311h06a4308_0 
  xformers           xformers/linux-64::xformers-0.0.28.post1-py311_cu11.8.0_pyt2.4.1 
  xz                 pkgs/main/linux-64::xz-5.4.6-h5eee18b_1 
  yaml               pkgs/main/linux-64::yaml-0.2.5-h7b6447c_0 
  zlib               pkgs/main/linux-64::zlib-1.2.13-h5eee18b_1 

Downloading and Extracting Packages

ChecksumMismatchError: Conda detected a mismatch between the expected content and downloaded content                                                                                      
for url 'https://conda.anaconda.org/pytorch/linux-64/torchtriton-3.0.0-py311.tar.bz2'.                                                                                                    
  download saved to: /environment/miniconda3/pkgs/torchtriton-3.0.0-py311.tar.bz2                                                                                                         
  expected sha256: 0c965cd1c12b728b2c9bc1dd390a7953626d0665bc009d2e35850e5db5d394d5                                                                                                       
  actual sha256: 7e10348d9b4bf28d00d3ac0d25a337686a53be0454cd0b6ffe5d3cf4d91d422b                                                                                                         

CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()                                                                                                                                                                          
CancelledError()      
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()
CancelledError()

and here is the pip list

Package                      Version
---------------------------- ------------
absl-py                      1.4.0
aiohttp                      3.7.4
aliyun-python-sdk-core       2.13.36
aliyun-python-sdk-kms        2.16.1
annotated-types              0.6.0
anyio                        3.7.1
apphub                       1.0.0
argon2-cffi                  21.3.0
argon2-cffi-bindings         21.2.0
asttokens                    2.2.1
astunparse                   1.6.3
async-timeout                3.0.1
attrs                        23.1.0
Babel                        2.12.1
backcall                     0.2.0
beautifulsoup4               4.12.2
bleach                       6.0.0
boltons                      23.0.0
brotlipy                     0.7.0
cachetools                   5.3.1
certifi                      2023.7.22
cffi                         1.15.1
chardet                      3.0.4
charset-normalizer           2.0.4
click                        7.1.2
cmake                        3.25.0
comm                         0.1.4
conda                        23.7.2
conda-content-trust          0.1.3
conda-libmamba-solver        23.5.0
conda-package-handling       2.1.0
conda_package_streaming      0.8.0
contourpy                    1.2.0
crcmod                       1.7
cryptography                 39.0.1
cycler                       0.12.1
dacite                       1.8.1
debugpy                      1.6.7
decorator                    5.1.1
defusedxml                   0.7.1
ecdsa                        0.18.0
exceptiongroup               1.1.2
executing                    1.2.0
fastapi                      0.104.1
fastjsonschema               2.18.0
featurize                    0.0.27
filelock                     3.9.0
flatbuffers                  23.5.26
fonttools                    4.44.0
gast                         0.4.0
google-auth                  2.22.0
google-auth-oauthlib         1.0.0
google-pasta                 0.2.0
grpcio                       1.56.2
gunicorn                     21.2.0
h11                          0.14.0
h5py                         3.9.0
httpcore                     0.17.3
httptools                    0.6.1
httpx                        0.24.1
idna                         2.10
imageio                      2.32.0
ipykernel                    6.25.0
ipython                      8.14.0
ipython-genutils             0.2.0
jedi                         0.19.0
Jinja2                       3.1.2
jmespath                     0.10.0
joblib                       1.3.2
json5                        0.9.14
jsonpatch                    1.32
jsonpointer                  2.1
jsonschema                   4.18.6
jsonschema-specifications    2023.7.1
jupyter_client               8.3.0
jupyter_core                 5.3.1
jupyter-server               1.24.0
jupyterlab                   3.2.9
jupyterlab-pygments          0.2.2
jupyterlab_server            2.24.0
keras                        2.13.1
kiwisolver                   1.4.5
lazy_loader                  0.3
libclang                     16.0.6
libmambapy                   1.4.1
lit                          15.0.7
Markdown                     3.4.4
MarkupSafe                   2.1.2
matplotlib                   3.8.1
matplotlib-inline            0.1.6
mistune                      3.0.1
mpmath                       1.2.1
multidict                    6.0.4
nbclassic                    0.2.8
nbclient                     0.8.0
nbconvert                    7.7.3
nbformat                     5.9.2
nest-asyncio                 1.5.7
networkx                     3.0
notebook                     6.4.12
numpy                        1.24.1
oauthlib                     3.2.2
opencv-python                4.8.1.78
opt-einsum                   3.3.0
oss2                         2.18.1
packaging                    23.0
pandas                       2.1.2
pandocfilters                1.5.0
parso                        0.8.3
pexpect                      4.8.0
pickleshare                  0.7.5
Pillow                       9.3.0
pip                          23.1.2
platformdirs                 3.10.0
pluggy                       1.0.0
prometheus-client            0.17.1
prompt-toolkit               3.0.39
protobuf                     4.23.4
psutil                       5.9.5
ptyprocess                   0.7.0
pure-eval                    0.2.2
pyasn1                       0.5.0
pyasn1-modules               0.3.0
pycosat                      0.6.4
pycparser                    2.21
pycryptodome                 3.18.0
pydantic                     2.4.2
pydantic_core                2.10.1
Pygments                     2.15.1
pyOpenSSL                    23.0.0
pyparsing                    3.1.1
PySocks                      1.7.1
python-dateutil              2.8.2
python-dotenv                1.0.0
pytz                         2023.3.post1
PyYAML                       6.0.1
pyzmq                        25.1.0
referencing                  0.30.0
requests                     2.32.3
requests-oauthlib            1.3.1
rpds-py                      0.9.2
rsa                          4.9
ruamel.yaml                  0.17.21
ruamel.yaml.clib             0.2.6
scikit-image                 0.22.0
scikit-learn                 1.3.2
scipy                        1.11.3
seaborn                      0.13.0
Send2Trash                   1.8.2
setuptools                   67.8.0
simple-uploader              0.0.15
six                          1.16.0
sniffio                      1.3.0
socksio                      1.0.0
soupsieve                    2.4.1
sshpubkeys                   3.3.1
stack-data                   0.6.2
starlette                    0.27.0
sympy                        1.11.1
tabulate                     0.8.7
tensorboard                  2.13.0
tensorboard-data-server      0.7.1
tensorflow                   2.13.0
tensorflow-estimator         2.13.0
tensorflow-io-gcs-filesystem 0.33.0
termcolor                    2.3.0
terminado                    0.17.1
threadpoolctl                3.2.0
tifffile                     2023.9.26
tinycss2                     1.2.1
toolz                        0.12.0
torch                        2.0.1+cu118
torchaudio                   2.0.2+cu118
torchvision                  0.15.2+cu118
tornado                      6.3.2
tqdm                         4.65.0
traitlets                    5.9.0
triton                       2.0.0
typing_extensions            4.8.0
tzdata                       2023.3
urllib3                      1.25.11
uvicorn                      0.23.2
uvloop                       0.19.0
watchfiles                   0.21.0
wcwidth                      0.2.5
webencodings                 0.5.1
websocket-client             1.2.1
websockets                   12.0
Werkzeug                     2.3.6
wheel                        0.38.4
workspace                    0.1.0
wrapt                        1.15.0
yarl                         1.9.2
zstandard                    0.19.0

and cuda version is here 

nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

i dont use colab,its another cloud.

buy the way , Installer guide for previous versions run well。

lastrei commented 3 weeks ago

install i use pip install "unsloth[cu121-torch240] @ git+https://github.com/unslothai/unsloth.git"

it's works

danielhanchen commented 3 weeks ago

@lastrei Apologies on the issue - glad you found a solution!