search

hiyouga / LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
https://arxiv.org/abs/2403.13372
Apache License 2.0
33.1k stars 4.07k forks source link

No CUDA Environment found #5113

Closed wisamidris7 closed 2 months ago

wisamidris7 commented 2 months ago

Reminder

System Info

> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Fri_Jun_14_16:44:19_Pacific_Daylight_Time_2024
Cuda compilation tools, release 12.6, V12.6.20
Build cuda_12.6.r12.6/compiler.34431801_0
> pip list
Package                   Version         Editable project location
------------------------- --------------- --------------------------------------------------
accelerate                0.32.0
aiofiles                  23.2.1
aiohttp                   3.9.5
aiosignal                 1.3.1
aiostream                 0.5.2
altair                    5.3.0
altgraph                  0.17.4
annotated-types           0.7.0
anyio                     4.3.0
asgiref                   3.8.1
attrs                     23.2.0
audioread                 3.0.1
auto_subtitle             1.0
bitsandbytes              0.41.2.post2
blinker                   1.8.2
blis                      0.7.11
brotlicffi                1.1.0.0
browser-cookie3           0.19.1
cachetools                5.4.0
catalogue                 2.0.10
certifi                   2024.2.2
cffi                      1.16.0
chardet                   3.0.4
charset-normalizer        3.3.2
click                     8.1.7
cloudpathlib              0.18.1
cloudscraper              1.2.71
cmake                     3.29.3
colorama                  0.4.6
comtypes                  1.4.1
confection                0.1.5
contourpy                 1.2.1
cycler                    0.12.1
cymem                     2.0.8
datasets                  2.20.0
decorator                 5.1.1
dill                      0.3.8
dnspython                 2.6.1
docstring_parser          0.16
einops                    0.8.0
email_validator           2.1.1
fastapi                   0.111.0
fastapi-cli               0.0.4
fastapi_poe               0.0.36
ffmpeg-python             0.2.0
ffmpy                     0.4.0
filelock                  3.13.4
fire                      0.1.3
flash_attn                2.6.3
Flask                     3.0.3
flask-sock                0.7.0
fonttools                 4.53.1
frappe                    0.0.1
frappe-bench              5.22.6
frozenlist                1.4.1
fsspec                    2024.3.1
future                    1.0.0
gguf                      0.9.1
gitdb                     4.0.11
GitPython                 3.1.43
gradio                    4.40.0
gradio_client             1.2.0
grpclib                   0.4.7
gTTS                      2.5.1
h11                       0.14.0
h2                        4.1.0
honcho                    1.1.0
hpack                     4.0.0
httpcore                  1.0.5
httptools                 0.6.1
httpx                     0.27.0
httpx-sse                 0.4.0
huggingface-hub           0.24.5
hyperframe                6.0.1
idna                      2.8
importlib_resources       6.4.0
intel-openmp              2021.4.0
itsdangerous              2.2.0
jieba                     0.42.1
Jinja2                    3.1.4
joblib                    1.4.0
jsonschema                4.23.0
jsonschema-specifications 2023.12.1
keyboard                  0.13.5
kiwisolver                1.4.5
langcodes                 3.4.0
language_data             1.2.0
lazy_loader               0.4
librosa                   0.10.2.post1
llamafactory              0.8.4.dev0      C:\Users\Administrator\Desktop\LaMA-Factory
llvmlite                  0.43.0
loguru                    0.7.2
lz4                       4.3.3
marisa-trie               1.2.0
markdown-it-py            2.2.0
MarkupSafe                2.1.5
matplotlib                3.9.0
mdurl                     0.1.2
mkl                       2021.4.0
modal                     0.62.181
modal-client              0.62.181
more-itertools            10.3.0
MouseInfo                 0.1.3
mpmath                    1.3.0
msgpack                   1.0.8
multidict                 6.0.5
multiprocess              0.70.16
murmurhash                1.0.10
nest-asyncio              1.6.0
networkx                  3.3
nltk                      3.8.1
numba                     0.60.0
numpy                     1.26.4
openai-whisper            20231117
opencv-python             4.9.0.80
orjson                    3.10.3
outcome                   1.3.0.post0
packaging                 24.0
pandas                    2.2.2
pefile                    2023.2.7
peft                      0.12.0
pillow                    10.4.0
pip                       24.2
platformdirs              4.2.2
poe-api                   0.5.3
poe-api-wrapper           1.4.1
pooch                     1.8.2
preshed                   3.0.9
protobuf                  4.25.4
psutil                    6.0.0
pyarrow                   17.0.0
pyarrow-hotfix            0.6
PyAudio                   0.2.14
PyAutoGUI                 0.9.54
pycparser                 2.22
pycryptodome              3.20.0
pycryptodomex             3.20.0
pydantic                  2.7.1
pydantic_core             2.18.2
pydeck                    0.9.1
pydub                     0.25.1
pygame                    2.5.2
PyGetWindow               0.0.9
Pygments                  2.18.0
pyinstaller               6.6.0
pyinstaller-hooks-contrib 2024.4
PyMsgBox                  1.0.9
pyparsing                 3.1.2
pyperclip                 1.9.0
pypiwin32                 223
PyRect                    0.2.0
PyScreeze                 0.1.30
PySocks                   1.7.1
python-crontab            2.6.0
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-multipart          0.0.9
pyttsx3                   2.90
pytweening                1.2.0
pytz                      2024.1
pywin32                   306
pywin32-ctypes            0.2.2
PyYAML                    6.0.1
quickjs                   1.19.4
rarfile                   4.2
referencing               0.35.1
regex                     2024.4.16
requests                  2.32.3
requests-toolbelt         1.0.0
rich                      13.3.4
rouge-chinese             1.0.3
rpds-py                   0.20.0
ruff                      0.5.6
sacremoses                0.1.1
safetensors               0.4.3
scikit-learn              1.5.0
scipy                     1.14.0
selenium                  4.20.0
semantic-version          2.8.5
sentencepiece             0.2.0
setuptools                69.5.1
shellingham               1.5.4
shtab                     1.7.1
sigtools                  4.0.1
simple-websocket          1.0.0
six                       1.16.0
smart-open                7.0.4
smmap                     5.0.1
sniffio                   1.3.1
sortedcontainers          2.4.0
soundfile                 0.12.1
soxr                      0.3.7
spacy                     3.7.5
spacy-legacy              3.0.12
spacy-loggers             1.0.5
SpeechRecognition         3.10.4
srsly                     2.4.8
sse-starlette             2.1.0
starlette                 0.37.2
streamlit                 1.37.1
sympy                     1.12.1
synchronicity             0.6.7
tbb                       2021.13.0
tenacity                  8.5.0
termcolor                 2.4.0
thinc                     8.2.5
threadpoolctl             3.5.0
tiktoken                  0.7.0
tls-client                1.0.1
tokenizers                0.19.1
toml                      0.10.2
tomlkit                   0.12.0
toolz                     0.12.1
torch                     2.2.2+cpu
tornado                   6.4.1
tqdm                      4.66.4
transformers              4.43.4
trio                      0.25.0
trio-websocket            0.11.1
trl                       0.9.6
typer                     0.12.3
types-certifi             2021.10.8.3
types-toml                0.10.8.20240310
typing_extensions         4.11.0
tyro                      0.8.5
tzdata                    2024.1
ujson                     5.10.0
Unidecode                 1.3.8
urllib3                   2.2.2
uvicorn                   0.29.0
wasabi                    1.1.3
watchdog                  4.0.1
watchfiles                0.21.0
weasel                    0.4.1
webdriver-manager         4.0.1
websocket-client          1.8.0
websockets                12.0
Werkzeug                  3.0.3
win32-setctime            1.1.0
wrapt                     1.16.0
wsproto                   1.2.0
xxhash                    3.4.1
yarl                      1.9.4

I did these commands

pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.2.post2-py3-none-win_amd64.whl
pip install https://github.com/bdashore3/flash-attention/releases/download/v2.6.3/flash_attn-2.6.3+cu123torch2.3.1cxx11abiFALSE-cp312-cp312-win_amd64.whl

And It still not working

Reproduction

I selected the model and selected datasets and clicked Start button

Expected behavior

No response

Others

No response

hiyouga commented 2 months ago

torch 2.2.2+cpu

Install cuda version of torch