Closed wisamidris7 closed 2 months ago
> nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2024 NVIDIA Corporation Built on Fri_Jun_14_16:44:19_Pacific_Daylight_Time_2024 Cuda compilation tools, release 12.6, V12.6.20 Build cuda_12.6.r12.6/compiler.34431801_0
> pip list Package Version Editable project location ------------------------- --------------- -------------------------------------------------- accelerate 0.32.0 aiofiles 23.2.1 aiohttp 3.9.5 aiosignal 1.3.1 aiostream 0.5.2 altair 5.3.0 altgraph 0.17.4 annotated-types 0.7.0 anyio 4.3.0 asgiref 3.8.1 attrs 23.2.0 audioread 3.0.1 auto_subtitle 1.0 bitsandbytes 0.41.2.post2 blinker 1.8.2 blis 0.7.11 brotlicffi 1.1.0.0 browser-cookie3 0.19.1 cachetools 5.4.0 catalogue 2.0.10 certifi 2024.2.2 cffi 1.16.0 chardet 3.0.4 charset-normalizer 3.3.2 click 8.1.7 cloudpathlib 0.18.1 cloudscraper 1.2.71 cmake 3.29.3 colorama 0.4.6 comtypes 1.4.1 confection 0.1.5 contourpy 1.2.1 cycler 0.12.1 cymem 2.0.8 datasets 2.20.0 decorator 5.1.1 dill 0.3.8 dnspython 2.6.1 docstring_parser 0.16 einops 0.8.0 email_validator 2.1.1 fastapi 0.111.0 fastapi-cli 0.0.4 fastapi_poe 0.0.36 ffmpeg-python 0.2.0 ffmpy 0.4.0 filelock 3.13.4 fire 0.1.3 flash_attn 2.6.3 Flask 3.0.3 flask-sock 0.7.0 fonttools 4.53.1 frappe 0.0.1 frappe-bench 5.22.6 frozenlist 1.4.1 fsspec 2024.3.1 future 1.0.0 gguf 0.9.1 gitdb 4.0.11 GitPython 3.1.43 gradio 4.40.0 gradio_client 1.2.0 grpclib 0.4.7 gTTS 2.5.1 h11 0.14.0 h2 4.1.0 honcho 1.1.0 hpack 4.0.0 httpcore 1.0.5 httptools 0.6.1 httpx 0.27.0 httpx-sse 0.4.0 huggingface-hub 0.24.5 hyperframe 6.0.1 idna 2.8 importlib_resources 6.4.0 intel-openmp 2021.4.0 itsdangerous 2.2.0 jieba 0.42.1 Jinja2 3.1.4 joblib 1.4.0 jsonschema 4.23.0 jsonschema-specifications 2023.12.1 keyboard 0.13.5 kiwisolver 1.4.5 langcodes 3.4.0 language_data 1.2.0 lazy_loader 0.4 librosa 0.10.2.post1 llamafactory 0.8.4.dev0 C:\Users\Administrator\Desktop\LaMA-Factory llvmlite 0.43.0 loguru 0.7.2 lz4 4.3.3 marisa-trie 1.2.0 markdown-it-py 2.2.0 MarkupSafe 2.1.5 matplotlib 3.9.0 mdurl 0.1.2 mkl 2021.4.0 modal 0.62.181 modal-client 0.62.181 more-itertools 10.3.0 MouseInfo 0.1.3 mpmath 1.3.0 msgpack 1.0.8 multidict 6.0.5 multiprocess 0.70.16 murmurhash 1.0.10 nest-asyncio 1.6.0 networkx 3.3 nltk 3.8.1 numba 0.60.0 numpy 1.26.4 openai-whisper 20231117 opencv-python 4.9.0.80 orjson 3.10.3 outcome 1.3.0.post0 packaging 24.0 pandas 2.2.2 pefile 2023.2.7 peft 0.12.0 pillow 10.4.0 pip 24.2 platformdirs 4.2.2 poe-api 0.5.3 poe-api-wrapper 1.4.1 pooch 1.8.2 preshed 3.0.9 protobuf 4.25.4 psutil 6.0.0 pyarrow 17.0.0 pyarrow-hotfix 0.6 PyAudio 0.2.14 PyAutoGUI 0.9.54 pycparser 2.22 pycryptodome 3.20.0 pycryptodomex 3.20.0 pydantic 2.7.1 pydantic_core 2.18.2 pydeck 0.9.1 pydub 0.25.1 pygame 2.5.2 PyGetWindow 0.0.9 Pygments 2.18.0 pyinstaller 6.6.0 pyinstaller-hooks-contrib 2024.4 PyMsgBox 1.0.9 pyparsing 3.1.2 pyperclip 1.9.0 pypiwin32 223 PyRect 0.2.0 PyScreeze 0.1.30 PySocks 1.7.1 python-crontab 2.6.0 python-dateutil 2.9.0.post0 python-dotenv 1.0.1 python-multipart 0.0.9 pyttsx3 2.90 pytweening 1.2.0 pytz 2024.1 pywin32 306 pywin32-ctypes 0.2.2 PyYAML 6.0.1 quickjs 1.19.4 rarfile 4.2 referencing 0.35.1 regex 2024.4.16 requests 2.32.3 requests-toolbelt 1.0.0 rich 13.3.4 rouge-chinese 1.0.3 rpds-py 0.20.0 ruff 0.5.6 sacremoses 0.1.1 safetensors 0.4.3 scikit-learn 1.5.0 scipy 1.14.0 selenium 4.20.0 semantic-version 2.8.5 sentencepiece 0.2.0 setuptools 69.5.1 shellingham 1.5.4 shtab 1.7.1 sigtools 4.0.1 simple-websocket 1.0.0 six 1.16.0 smart-open 7.0.4 smmap 5.0.1 sniffio 1.3.1 sortedcontainers 2.4.0 soundfile 0.12.1 soxr 0.3.7 spacy 3.7.5 spacy-legacy 3.0.12 spacy-loggers 1.0.5 SpeechRecognition 3.10.4 srsly 2.4.8 sse-starlette 2.1.0 starlette 0.37.2 streamlit 1.37.1 sympy 1.12.1 synchronicity 0.6.7 tbb 2021.13.0 tenacity 8.5.0 termcolor 2.4.0 thinc 8.2.5 threadpoolctl 3.5.0 tiktoken 0.7.0 tls-client 1.0.1 tokenizers 0.19.1 toml 0.10.2 tomlkit 0.12.0 toolz 0.12.1 torch 2.2.2+cpu tornado 6.4.1 tqdm 4.66.4 transformers 4.43.4 trio 0.25.0 trio-websocket 0.11.1 trl 0.9.6 typer 0.12.3 types-certifi 2021.10.8.3 types-toml 0.10.8.20240310 typing_extensions 4.11.0 tyro 0.8.5 tzdata 2024.1 ujson 5.10.0 Unidecode 1.3.8 urllib3 2.2.2 uvicorn 0.29.0 wasabi 1.1.3 watchdog 4.0.1 watchfiles 0.21.0 weasel 0.4.1 webdriver-manager 4.0.1 websocket-client 1.8.0 websockets 12.0 Werkzeug 3.0.3 win32-setctime 1.1.0 wrapt 1.16.0 wsproto 1.2.0 xxhash 3.4.1 yarl 1.9.4
I did these commands
pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.2.post2-py3-none-win_amd64.whl pip install https://github.com/bdashore3/flash-attention/releases/download/v2.6.3/flash_attn-2.6.3+cu123torch2.3.1cxx11abiFALSE-cp312-cp312-win_amd64.whl
And It still not working
I selected the model and selected datasets and clicked Start button
No response
torch 2.2.2+cpu
Install cuda version of torch
Reminder
System Info
I did these commands
And It still not working
Reproduction
I selected the model and selected datasets and clicked Start button
Expected behavior
No response
Others
No response