bash ./scripts/cli_demo.sh
/home/anaconda3/envs/zhongjing/lib/python3.8/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
warnings.warn(
You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the legacy (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set legacy=False. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565
/home/sun/anaconda3/envs/zhongjing/lib/python3.8/site-packages/torch/_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.get(instance, owner)()
./scripts/cli_demo.sh: line 7: 1887331 Killed CUDA_VISIBLE_DEVICES=2 python ./src/cli_demo.py --model_name_or_path /home/Zhongjing/Zhongjing-LLaMA-base --checkpoint_dir /home/Zhongjing/Zhongjing-LLaMA-lora/zhongjing_7_13/checkpoint-6000,/home/Zhongjing/Zhongjing-LLaMA-lora/zhongjing_7_26 --template ziya --repetition_penalty 1.2
The process always be killed. Can't find anything wrong.
This is my pip list, due to the repo dosen't provide the environment file, I've tried many times to make sure no library problem arised at the runtime. I also tried the torch==1.13.1, but it comes the same error.
bash ./scripts/cli_demo.sh /home/anaconda3/envs/zhongjing/lib/python3.8/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations warnings.warn( You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the
legacy(previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, setlegacy=False. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 /home/sun/anaconda3/envs/zhongjing/lib/python3.8/site-packages/torch/_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() return self.fget.get(instance, owner)() ./scripts/cli_demo.sh: line 7: 1887331 Killed CUDA_VISIBLE_DEVICES=2 python ./src/cli_demo.py --model_name_or_path /home/Zhongjing/Zhongjing-LLaMA-base --checkpoint_dir /home/Zhongjing/Zhongjing-LLaMA-lora/zhongjing_7_13/checkpoint-6000,/home/Zhongjing/Zhongjing-LLaMA-lora/zhongjing_7_26 --template ziya --repetition_penalty 1.2The process always be killed. Can't find anything wrong. This is my pip list, due to the repo dosen't provide the environment file, I've tried many times to make sure no library problem arised at the runtime. I also tried the torch==1.13.1, but it comes the same error.
accelerate 0.26.1 aiofiles 23.2.1 aiohttp 3.9.3 aiosignal 1.3.1 altair 5.2.0 annotated-types 0.6.0 anyio 4.2.0 async-timeout 4.0.3 attrs 23.2.0 certifi 2023.11.17 charset-normalizer 3.3.2 click 8.1.7 cmake 3.28.1 colorama 0.4.6 contourpy 1.1.1 cycler 0.12.1 datasets 2.16.1 dill 0.3.7 docstring-parser 0.15 exceptiongroup 1.2.0 fastapi 0.109.0 ffmpy 0.3.1 filelock 3.13.1 fonttools 4.47.2 frozenlist 1.4.1 fsspec 2023.10.0 gradio 4.16.0 gradio_client 0.8.1 h11 0.14.0 httpcore 1.0.2 httpx 0.26.0 huggingface-hub 0.20.3 idna 3.6 importlib-resources 6.1.1 jieba 0.42.1 Jinja2 3.1.3 joblib 1.3.2 jsonschema 4.21.1 jsonschema-specifications 2023.12.1 kiwisolver 1.4.5 lit 17.0.6 markdown-it-py 3.0.0 MarkupSafe 2.1.4 matplotlib 3.7.4 mdurl 0.1.2 mpmath 1.3.0 multidict 6.0.4 multiprocess 0.70.15 networkx 3.1 nltk 3.8.1 numpy 1.24.4 nvidia-cublas-cu11 11.10.3.66 nvidia-cublas-cu12 12.1.3.1 nvidia-cuda-cupti-cu11 11.7.101 nvidia-cuda-cupti-cu12 12.1.105 nvidia-cuda-nvrtc-cu11 11.7.99 nvidia-cuda-nvrtc-cu12 12.1.105 nvidia-cuda-runtime-cu11 11.7.99 nvidia-cuda-runtime-cu12 12.1.105 nvidia-cudnn-cu11 8.5.0.96 nvidia-cudnn-cu12 8.9.2.26 nvidia-cufft-cu11 10.9.0.58 nvidia-cufft-cu12 11.0.2.54 nvidia-curand-cu11 10.2.10.91 nvidia-curand-cu12 10.3.2.106 nvidia-cusolver-cu11 11.4.0.1 nvidia-cusolver-cu12 11.4.5.107 nvidia-cusparse-cu11 11.7.4.91 nvidia-cusparse-cu12 12.1.0.106 nvidia-nccl-cu11 2.14.3 nvidia-nccl-cu12 2.19.3 nvidia-nvjitlink-cu12 12.3.101 nvidia-nvtx-cu11 11.7.91 nvidia-nvtx-cu12 12.1.105 orjson 3.9.12 packaging 23.2 pandas 2.0.3 peft 0.4.0 pillow 10.2.0 pip 23.3.1 pkgutil_resolve_name 1.3.10 protobuf 4.25.2 psutil 5.9.8 pyarrow 15.0.0 pyarrow-hotfix 0.6 pydantic 2.6.0 pydantic_core 2.16.1 pydub 0.25.1 Pygments 2.17.2 pyparsing 3.1.1 python-dateutil 2.8.2 python-multipart 0.0.6 pytz 2023.4 PyYAML 6.0.1 referencing 0.33.0 regex 2023.12.25 requests 2.31.0 rich 13.7.0 rouge-chinese 1.0.3 rpds-py 0.17.1 ruff 0.1.15 safetensors 0.4.2 semantic-version 2.10.0 sentencepiece 0.1.99 setuptools 68.2.2 shellingham 1.5.4 shtab 1.6.5 six 1.16.0 sniffio 1.3.0 sse-starlette 2.0.0 starlette 0.35.1 sympy 1.12 tiktoken 0.5.2 tokenizers 0.15.1 tomlkit 0.12.0 toolz 0.12.1 torch 2.0.0 torchaudio 2.0.1 torchvision 0.15.1 tqdm 4.66.1 transformers 4.37.2 triton 2.0.0 trl 0.7.2 typer 0.9.0 typing_extensions 4.9.0 tyro 0.7.0 tzdata 2023.4 urllib3 2.2.0 uvicorn 0.27.0.post1 websockets 11.0.3 wheel 0.41.2 xxhash 3.4.1 yarl 1.9.4 zipp 3.17.0