IDEA-CCNL / Fengshenbang-LM

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系,成为中文AIGC和认知智能的基础设施。
Apache License 2.0
4k stars 374 forks source link

Can not install to macOS #177

Closed FreeBlues closed 1 year ago

FreeBlues commented 1 year ago

error log:

(fsbang) ppt@pptdeMacBook-Pro Fengshenbang-LM % pip install -e .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///Users/ppt/Github/Fengshenbang-LM
  Preparing metadata (setup.py) ... done
Requirement already satisfied: transformers>=4.17.0 in /Users/ppt/miniconda/envs/fsbang/lib/python3.9/site-packages (from fengshen==0.0.1) (4.23.1)
Requirement already satisfied: datasets>=2.0.0 in /Users/ppt/miniconda/envs/fsbang/lib/python3.9/site-packages (from fengshen==0.0.1) (2.6.1)
Requirement already satisfied: pytorch_lightning>=1.5.10 in /Users/ppt/miniconda/envs/fsbang/lib/python3.9/site-packages (from fengshen==0.0.1) (1.7.7)
Collecting deepspeed==0.5.10
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (515 kB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/private/var/folders/9g/fb4nqfxs7vdgr9gsldg83dgw0000gn/T/pip-install-ejq24w8q/deepspeed_7dad7f884ad74b338479176806040179/setup.py", line 94, in <module>
          os.environ["TORCH_CUDA_ARCH_LIST"] = get_default_compute_capabilities()
        File "/private/var/folders/9g/fb4nqfxs7vdgr9gsldg83dgw0000gn/T/pip-install-ejq24w8q/deepspeed_7dad7f884ad74b338479176806040179/op_builder/builder.py", line 55, in get_default_compute_capabilities
          if torch.utils.cpp_extension.CUDA_HOME is not None and installed_cuda_version(
        File "/private/var/folders/9g/fb4nqfxs7vdgr9gsldg83dgw0000gn/T/pip-install-ejq24w8q/deepspeed_7dad7f884ad74b338479176806040179/op_builder/builder.py", line 40, in installed_cuda_version
          output = subprocess.check_output([cuda_home + "/bin/nvcc",
        File "/Users/ppt/miniconda/envs/fsbang/lib/python3.9/subprocess.py", line 424, in check_output
          return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
        File "/Users/ppt/miniconda/envs/fsbang/lib/python3.9/subprocess.py", line 505, in run
          with Popen(*popenargs, **kwargs) as process:
        File "/Users/ppt/miniconda/envs/fsbang/lib/python3.9/subprocess.py", line 951, in __init__
          self._execute_child(args, executable, preexec_fn, close_fds,
        File "/Users/ppt/miniconda/envs/fsbang/lib/python3.9/subprocess.py", line 1821, in _execute_child
          raise child_exception_type(errno_num, err_msg, err_filename)
      FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/cuda/bin/nvcc'
      No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
      [WARNING] Torch did not find cuda available, if cross-compiling or running with cpu only you can ignore this message. Adding compute capability for Pascal, Volta, and Turing (compute capabilities 6.0, 6.1, 6.2)
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
(fsbang) ppt@pptdeMacBook-Pro Fengshenbang-LM %
FreeBlues commented 1 year ago

@ganzhiruyi @GGGGGGXY It is my fault, I tried to used an invokeai Conda env to install it, and conflict. When I try to create a clean Conda env, it is OK!

I use this file test.py to test, the command is:

python3 test.py

the test.py is:

from diffusers import StableDiffusionPipeline

import torch

if torch.cuda.is_available():
    device = "cuda"
elif hasattr(torch.backends, "mps") and torch.backends.mps.is_available():
    device = "mps"
else:
    device = "cpu"

pipe = StableDiffusionPipeline.from_pretrained("IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1").to(device)

prompt = '飞流直下三千尺,油画'
image = pipe(prompt, guidance_scale=7.5, ddim_steps = 10).images[0]  
image.save("飞流.png")

The run log is:

(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % python3 test.py
Fetching 14 files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [00:24<00:00,  1.77s/it]
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 51/51 [17:02<00:00, 20.06s/it]
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % 

The image is:

飞流

Btw. the module diffusers need install manually with this line:

pip3 install diffusers 

All the installation log:

(fsbang) ppt@pptdeMacBook-Pro Github % cd Fengshenbang-LM 
(fsbang) ppt@pptdeMacBook-Pro Fengshenbang-LM % conda deactivate
(base) ppt@pptdeMacBook-Pro Fengshenbang-LM % conda create -n fsbclean
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /Users/ppt/miniconda/envs/fsbclean

Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate fsbclean
#
# To deactivate an active environment, use
#
#     $ conda deactivate

Retrieving notices: ...working... done
(base) ppt@pptdeMacBook-Pro Fengshenbang-LM % conda activate fsbclean
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % ls
LICENSE             README_en.md            fengshen            install_fengshenbang_env.md setup.py
README.md           environment-mac.yml     install.sh          pics                src
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % pip install --editable .
zsh: command not found: pip
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % pip3 install --editable .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///Users/ppt/Github/Fengshenbang-LM
  Preparing metadata (setup.py) ... done
Collecting transformers>=4.17.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/a4/df/3248eac2923ceffdf55686ff318e002b558e7c51f6a909dd870cf3185949/transformers-4.24.0-py3-none-any.whl (5.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.5/5.5 MB 1.1 MB/s eta 0:00:00
Collecting datasets>=2.0.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/7c/75/d282907e7ebd87e4b3475bc5156140465372fa451bc6cbddbefa54915d00/datasets-2.6.1-py3-none-any.whl (441 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 441.9/441.9 kB 1.4 MB/s eta 0:00:00
Collecting pytorch_lightning>=1.5.10
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/5c/6d/4719a089c57d55800ab820b4f157a354cc6f5db0d10356d53038150fd7b3/pytorch_lightning-1.8.0-py3-none-any.whl (795 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 795.8/795.8 kB 783.4 kB/s eta 0:00:00
Collecting deepspeed==0.5.10
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (515 kB)
  Preparing metadata (setup.py) ... done
Collecting jieba-fast>=0.53
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/87/6f/9c22f7b0ecc043f8e7d324e30767fdc9ce8d3cf5fd66e60823dd2b84432e/jieba_fast-0.53.tar.gz (7.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.5/7.5 MB 2.7 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Collecting jieba>=0.40.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/c6/cb/18eeb235f833b726522d7ebed54f2278ce28ba9438e3135ab0278d9792a2/jieba-0.42.1.tar.gz (19.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.2/19.2 MB 5.3 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Collecting hjson
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/1f/7f/13cd798d180af4bf4c0ceddeefba2b864a63c71645abc0308b768d67bb81/hjson-3.1.0-py3-none-any.whl (54 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.0/54.0 kB 1.5 MB/s eta 0:00:00
Collecting ninja
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/39/0b/4f30facb8a1ecd7627b62c7922480dcc1a75f52f48f75f89cad5a286be68/ninja-1.10.2.4-py2.py3-none-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl (231 kB)
Collecting numpy
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/07/08/417eabd93635695e69a18a336401b306da504dec032d537dbdc76577a569/numpy-1.23.4-cp310-cp310-macosx_10_9_x86_64.whl (18.1 MB)
Collecting packaging
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/05/8e/8de486cbd03baba4deef4142bd643a3e7bbe954a784dc1bb17142572d127/packaging-21.3-py3-none-any.whl (40 kB)
Collecting psutil
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/95/90/822c926e170e8a5769ff11edb92ac59dd523df505b5d56cad0ef3f15c325/psutil-5.9.3-cp310-cp310-macosx_10_9_x86_64.whl (242 kB)
Collecting py-cpuinfo
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/e0/a9/023730ba63db1e494a271cb018dcd361bd2c917ba7004c3e49d5daf795a2/py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Collecting torch
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b6/79/ead6840368f294497591af143980372ff956fc4c982c457a8b5610a5a1f3/torch-1.13.0-cp310-none-macosx_10_9_x86_64.whl (137.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 137.9/137.9 MB 4.0 MB/s eta 0:00:00
Collecting tqdm
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/47/bb/849011636c4da2e44f1253cd927cfb20ada4374d8b3a4e425416e84900cc/tqdm-4.64.1-py2.py3-none-any.whl (78 kB)
Collecting pyyaml>=5.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/44/e5/4fea13230bcebf24b28c0efd774a2dd65a0937a2d39e94a4503438b078ed/PyYAML-6.0-cp310-cp310-macosx_10_9_x86_64.whl (197 kB)
Collecting pandas
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/97/04/e2f55bb7fea442e27a002df165d05e0fcd4c282a3ca0da9f717f021515e8/pandas-1.5.1-cp310-cp310-macosx_10_9_x86_64.whl (12.0 MB)
Collecting responses<0.19
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/79/f3/2b3a6dc5986303b3dd1bbbcf482022acb2583c428cd23f0b6d37b1a1a519/responses-0.18.0-py3-none-any.whl (38 kB)
Collecting dill<0.3.6
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/12/ff/3b1a8f5d59600393506c64fa14d13afdfe6fe79ed65a18d64026fe9f8356/dill-0.3.5.1-py2.py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.8/95.8 kB 3.6 MB/s eta 0:00:00
Collecting aiohttp
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/9b/4c/d87f8d80a8f05a3b78dffa0fec7d103f0747140375ec02a846867119c349/aiohttp-3.8.3-cp310-cp310-macosx_10_9_x86_64.whl (358 kB)
Collecting requests>=2.19.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ca/91/6d9b8ccacd0412c08820f72cebaa4f0c0441b5cda699c90f618b6f8a1b42/requests-2.28.1-py3-none-any.whl (62 kB)
Collecting multiprocess
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b8/0c/c26b346b41bb1f81ac921fa10074a9595c22e5f99cc89c0410fc4efd5df3/multiprocess-0.70.14-py310-none-any.whl (134 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.3/134.3 kB 2.4 MB/s eta 0:00:00
Collecting pyarrow>=6.0.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/53/31/2b288532660824e04e381aed72c6f66d6a2c166e59eac9e1c426914f7968/pyarrow-10.0.0-cp310-cp310-macosx_10_14_x86_64.whl (24.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 24.6/24.6 MB 4.9 MB/s eta 0:00:00
Collecting fsspec[http]>=2021.11.1
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/4c/3d/86112db0fc482c4b11031516340e2d9978aa837ee104b4bebaaad0fae465/fsspec-2022.10.0-py3-none-any.whl (138 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 138.8/138.8 kB 4.3 MB/s eta 0:00:00
Collecting xxhash
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/62/84/489fc46b6a82fa8afebd76039554982b2ab1f984915c9ee2b96dfe1d0a31/xxhash-3.1.0-cp310-cp310-macosx_10_9_x86_64.whl (34 kB)
Collecting huggingface-hub<1.0.0,>=0.2.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/b2/2b/715a1924d470691a27b2dcdf472a9ef87f04718a897de25e68bf86ac0184/huggingface_hub-0.10.1-py3-none-any.whl (163 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.5/163.5 kB 2.4 MB/s eta 0:00:00
Collecting typing-extensions>=4.0.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/0b/8e/f1a0a5a76cfef77e1eb6004cb49e5f8d72634da638420b9ea492ce8305e8/typing_extensions-4.4.0-py3-none-any.whl (26 kB)
Collecting torchmetrics>=0.7.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6c/f1/89c4c39ebc53106179e9a636a73046aa35534c16fa4e893b329440f90247/torchmetrics-0.10.2-py3-none-any.whl (529 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 529.7/529.7 kB 4.5 MB/s eta 0:00:00
Collecting tensorboard>=2.9.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/80/49/a5ec29886ef823718c8ae54ed0b3ad7e19066b5bf21cec5038427e6a04c4/tensorboard-2.10.1-py3-none-any.whl (5.9 MB)
Collecting lightning-lite==1.8.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/23/d3/65fdfb0180643d65bbe82dfc0732e8caff9f73b1e13ab0f99a37a63a44ba/lightning_lite-1.8.0-py3-none-any.whl (136 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 136.4/136.4 kB 3.0 MB/s eta 0:00:00
Collecting lightning-utilities==0.3.*
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/8f/fc/1f4ff2bcba4e6162276cabe831a431ef14681a7158e693a5cf828dd6fa1b/lightning_utilities-0.3.0-py3-none-any.whl (15 kB)
Collecting fire
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/11/07/a119a1aa04d37bc819940d95ed7e135a7dcca1c098123a3764a6dcace9e7/fire-0.4.0.tar.gz (87 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.7/87.7 kB 2.4 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Requirement already satisfied: filelock in /usr/local/lib/python3.10/site-packages (from transformers>=4.17.0->fengshen==0.0.1) (3.8.0)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/42/5f/2d65b98159b053b28f18d68be048d0937b20ea242ecfe4bc59fe5bb25945/tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whl (3.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.8/3.8 MB 3.8 MB/s eta 0:00:00
Collecting regex!=2019.12.17
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/84/93/67595e62890fa944da394795f0425140917340d35d9cfd49672a8dc48c1a/regex-2022.10.31-cp310-cp310-macosx_10_9_x86_64.whl (293 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 293.9/293.9 kB 1.9 MB/s eta 0:00:00
Collecting aiosignal>=1.1.2
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3b/87/fe94898f2d44a93a35d5aa74671ed28094d80753a1113d68b799fab6dc22/aiosignal-1.2.0-py3-none-any.whl (8.2 kB)
Collecting async-timeout<5.0,>=4.0.0a3
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d6/c1/8991e7c5385b897b8c020cdaad718c5b087a6626d1d11a23e1ea87e325a7/async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting charset-normalizer<3.0,>=2.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/db/51/a507c856293ab05cdc1db77ff4bc1268ddd39f29e7dc4919aa497f0adbec/charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
Collecting frozenlist>=1.1.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ef/52/8fb729477f53cfd2085bc01af284e00d2a4bed9cffaed96cabcb644c8c6d/frozenlist-1.3.1-cp310-cp310-macosx_10_9_x86_64.whl (35 kB)
Collecting multidict<7.0,>=4.5
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d2/67/ef1ef8f3539642d90c77bc7c86cc7283297cd2ab100b45d7541476ef641e/multidict-6.0.2-cp310-cp310-macosx_10_9_x86_64.whl (28 kB)
Collecting yarl<2.0,>=1.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/17/72/8720b7fe90b35f7e75caa22bba1dd679ef2e0374e6907d4d584c939e20a0/yarl-1.8.1-cp310-cp310-macosx_10_9_x86_64.whl (61 kB)
Collecting attrs>=17.3.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/f2/bc/d817287d1aa01878af07c19505fafd1165cd6a119e9d0821ca1d1c20312d/attrs-22.1.0-py2.py3-none-any.whl (58 kB)
Collecting pyparsing!=3.0.5,>=2.0.2
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6c/10/a7d0fa5baea8fe7b50f448ab742f26f52b80bfca85ac2be9d35cdd9a3246/pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting idna<4,>=2.5
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/fc/34/3030de6f1370931b9dbb4dad48f6ab1015ab1d32447850b9fc94e60097be/idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6f/de/5be2e3eed8426f871b170663333a0f627fc2924cc386cd41be065e7ea870/urllib3-1.26.12-py2.py3-none-any.whl (140 kB)
Collecting certifi>=2017.4.17
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/1d/38/fa96a426e0c0e68aabc68e896584b83ad1eec779265a028e156ce509630e/certifi-2022.9.24-py3-none-any.whl (161 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/e0/68/e8ecfac5dd594b676c23a7f07ea34c197d7d69b3313afdf8ac1b0a9905a2/tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b1/0e/0636cc1448a7abc444fb1b3a63655e294e0d2d49092dc3de05241be6d43c/google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/3e/48/dd135dbb3cf16bfb923720163493cab70e7336db4b5f3103d49efa730404/tensorboard_data_server-0.6.1-py3-none-macosx_10_9_x86_64.whl (3.5 MB)
Requirement already satisfied: wheel>=0.26 in /usr/local/lib/python3.10/site-packages (from tensorboard>=2.9.1->pytorch_lightning>=1.5.10->fengshen==0.0.1) (0.37.1)
Requirement already satisfied: setuptools>=41.0.0 in /usr/local/lib/python3.10/site-packages (from tensorboard>=2.9.1->pytorch_lightning>=1.5.10->fengshen==0.0.1) (63.4.3)
Collecting werkzeug>=1.0.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c8/27/be6ddbcf60115305205de79c29004a0c6bc53cec814f733467b1bb89386d/Werkzeug-2.2.2-py3-none-any.whl (232 kB)
Collecting protobuf<3.20,>=3.9.2
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/32/27/1141a8232723dcb10a595cc0ce4321dcbbd5215300bf4acfc142343205bf/protobuf-3.19.6-py2.py3-none-any.whl (162 kB)
Collecting absl-py>=0.4
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2c/39/ba081c6f7837366a39c9286fa1bc9dbf217249df80e133f25c62b05d1a53/absl_py-1.3.0-py3-none-any.whl (124 kB)
Collecting google-auth<3,>=1.6.3
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/6a/da/e02110f71cb3fc3134bd1984ed9a531557bdf32c8c34ed1d6a2ec33f88a6/google_auth-2.14.0-py2.py3-none-any.whl (175 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 175.0/175.0 kB 805.7 kB/s eta 0:00:00
Collecting grpcio>=1.24.3
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/ed/15/51f907dfae5aea734d5047921d6da8cb3f5813828fd9b9de77a8ec8b4f31/grpcio-1.50.0-cp310-cp310-macosx_12_0_x86_64.whl (4.4 MB)
Collecting markdown>=2.6.8
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/86/be/ad281f7a3686b38dd8a307fa33210cdf2130404dfef668a37a4166d737ca/Markdown-3.4.1-py3-none-any.whl (93 kB)
Collecting multiprocess
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/fa/e6/3b9d10a3700782464eb304b6703224428404bac36d14acdb1b2a0046ade6/multiprocess-0.70.13-py310-none-any.whl (133 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 kB 1.7 MB/s eta 0:00:00
Collecting pytz>=2020.1
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/85/ac/92f998fc52a70afd7f6b788142632afb27cd60c8c782d1452b7466603332/pytz-2022.6-py2.py3-none-any.whl (498 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 498.1/498.1 kB 2.3 MB/s eta 0:00:00
Collecting python-dateutil>=2.8.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/36/7a/87837f39d0296e723bb9b62bbb257d0355c7f6128853c78955f57342a56d/python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting pyasn1-modules>=0.2.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/95/de/214830a981892a3e286c3794f41ae67a4495df1108c3da8a9f62159b9a9d/pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting six>=1.9.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting rsa<5,>=3.1.4
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/49/97/fa78e3d2f65c02c8e1268b9aba606569fe97f6c8f7c2d74394553347c145/rsa-4.9-py3-none-any.whl (34 kB)
Collecting cachetools<6.0,>=2.0.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/68/aa/5fc646cae6e997c3adf3b0a7e257cda75cff21fcba15354dffd67789b7bb/cachetools-5.2.0-py3-none-any.whl (9.3 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6f/bb/5deac77a9af870143c684ab46a7934038a53eb4aa975bc0687ed6ca2c610/requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting MarkupSafe>=2.1.1
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/8c/96/7e608e1a942232cb8c81ca24093e71e07e2bacbeb2dad62a0f82da28ed54/MarkupSafe-2.1.1-cp310-cp310-macosx_10_9_x86_64.whl (13 kB)
Collecting termcolor
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/74/03/8238272af77e4bb9323d60cf76ae26b8dd7d8e9d6522e584df70d69555e5/termcolor-2.1.0-py3-none-any.whl (5.8 kB)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/62/1e/a94a8d635fa3ce4cfc7f506003548d0a2447ae76fd5ca53932970fe3053f/pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting oauthlib>=3.0.0
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/7e/80/cab10959dc1faead58dc8384a781dfbf93cb4d33d50988f7a69f1b7c9bbe/oauthlib-3.2.2-py3-none-any.whl (151 kB)
Building wheels for collected packages: deepspeed, jieba, jieba-fast, fire
  Building wheel for deepspeed (setup.py) ... done
  Created wheel for deepspeed: filename=deepspeed-0.5.10-py3-none-any.whl size=528278 sha256=942c7188e75601899fbff73f87a78eca9e15a7105d2184147b9cca6e01ef4b04
  Stored in directory: /Users/ppt/Library/Caches/pip/wheels/0b/d2/90/e5d588399a00f92a3b888f9f43d972c553203e0ca915ef4e25
  Building wheel for jieba (setup.py) ... done
  Created wheel for jieba: filename=jieba-0.42.1-py3-none-any.whl size=19314459 sha256=45a7c287e3a4a42e80857c265969ec9fc8d142c6f4a7ba7d7556f2dd7739d323
  Stored in directory: /Users/ppt/Library/Caches/pip/wheels/b2/9b/80/7537177f75993c29af08e0d00c753724c7f06c646352be50a3
  Building wheel for jieba-fast (setup.py) ... done
  Created wheel for jieba-fast: filename=jieba_fast-0.53-cp310-cp310-macosx_12_0_x86_64.whl size=7626659 sha256=0b8733a7893b2aac4e31eecfd628da814168f6085733fc22105d2a07c858a36d
  Stored in directory: /Users/ppt/Library/Caches/pip/wheels/b7/a6/6a/af29c133874837e90c57a31784574a860321020cada522bfce
  Building wheel for fire (setup.py) ... done
  Created wheel for fire: filename=fire-0.4.0-py2.py3-none-any.whl size=115926 sha256=481a354abbfb4c28fe42be6c95c65ab0ec44f453a28800f4cb195223b023994f
  Stored in directory: /Users/ppt/Library/Caches/pip/wheels/02/db/0a/7d7cd837d82be5ac1bded9aefb47185db713703308b3327b78
Successfully built deepspeed jieba jieba-fast fire
Installing collected packages: tokenizers, tensorboard-plugin-wit, pytz, pyasn1, py-cpuinfo, ninja, jieba-fast, jieba, hjson, xxhash, urllib3, typing-extensions, tqdm, termcolor, tensorboard-data-server, six, rsa, regex, pyyaml, pyparsing, pyasn1-modules, psutil, protobuf, oauthlib, numpy, multidict, MarkupSafe, markdown, idna, fsspec, frozenlist, dill, charset-normalizer, certifi, cachetools, attrs, async-timeout, absl-py, yarl, werkzeug, torch, requests, python-dateutil, pyarrow, packaging, multiprocess, grpcio, google-auth, fire, aiosignal, torchmetrics, responses, requests-oauthlib, pandas, lightning-utilities, huggingface-hub, deepspeed, aiohttp, transformers, google-auth-oauthlib, tensorboard, lightning-lite, datasets, pytorch_lightning, fengshen
  Running setup.py develop for fengshen
Successfully installed MarkupSafe-2.1.1 absl-py-1.3.0 aiohttp-3.8.3 aiosignal-1.2.0 async-timeout-4.0.2 attrs-22.1.0 cachetools-5.2.0 certifi-2022.9.24 charset-normalizer-2.1.1 datasets-2.6.1 deepspeed-0.5.10 dill-0.3.5.1 fengshen-0.0.1 fire-0.4.0 frozenlist-1.3.1 fsspec-2022.10.0 google-auth-2.14.0 google-auth-oauthlib-0.4.6 grpcio-1.50.0 hjson-3.1.0 huggingface-hub-0.10.1 idna-3.4 jieba-0.42.1 jieba-fast-0.53 lightning-lite-1.8.0 lightning-utilities-0.3.0 markdown-3.4.1 multidict-6.0.2 multiprocess-0.70.13 ninja-1.10.2.4 numpy-1.23.4 oauthlib-3.2.2 packaging-21.3 pandas-1.5.1 protobuf-3.19.6 psutil-5.9.3 py-cpuinfo-9.0.0 pyarrow-10.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pyparsing-3.0.9 python-dateutil-2.8.2 pytorch_lightning-1.8.0 pytz-2022.6 pyyaml-6.0 regex-2022.10.31 requests-2.28.1 requests-oauthlib-1.3.1 responses-0.18.0 rsa-4.9 six-1.16.0 tensorboard-2.10.1 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 termcolor-2.1.0 tokenizers-0.13.1 torch-1.13.0 torchmetrics-0.10.2 tqdm-4.64.1 transformers-4.24.0 typing-extensions-4.4.0 urllib3-1.26.12 werkzeug-2.2.2 xxhash-3.1.0 yarl-1.8.1

[notice] A new release of pip available: 22.2.2 -> 22.3
[notice] To update, run: python3.10 -m pip install --upgrade pip
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % python3.10 -m pip install --upgrade pip
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: pip in /usr/local/lib/python3.10/site-packages (22.2.2)
Collecting pip
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/47/ef/8b5470b5b94b36231ed9c0bde90caa71c0d4322d4a15f009b2b7f4287fe0/pip-22.3-py3-none-any.whl (2.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 2.7 MB/s eta 0:00:00
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 22.2.2
    Uninstalling pip-22.2.2:
      Successfully uninstalled pip-22.2.2
Successfully installed pip-22.3
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % 

(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % python3 test.py
Traceback (most recent call last):
  File "/Users/ppt/Github/Fengshenbang-LM/test.py", line 1, in <module>
    from diffusers import StableDiffusionPipeline
ModuleNotFoundError: No module named 'diffusers'
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % pip install diffusers
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting diffusers
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/9c/57/748d846b4c82a4ccab160c0f665791217c781780c59a5f41abb9a7e9ee64/diffusers-0.6.0-py3-none-any.whl (255 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 255.4/255.4 kB 1.1 MB/s eta 0:00:00
Requirement already satisfied: filelock in /usr/local/lib/python3.10/site-packages (from diffusers) (3.8.0)
Requirement already satisfied: huggingface-hub>=0.10.0 in /usr/local/lib/python3.10/site-packages (from diffusers) (0.10.1)
Collecting Pillow<10.0
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/26/d6/9355d59a2ee9406e4d5129ff0ff99835e7f6adb6133815fab2099e1879b5/Pillow-9.3.0-cp310-cp310-macosx_10_10_x86_64.whl (3.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 4.0 MB/s eta 0:00:00
Collecting importlib-metadata
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/b5/64/ef29a63cf08f047bb7fb22ab0f1f774b87eed0bb46d067a5a524798a4af8/importlib_metadata-5.0.0-py3-none-any.whl (21 kB)
Requirement already satisfied: numpy in /usr/local/lib/python3.10/site-packages (from diffusers) (1.23.4)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/site-packages (from diffusers) (2022.10.31)
Requirement already satisfied: requests in /usr/local/lib/python3.10/site-packages (from diffusers) (2.28.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.10/site-packages (from huggingface-hub>=0.10.0->diffusers) (4.64.1)
Requirement already satisfied: packaging>=20.9 in /usr/local/lib/python3.10/site-packages (from huggingface-hub>=0.10.0->diffusers) (21.3)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/site-packages (from huggingface-hub>=0.10.0->diffusers) (4.4.0)
Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/site-packages (from huggingface-hub>=0.10.0->diffusers) (6.0)
Collecting zipp>=0.5
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/40/8a/d63273ed0fa4a3d06f77e7b043f6577d8894e95515b0c187c52e2c0efabb/zipp-3.10.0-py3-none-any.whl (6.2 kB)
Requirement already satisfied: charset-normalizer<3,>=2 in /usr/local/lib/python3.10/site-packages (from requests->diffusers) (2.1.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/site-packages (from requests->diffusers) (1.26.12)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/site-packages (from requests->diffusers) (2022.9.24)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/site-packages (from requests->diffusers) (3.4)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.10/site-packages (from packaging>=20.9->huggingface-hub>=0.10.0->diffusers) (3.0.9)
Installing collected packages: zipp, Pillow, importlib-metadata, diffusers
Successfully installed Pillow-9.3.0 diffusers-0.6.0 importlib-metadata-5.0.0 zipp-3.10.0
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % python3 test.py      
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 539/539 [00:00<00:00, 197kB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 342/342 [00:00<00:00, 278kB/s]
Downloading: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4.67k/4.67k [00:00<00:00, 4.33MB/s]
Downloading: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.22G/1.22G [06:08<00:00, 3.30MB/s]
Downloading: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 234/234 [00:00<00:00, 98.8kB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 884/884 [00:00<00:00, 432kB/s]
Downloading: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 409M/409M [02:32<00:00, 2.68MB/s]
Downloading: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 125/125 [00:00<00:00, 43.1kB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 555/555 [00:00<00:00, 257kB/s]
Downloading: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 110k/110k [00:00<00:00, 145kB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 793/793 [00:00<00:00, 246kB/s]
Downloading: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3.44G/3.44G [17:13<00:00, 3.33MB/s]
Downloading: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 571/571 [00:00<00:00, 248kB/s]
Downloading: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 335M/335M [01:07<00:00, 4.98MB/s]
Fetching 14 files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [27:47<00:00, 119.10s/it]
Traceback (most recent call last):
  File "/Users/ppt/Github/Fengshenbang-LM/test.py", line 3, in <module>
    pipe = StableDiffusionPipeline.from_pretrained("IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1").to("cuda")
  File "/usr/local/lib/python3.10/site-packages/diffusers/pipeline_utils.py", line 199, in to
    module.to(torch_device)
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 987, in to
    return self._apply(convert)
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 639, in _apply
    module._apply(fn)
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 639, in _apply
    module._apply(fn)
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 639, in _apply
    module._apply(fn)
  [Previous line repeated 1 more time]
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 662, in _apply
    param_applied = fn(param)
  File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 985, in convert
    return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
  File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 221, in _lazy_init
    raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % python3 test.py
Fetching 14 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [00:00<00:00, 2247.92it/s]
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 51/51 [15:38<00:00, 18.40s/it]
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % ls
LICENSE             environment-mac.yml     install.sh          setup.py            飞流.png
README.md           fengshen            install_fengshenbang_env.md src
README_en.md            fengshen.egg-info       pics                test.py
(fsbclean) ppt@pptdeMacBook-Pro Fengshenbang-LM % 
Peineng commented 1 year ago

This is so helpful, many thanks!