microsoft / torchscale

Foundation Architecture for (M)LLMs
https://aka.ms/GeneralAI
MIT License
3k stars 201 forks source link

Could not install fairseq #22

Closed BaohaoLiao closed 1 year ago

BaohaoLiao commented 1 year ago

When I follow your instruction to install fairseq as follow pip install git+https://github.com/shumingma/fairseq.git@moe I meet the following errors. Do you have any clue about it?

Collecting git+https://github.com/shumingma/fairseq.git@moe
  Cloning https://github.com/shumingma/fairseq.git (to revision moe) to /tmp/pip-req-build-o2u6y6uv
  Running command git clone --quiet https://github.com/shumingma/fairseq.git /tmp/pip-req-build-o2u6y6uv
  Running command git checkout -b moe --track origin/moe
  Switched to a new branch 'moe'
  Branch moe set up to track remote branch moe from origin.
  Resolved https://github.com/shumingma/fairseq.git to commit 5605b44f973b573fa09ff9acad5b6826c9bb75e3
  Running command git submodule update --init --recursive -q
  fatal: reference is not a tree: adb23324c222aad0aad89308e70302d996a5eaeb
  Unable to checkout 'adb23324c222aad0aad89308e70302d996a5eaeb' in submodule path 'fairseq/model_parallel/megatron'
  error: subprocess-exited-with-error

  × git submodule update --init --recursive -q did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× git submodule update --init --recursive -q did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
shumingma commented 1 year ago

I was unable to reproduce the errors, but found some related issues in the fairseq repo. You may try the solution here to see whether it helps.