search

tlc4418 / llm_optimization

A repo for RLHF training and BoN over LLMs, with support for reward model ensembles.
https://arxiv.org/abs/2310.02743
MIT License
26 stars 1 forks source link

5 Installation Errors #3

Closed RylanSchaeffer closed 2 months ago

RylanSchaeffer commented 2 months ago

When I try following the installation instructions, I've hit several errors. Putting them here:

  1. ModuleNotFoundError: No module named 'packaging -> pip install packaging
  2. ModuleNotFoundError: No module named 'torch' -> pip install torch torchvision torchaudio
  3. Later, when I tried creating an SFT model using the pythia-70m config, I hit: accelerate: command not found
  4. After installing accelerate, ImportError: DeepSpeed is not installed => runpip3 install deepspeedor build it from source.
  5. ModuleNotFoundError: No module named 'datasets'

Is something wrong with the pyproject.toml file? Or did I do something incorrectly?

RylanSchaeffer commented 2 months ago

I might have run pip install -e . in the wrong directory :grimacing:

tlc4418 commented 1 month ago

Haha no worries, I appreciate the idea of compiling errors you found!