substratusai / images

Official Substratus Container Images
1 stars 0 forks source link

HG Model Trainer failing #29

Open nstogner opened 1 year ago

nstogner commented 1 year ago
ImportError: Using `load_in_8bit=True` requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes `pip install -i https://test.pypi.org/simple/ bitsandbytes` or pip install bitsandbytes`

Looks like load_in_8bit=True is hardcoded in the trainer: https://github.com/substratusai/images/blob/main/model-trainer-huggingface/src/train.ipynb

Are we missing an import for Accelerate?

samos123 commented 1 year ago

weird, I have never hit this issue. Maybe it's fixed already?