device=0 leads to AssertionError: Torch not compiled with CUDA enabled

CarperAI / cheese

Used for adaptive human in the loop evaluation of language and embedding models.

MIT License

303 stars 24 forks source link

device=0 leads to AssertionError: Torch not compiled with CUDA enabled #44

Closed aashay96 closed 1 year ago

aashay96 commented 1 year ago

Describe the bug device is preset to be GPU for instruct hf pipeline. Needs to be taken as input for line 61 and 29. Otherwise it leads to AssertionError: Torch not compiled with CUDA enabled

To Reproduce Steps to reproduce the behavior: Run instruct_hf_pipeline.py on a CPU system

Expected behavior

detect GPU or take as input the device

LouisCastricato commented 1 year ago

Thanks! Our engineers typically don't work weekends. I'll have this resolved Monday.

shahbuland commented 1 year ago

Think I've addressed in #46

aashay96 commented 1 year ago

awesome! Thanks