pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD 3-Clause "New" or "Revised" License

5.37k stars 488 forks source link

Open MrD005 opened 7 months ago

MrD005 commented 7 months ago

NameError: name 'InputRecorder' is not defined getting this error while create int4 and int4-gptq model

Gemini321 commented 7 months ago

'class InputRecorder' is defined at line 28: GPTQ.py after importing library lm_eval. Maybe you should check whether lm_eval is installed.

MrD005 commented 7 months ago

@Gemini321

12 i just go through this issue and solved inputRecorder issue but stuck on another problem after that