[not for land] Temp fix to make GPTQ work

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD 3-Clause "New" or "Revised" License

5.36k stars 485 forks source link

Open HDCharles opened 5 months ago

HDCharles commented 5 months ago

Stack from ghstack (oldest at bottom):

Summary: this makes gptq work

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags: