AlpinDale / gptq-gptj

Code for the paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers" with GPT-J implementation.
Apache License 2.0
15 stars 4 forks source link

fixy #2

Open ewof opened 1 year ago

ewof commented 1 year ago

just werks python gptj.py PygmalionAI/pygmalion-6b wikitext2 --wbits 4 --save pygmalion-6b-4bit.pt will make the pt gonna see if i can get it to work in oobagooga and interface w it