use monkey patch instead of forked peft

johnsmith0031 / alpaca_lora_4bit

MIT License

533 stars 84 forks source link

use monkey patch instead of forked peft #77

Closed winglian closed 1 year ago

winglian commented 1 year ago

Feel free to dismiss this if you don't like this pattern. This PR attempts to divorce the repo from using a forked peft. The tradeoff is that upstream changes could break this repo.

johnsmith0031 commented 1 year ago

Thanks! Maybe I should also create an independent cuda kernel from the GPTQ repo.