Implement LORA\QLORA for all hardware

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/

https://anarchy.ai/

MIT License

483 stars 144 forks source link

Open VictorOdede opened 1 year ago

VictorOdede commented 1 year ago

implement support for CPUs and other GPUs

sablin39 commented 1 year ago

I want to try running this based on SIMD feature on x86 CPU first. Wondering if I should do so.

VictorOdede commented 1 year ago

You can definitely give it a shot! Have you looked into this? https://pypi.org/project/loralib/

Abdevna commented 1 year ago

Hey @VictorOdede, is this issue still open?

VictorOdede commented 1 year ago

@Abdevna Yes it is!

fracapuano commented 11 months ago

Hi @VictorOdede, is this still open?