Locutusque / TPU-Alignment

Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
Apache License 2.0
217 stars 22 forks source link

Axolotl #4

Closed fakerybakery closed 7 months ago

fakerybakery commented 7 months ago

Hi, Great project - do you know if there's any possibility of integrating this into Axolotl? Thanks!

Locutusque commented 7 months ago

Hello, thanks for your interest! I'm not very fond with Axolotl, I typically write my on training scripts. You can try opening an issue linking to this on their repository, I'd be willing to collaborate with Axolotl's developers to implement TPU support.

fakerybakery commented 7 months ago

OK, thanks!