Tips for implementing LlaMa-Factory for new Hardwares

hiyouga / LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

https://arxiv.org/abs/2403.13372

Apache License 2.0

34.45k stars 4.25k forks source link

Tips for implementing LlaMa-Factory for new Hardwares #5460

Open EtashGuha opened 2 months ago

EtashGuha commented 2 months ago

I am trying to implement support for SambaNova RDU. Just like with NPU's, there is a torch_rdu which has the same features of torch that works well with RDU. I was wondering if there were any tips or suggestions on how to add support for new hardware? I appreciate all the help!