Installation issue from habana_alpha branch

mosaicml / llm-foundry

LLM training code for Databricks foundation models

https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm

Apache License 2.0

3.84k stars 503 forks source link

Installation issue from habana_alpha branch #1090

Open palash04 opened 3 months ago

palash04 commented 3 months ago

palash04 commented 3 months ago

Removed flash attn dependencies from requirements.txt, and it worked. Should it be installed for gaudi?

abhi-mosaic commented 3 months ago

That's right, the flash-attn dependenices should not be required for Gaudi. If you'd like to submit a PR to this branch editing the setup.py requirements, please go for it!