search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

Support for LLaMA #50

Open IzzetYoung opened 1 year ago

IzzetYoung commented 1 year ago

Hi,

Would it be possible to support LLaMA models? It is open and based model for some other large models, such as Alpaca.

Here's the official doc: https://huggingface.co/docs/transformers/model_doc/llama

Thanks for your great work!

zhangjunyi111 commented 1 year ago

@IzzetYoung Does it support for LLaMA now?

IzzetYoung commented 1 year ago

Unfortunately, no new version has been released until now.

teis-e commented 4 months ago

Does it support for LLaMA now?