[DOC]: clear Coati model format

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible

https://www.colossalai.org

Apache License 2.0

38.82k stars 4.35k forks source link

[DOC]: clear Coati model format #3353

Open binmakeswell opened 1 year ago

binmakeswell commented 1 year ago

📚 The doc issue

Currently, our load and save models involve both PyTorch and HF formats, and instructions for stage123 and inference need to be added to avoid misunderstandings and usage by users. https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat#stage1---supervised-instructs-tuning

In the case of raw LLaMAq weights, conversion to HF format is also required. https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/convert_llama_weights_to_hf.py

Issues-translate-bot commented 1 year ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Title: [DOC]: clear Coati model format