Can convert chatGLM to gguf?

lmstudio-ai / model-catalog

A collection of standardized JSON descriptors for Large Language Model (LLM) files.

Apache License 2.0

789 stars 87 forks source link

Can convert chatGLM to gguf? #44

Open xh542428798 opened 10 months ago

xh542428798 commented 10 months ago

Sir, I have a model want to use in lm studio, chatGLM. Can you help me convert it to gguf, the link is : https://huggingface.co/ayoolaolafenwa/ChatLM/tree/main It seem be a pytorch model. Or, can you tell me how I can convert it? I am a new learner. Thank you very much.

manish-baghel commented 9 months ago

@xh542428798 You can use llama.cpp for this purpose

Install instructions - https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#get-the-code Convert instructions - https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#prepare-data--run

johndpope commented 8 months ago

close this ticket.