MiuLab / Taiwan-LLM

Traditional Mandarin LLMs for Taiwan
https://twllm.com
Apache License 2.0
1.23k stars 102 forks source link

GGUF #62

Open DavidWang67 opened 2 months ago

DavidWang67 commented 2 months ago

I'm trying to run local llm with this model, where can I find the gguf file of this model on huggingface?

g2david commented 1 month ago

same question.

dianyo commented 2 weeks ago

@adamlin120 If no one is currently dealing with this task, I would like to pick it up and convert the current model to GGUF format. What do you think?

Ok, i just found that there're already some of GGUF models on HF from @audreyt https://huggingface.co/audreyt