How to convert ProSparse-LLaMA-2-13B model to .gguf?

[Graysonicc]

Prerequisites

Before submitting your question, please ensure the following:

• [x] I am running the latest version of PowerInfer. Development is rapid, and as of now, there are no tagged versions.
• [x] I have carefully read and followed the instructions in the README.md.
• [x] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).

Question Details

Please provide a clear and concise description of your question. If applicable, include steps to reproduce the issue or behaviors you've observed.

Additional Context

Please provide any additional information that may be relevant to your question, such as specific system configurations, environment details, or any other context that could be helpful in addressing your inquiry.

[Graysonicc]

python convert.py --outfile ./llama_convert/prosparse-llama-2-13b.powerinfer.gguf ./prosparse-llama-2-13b ./prosparse-llama-2-13b-predictor Model architecture True is not supported by this convert.py. Trying with convert-hf-to-powerinfer-gguf.py... Loading model: prosparse-llama-2-13b Traceback (most recent call last): File "/root/autodl-tmp/powerinfer/PowerInfer/convert-hf-to-powerinfer-gguf.py", line 609, in model_class = Model.from_model_architecture(hparams["architectures"][0]) File "/root/autodl-tmp/powerinfer/PowerInfer/convert-hf-to-powerinfer-gguf.py", line 189, in from_model_architecture raise NotImplementedError(f'Architecture "{model_architecture}" not supported!') NotImplementedError: Architecture "SparseLlamaForCausalLM" not supported!

[Graysonicc]

![Uploading @YSU)%~3F0F[]DI%4LW_COM.png…]()

[baibizhe]

Hello. Have you solve this bug ?