SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.96k stars 412 forks source link

Am i doing something wrong? #216

Open RealMrCactus opened 2 months ago

RealMrCactus commented 2 months ago

Prerequisites

Before submitting your question, please ensure the following:

Question Details

~/tenv/PowerInfer# python convert.py --outfile ./ReluLLaMA-70B-PowerInfer-GGUF/llama-70b-relu.powerinfer.gguf ./SparseLLM/ReluLLaMA-70B ./PowerInfer/ReluLLaMA-70B-Predictor
Traceback (most recent call last):
  File "/root/tenv/PowerInfer/convert.py", line 1308, in <module>
    main()
  File "/root/tenv/PowerInfer/convert.py", line 1193, in main
    if np.uint32(1) == np.uint32(1).newbyteorder("<"):
                       ^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: `newbyteorder` was removed from scalar types in NumPy 2.0. Use `sc.view(sc.dtype.newbyteorder(order))` instead.