-
分别跑了Qwen1.5-1.8B-Chat和Qwen-1_8B-Chat,报了类似的问题:
以Qwen1.5-1.8B-Chat举例:
使用tramsformers==4.31.0:
```
Traceback (most recent call last):
File "/data_sdb/demos/mnn-llm/models/llm-export/llm_export.py"…
-
Running the default example doesn't work:
```text
Namespace(verbose=True, batch_size_for_cuda_graph=1, chat_template='', model='.\\example-models\\phi2-int4-directml')
Loading model...
Model loa…
-
**Is your feature request related to a problem? Please describe.**
Thanks for the great work. I am using tiger's AX method to get a projection of a CT image, but what are the intrinsic and extrinsic …
-
Hi team,
any hope of providing support for phi2 in the near future?
-
### Expected behavior
The following code
```
dev1 = qml.device("lightning.qubit", wires=1)
@qml.qnode(dev1)
def circuit2(phi1, phi2):
qml.RX(phi1, wires=0)
qml.RY(phi2, wires=0)
…
-
phi2 使用 llm_demo 推理报错
```
model path is ../../llm_export/phi2-int4/llm.mnn
### model name : Phi_2
The device support i8sdot:1, support fp16:1, support i8mm: 1
Can't open file:.tempcache
Load C…
-
╰─(phi2-mps) ○ phi2-mps --model "/Users/shimura/Documents/weights.npz" --prompt "Hi how are you" --max_tokens 256
Traceback (most recent call last):
File "/Users/shimura/miniforge3/envs/phi2-mps/b…
-
### Question
I am using openai's visual encoder clip-vit-large-patch14-336, but a problem occurred: ValueError: Unknown image tower: /hy-tmp/LLaVA/clip-vit-large-patch14-336. please tell me how to so…
-
Hey, Is there a simple way to get Phi2 algo added to this?
Not sure if this hashing module helps with that process: https://github.com/kimkkikki/phi2_hashing_module
Thanks!
-
I'm getting the following error:
```
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Loading checkpoint shards: 100%|████████…