search

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.37k stars 90 forks source link

SyntaxError: invalid syntax on MacOS #109

Closed realcarlos closed 1 year ago

realcarlos commented 1 year ago

python rwkv/convert_pytorch_to_ggml.py RWKV-4-Raven-1B5-v12-Eng98%-Other2%-20230520-ctx4096.pth rwkv1B5.bin BF16 File "rwkv/convert_pytorch_to_ggml.py", line 18 def get_layer_count(state_dict: Dict[str, torch.Tensor]) -> int: ^ SyntaxError: invalid syntax

saharNooby commented 1 year ago

What's your Python version?

realcarlos commented 1 year ago

Python 3.10.9

realcarlos commented 1 year ago

python3 rwkv/chat_with_bot.py rwkv-169m-ggml-f16-new.bin. it woks, thank you.