search

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.13k stars 82 forks source link

Replace all assertions in Python code with if statements #165 #166

Closed whitealpa closed 4 months ago

whitealpa commented 4 months ago

Hi all,

Please help review the pull request and suggest edits as needed.

Notes:

  1. I didn’t edit the test file.
  2. I'm not sure about the assertions that don't have any string return, so I didn't edit them. rwkv_word_tokenizer.py: line 78-79, 99 convert_pytorch_to_ggml.py: line 24 merge_lora_into_ggml.py: line 23

Signed-off-by: whitealpa saelenar@gmail.com