Expose n_vocab, n_embed, n_layer to the Python interface

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

MIT License

1.37k stars 90 forks source link

Expose n_vocab, n_embed, n_layer to the Python interface #118

Closed mczk77 closed 1 year ago

mczk77 commented 1 year ago

This patch exposes the rwkv_get_n_vocab, rwkv_get_n_embed, rwkv_get_n_layer functions to the Python interface through the n_vocab, n_embed, n_layer properties of the RWKVSharedLibrary class.

saharNooby commented 1 year ago

CC @LoganDark

LoganDark commented 1 year ago

Logan isn't here right now so can't actually offer his opinion, but it looks fine to me!

saharNooby commented 1 year ago

Just was tagging you since you are working on Python API rewrite (AFAIK) :)