Closed lambdaofgod closed 1 year ago
Here is a guide: https://huggingface.co/blog/rwkv#weights-conversion
@lambdaofgod https://huggingface.co/RWKV
sgugger made huggingface class for RWKV.
Do you know by any chance how he converted the model?
I've asked him how he did it, I think it'd be great to document here how RWKV can be used in transformers. A script to convert to PyTorch like this format would make it straightforward to port your new models :)
Hi, I'm new to this huggingface transformation. I now have:
I want to convert it into a huggingface model like yours repo [https://huggingface.co/RWKV]
What should I do to become a warehouse like yours? Can you be more detailed?
@lambdaofgod https://huggingface.co/RWKV
Hi, I'm new to this huggingface transformation. I now have:
I want to convert it into a huggingface model like yours repo [https://huggingface.co/RWKV]
What should I do to become a warehouse like yours? Can you be more detailed?
sgugger made huggingface class for RWKV.
Do you know by any chance how he converted the model?
I've asked him how he did it, I think it'd be great to document here how RWKV can be used in transformers. A script to convert to PyTorch like this format would make it straightforward to port your new models :)