Missing RWKV/rwkv-raven-14b from the model list?

ray-project / ray-llm

RayLLM - LLMs on Ray

https://aviary.anyscale.com

Apache License 2.0

1.22k stars 89 forks source link

Missing RWKV/rwkv-raven-14b from the model list? #7

Open PicoCreator opened 1 year ago

PicoCreator commented 1 year ago

RWKV is shown in the main readme

https://github.com/ray-project/aviary#listing-all-available-models

but is missing in the current models page

https://github.com/ray-project/aviary/tree/master/models

Yard1 commented 1 year ago

Yes, that is correct. We have had some trouble getting it to work, so it has been disabled for now (you can see enabled: false in the RWKV yaml). We will re-enable it once we can pinpoint the issue.

PicoCreator commented 1 year ago

Oh, the RWKV.yaml itself is not there (so cant see the enabled: false)

Yard1 commented 1 year ago

My bad, we must have removed it from the repo at some point! Happy to add it back in.

PicoCreator commented 1 year ago

Yes please, i would like to help debug the issue if possible (im from the RWKV community)

Yard1 commented 1 year ago

The problem was that using batch size > 1 resulted in all the responses but one turning into gibberish. We've used the Transformers integration. YAML attached: RWKV--rwkv-raven-14b.txt