search

flexflow / FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving
https://flexflow.readthedocs.io
Apache License 2.0
1.69k stars 224 forks source link

When the Falcon SSMs will be available #1010

Open xujinlai opened 1 year ago

xujinlai commented 1 year ago

I see Falcon is on the supported list but I noticed that the SSMs are not available currently.

When it supposed to be available? Is it a timeline there?

JackFram commented 1 year ago

As Falcon doesn't have a relatively small pre-trained model, we may need to train from scratch by ourselves. Thus, the timeline can vary from weeks to one or two months. Thx for your interest in our system!