Is beam search supported?

microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Apache License 2.0

1.88k stars 176 forks source link

Open flexwang opened 11 months ago

mrwyattii commented 11 months ago

Beam search is not currently supported.

flexwang commented 11 months ago

Is the support on the roadmap?