search

huggingface / transformers-bloom-inference

Fast Inference Solutions for BLOOM
Apache License 2.0
561 stars 114 forks source link

beam search #73

Closed syp1997 closed 1 year ago

syp1997 commented 1 year ago

Hello, I wonder if this repo support beam search? Thanks!

mayank31398 commented 1 year ago

Hey @syp1997, right now it doesn't support beam search :)

mayank31398 commented 1 year ago

closing this