-
Hi, I want to use num_beams for generate, but PipelineModel can't. Can you support num_beams?
Best wishes.
-
### Your current environment
```text
vllm=0.5.4
```
llm = LLM(
model=MODEL_NAME,
trust_remote_code=True,
gpu_memory_utilization=0.5,
max_model_len=2048,
tensor_paralle…
-
Look at different methods of search.
- https://github.com/google-research/google-research/tree/master/scann
- https://github.com/facebookresearch/faiss
- https://github.com/nmslib/hnswlib
- http…
-
### Icon name
spotlight
### Use cases
- I need a spotlight icon next to my Heading "Featured apps". Those apps are picked by hand. By featuring them, we put the "beam of the spotlight on thos…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Problem description
Steps to reproduce:
1. Open the uncompressed [attached test file](https://github.…
-
The network is:
```
network = {
"output": {"class": "rec", "from": "data", "unit": {
"start": {"class": "copy", "from": "prev:output"},
"slices": {"class": "slice_nd", "fr…
-
### Describe the feature request
Currently there is support for beam search for T5 model. But the 3 models (encoder, decoder, decoder_with_past) or 2 models (encoder_decoder_init, decoder) would be j…
-
- https://arxiv.org/abs/2104.05336
- 2021
ビームサーチは、自動回帰型機械翻訳モデルをデコードするための最も一般的な手法です。
ビームサーチはBLEUの点では一貫した改善をもたらしますが、モデルの尤度が高い出力を見つけることにしか関心がないため、実務者が気にする最終的なメトリックやスコアには不可知論的です。
我々の目的は、ビーム探索をより強力なメ…
e4exp updated
3 years ago
-
When setting the use_beamsearch_decode=True, it shows the ValueError: t must have statically known rank.
File "seq2seq_sleep_sleep-EDF.py", line 755, in main
run_program(hparams,FLAGS)
F…
-
I am following the pytorch implementation. I couldnt find any support for beam search decoding in either of the implementations. Does the decoding by default use beam search?