-
### Feature request
Adaptive decoding balances the diversity and coherence of open-ended text generation, making it an excellent method compared to top-k, top-p, and other decoding algorithms. For mo…
-
### Description
ends at https://arxiv.org/pdf/2404.03626.pdf#page=6
> Other recent work focuses on using the “modeling” component from well-known compressors to do
other tasks. [34] uses the mod…
gwern updated
3 months ago
-
#### Motivation
I have set the format type to JSON whenever I use MQTTX, which I often forget, and I have to copy-paste my messages somewhere to format them.
Would LOVE for MQTTX to remember w…
-
For windows users, it is a little bit difficult to get started.
I have downloaded `cbird-windows-0.7.0-x86_64.zip` and extracted it locally.
Then I found this minimalistic working command line
…
-
### Feature description
Constrained beam search allows the user to exert control over the output of text generation based on forcing certain terms (like phrase table entries).
Currently beam searc…
-
The decision-making process for how many tokens to generate in response to a prompt, especially in models like ChatGPT, involves several key components designed to ensure the responses are coherent, c…
-
### Feature request
Add diverse beam search decoding to Flax, an "alternative to BS that decodes a list of diverse outputs by optimising for a diversity-augmented objective", as described in the pape…
-
right now, we're using beam search as an off-the-shelf component.
It would be great that:
* the search embeds some kind of patch quality knowledge: the first patch generated should have a better…
-
Institute: Oxford, Torr
URL: https://arxiv.org/pdf/1802.03803.pdf
Web:
Category: Visual Dialog
Interest: 3
-
Hi, thanks for this fantastic work.
Here is my question: I try to use BRIO in another generation task and re-implement it in Fairseq. However, I find that the performance is relatively poor after inc…