-
### Feature request
Adaptive decoding balances the diversity and coherence of open-ended text generation, making it an excellent method compared to top-k, top-p, and other decoding algorithms. For mo…
-
### Feature description
Constrained beam search allows the user to exert control over the output of text generation based on forcing certain terms (like phrase table entries).
Currently beam searc…
-
### Description
ends at https://arxiv.org/pdf/2404.03626.pdf#page=6
> Other recent work focuses on using the “modeling” component from well-known compressors to do
other tasks. [34] uses the mod…
gwern updated
4 months ago
-
#### Motivation
I have set the format type to JSON whenever I use MQTTX, which I often forget, and I have to copy-paste my messages somewhere to format them.
Would LOVE for MQTTX to remember w…
V4G4X updated
1 month ago
-
For windows users, it is a little bit difficult to get started.
I have downloaded `cbird-windows-0.7.0-x86_64.zip` and extracted it locally.
Then I found this minimalistic working command line
…
-
### Feature request
Add diverse beam search decoding to Flax, an "alternative to BS that decodes a list of diverse outputs by optimising for a diversity-augmented objective", as described in the pape…
-
**Description**
It is possible that this is not a valid bug, but worth investigating. Three expressions in PR #3141 were left commented out because they don't roundtrip cleanly through pandas…
-
right now, we're using beam search as an off-the-shelf component.
It would be great that:
* the search embeds some kind of patch quality knowledge: the first patch generated should have a better…
-
The decision-making process for how many tokens to generate in response to a prompt, especially in models like ChatGPT, involves several key components designed to ensure the responses are coherent, c…
-
Hi,
Firstly, thank you for your great work. You have opened up a new single cell transformer pretraining paradigm, which is very inspiring.
I'd like to ask if the checkpoint you released was tra…