-
### 🚀 The feature, motivation and pitch
Parallel attention layers and MQA are introduced in PaLM [1]. The “standard” encoder layer, as currently implemented in PyTorch, follows the following struct…
-
I am attempting to fine tune and train a model to extract the fields highlighted in yellow in the sample reports here. My results are not good when testing the model and I'm looking for some guidance …
-
Hi, thanks for the great work.
I developed an autoregressive model that is somewhat similar to T2M-GPT. However, during sampling, I get better results when `if_categorical=False` compared to `if_ca…
-
As title indicates I'd be interested in understanding whether this is just for text-generation or whether it could also be used to expose the embedding function?
-
**Describe the bug**
Can't import model, running demo code
**To Reproduce**
import package
**Expected behavior**
demo run
**Screenshots**
![image](https://github.com/kyegomez/AudioFlaming…
-
### No consistency between C-contiguous and F-contiguous arrays for LinearRegression()
At least for LinearRegression() : In some edge case (when X is almost singular), there is huge difference betw…
-
Joey implements a token based batch sampler, such that every batch has roughly a similar number of tokens.
https://github.com/joeynmt/joeynmt/blob/main/joeynmt/datasets.py#L783-L820
The goals as I…
-
This might sounds like a bit of re-structuring but for the sake of future compatibility, I propose the following,
1. Move to `huggingface` trainer: This will help the repo to automatically adapt to `…
-
Appreciate the guide on [Inferencing on custom models](https://github.com/SafeAILab/EAGLE/blob/main/README.md#inference-on-custom-models).
Is there a guide on how I can train my own eagle heads on a …
-
Hello,
I saw that you used `pad`, `audio_slice_frames`, `sample_frames` but I can't understand the usage of those params. Can you explain the meanings of them?
Also, `WaveRNN` model was using pa…