-
# Feature request
We have been recently working on multiresolution HuBERT (https://openreview.net/forum?id=kUuKFW7DIF) which could get better performance than original HuBERT with faster speed. As …
-
## 🐛 Bug
### To Reproduce
Steps to reproduce the behavior (**always include the command you ran**):
1. Run cmd 'fairseq-hydra-train \
task.normalize=true \
common.user_dir=/mypa…
-
In data2vec.py, in line 90,
y = self.ema.model(trg, ~mask, **kwargs)['encoder_states']
shouldn't it have been,
y = self.ema.model(trg, None, **kwargs)['encoder_states'] (going by the train…
-
speechlab@speechlab-HP-Pro-Tower-400-G9-PCI-Desktop-PC:~/data2vec-aqc$ python fairseq_cli/hydra_train.py -m --config-dir examples/data2vec/config/audio/pretraining --config-name base_librispeech task.…
-
When loading the data2vec2 model using fairseq. checkpoint_utils. load_model_ensemble_and_task ([ckpt_path]), an error occurred while loading the data2vec2 model: KeyError : "_name", Could you please…
-
### Model description
You have mentioned that sfr-embedding model is supported along with all other huggingface embedding models (ref.nomic).
However, both are not working :
infinity | ERROR …
-
Hi @kabouzeid ,
Thanks for open sourcing your code. Have just 2 questions about pre-training, may be you can help)
1) What is the intuition behind the behavior that training loss first decreases a…
-
Hi,
Thank you for sharing the source code of data2vec.
However, can I request a typo correction as follows?
From: Base netowkr -> ViT
To: Base network -> ViT
When I have time for this, I pl…
-
Hi, I'm working on how to use llm2vec, it's really an interesting thing to work on!
However, in my application, I found a problem that the relationship between batch size and running time is a little…
-
We are currently working on identifying the backend versions with which we are compatible and with which we want to be compatible. These backends are PyTorch and TensorFlow. We will be considering Fla…