-
Hey! I want to distill a [data2vec](https://arxiv.org/abs/2202.03555) model(which is from torch.hub), following the steps of [distilling hubert](http://arxiv.org/abs/2110.01900).
According to [READM…
-
Hi there, I tried running the fast transformer on all-mpnet-base-v2 and also multi-qa-mpnet-base-cos-v1 and got an error:
Encoder=SentenceTransformer("all-mpnet-base-v2",device='cpi',quantize=True)
…
-
Hi there,
Great repo and paper. I follow the exact installation and data prep steps for Speech2C training and get this error when I run the pre_training command:
`AssertionError: number of label…
-
Why not `l.register_forward_hook(self._register_hs_hook)` here?
https://github.com/Guillem96/data2vec-vision/blob/f183fa6ebf84eafe723ee2c6c6a5b48c2b5809fb/data2vec_vision/model.py#L55
-
## ❓ Questions and Help
### Before asking:
1. search the issues.
2. search the docs.
#### What is your question?
In wav2vec2.0 and hubert, the config `task.normalize` is set to `False` …
-
Hello, thanks for a nice summary. I think we could add two more papers (at least, maybe more papers are coming...).
- https://arxiv.org/abs/2208.00449 - Clearly a following work of MAE.
- https://…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
Duplicate "transformers" dependency in the requirements of image embedding for data2vec
ht…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
Error “towhee/data2vec repo does not exist” occurs when running audio embedding
### Expected…
-
Hi, I am trying to reproduce data2vec on speech.
I found that the config of the released model you provided is inconsistent with what is stated in the documentation. And some fields are not declar…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
```
>>> import towhee
>>>
>>>
>>> towhee.dc(["Hello, world."]) \
... .text_embeddi…