-
## 🐛 Bug
I am trying to reproduce the results of the Language Identification task with the XLS-R model on the Voxligua107 dataset, but following the [current instructions](https://github.com/facebo…
-
Hello, I have read your paper 《Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation 》and find it interesting. I noticed that you said in the abstract
> The code w…
-
# Describe the feature
**Motivation**
There is no implementaiton of SwinV2 for semantic segmentation
**Related resources**
The original implementation is only for Image Classification.
**Addi…
rznas updated
2 years ago
-
### System Info
latest version of transformers, Colab TPU, tensorflow 2
### Who can help?
@kamalkraj @Rocketknight1 @BigBird01
### Information
- [ ] The official example scripts
- [X]…
-
hello, for CLIP knowledge distilation paper, i.e.,A Unified View of Masked Image Modeling:
when the teacher is CLIP vit-large/14 for 196's input resolution, and the student is vit-base/16 for 224's i…
-
Masked pixels arise from cosmic ray hits, artifact removal, saturation ...
The question we ask here is: do we prefer to have masked pixels interpolated upstream or do we fix them by modeling in sca…
-
### 🐛 Describe the bug
It looks odd asking for 20209.02 GiB of memory.
```bash
python benchmarks/dynamo/torchbench.py \
--accuracy --no-translation-validation --inference --bfloat16 \
…
-
Hi! I saw that there's currently a [masked language modeling `Model`](https://github.com/allenai/allennlp-models/blob/main/allennlp_models/lm/models/masked_language_model.py) over in the `allennlp-mo…
-
**Is your feature request related to a problem? Please describe.**
The next step of integrating HuggingFace into ART is to add support for the language modeling estimators. This involves creating ART…
f4str updated
11 months ago
-
I plan to implement 2 transformer models, and finally choose the one which performs the best on evaluation.
T5 (Text-to-Text Transfer Transformer) is a powerful and flexible Transformer-based languag…