-
Author information is not updated yet
References are empty.
The paper contents are so interesting! And the review gave me a good summary.
-
Hi!
I noticed the new models and zero-shot tutorials. The results look interesting. One thing I can't figure out is what exactly do you mean by "continual pretrained" checkpoint.
The term evoke…
-
![image](https://user-images.githubusercontent.com/43124010/144537827-cb5c2cdf-26ca-4106-bccb-355b72c15804.png)
![image](https://user-images.githubusercontent.com/43124010/144537877-688be103-e1cc-4a1…
-
### Model description
[CLIP-ViP](https://github.com/microsoft/XPretrain/tree/main/CLIP-ViP) is a video-language model which is based on a pre-trained image-text model [CLIP](https://openai.com/blog/c…
-
Hi, Great work! I pre-trained the network using the provided script with the full AudioSet (unbalanced + balanced), similar to BEATs and AudioMAE. So my pre-training set is slightly larger than yours …
ta012 updated
1 month ago
-
-
What would be the best way to derive embeddings from mamba models? Is there a straightforward approach or would we need a new architecture?
-
According to this [readme file](https://github.com/berlino/tensor2struct-public/blob/main/experiments/sql2nl/readme.md), I should be able to run the Pretraining step by running this line of code-
`p…
-
Hi, I performed the CPT for my domain following the [Continued Pretraining notebook](https://colab.research.google.com/drive/1tEd1FrOXWMnCU9UIvdYhs61tkxdMuKZu?usp=sharing). Now when I am trying to per…
-
- [ ] Split the EC Dataset into three datasets
- [ ] Implement the Normalization Condition as a new designed Boundary Condition (https://pytorch.org/docs/stable/generated/torch.trapz.html) could ma…