-
### Your GTNH Discord Username
iamworking
### Your Pack Version
nightly 593
### Your Proposal
I propose two different upgrades for the Active Transformer.
The first upgrade, "High Power Resist…
-
왜 ViT 가 잘 working 할까에 대해 연구한 논문.
[paper](https://arxiv.org/abs/2202.06709)
일반적으로 생각하는 MSA 가 좋은 이유
```
MSA 의 어떤 부분이 모델을 위해 좋을까?
==> long range dependency
MSA가 conv 처럼 동작할까?
==> MSA 가 general…
-
# Interpretable ECG Classification With 1D Vision Transformer | Yoni Gottesman
Interpretable ECG Classification With 1D Vision Transformer
[https://yonigottesman.github.io/ecg/vit/deep-learning/2023…
-
Do you have any plans to support multimodal LLMs, such as MiniGPT-4/MiniGPT v2 (https://github.com/Vision-CAIR/MiniGPT-4/) and LLaVA (https://github.com/haotian-liu/LLaVA/)? That would be a significan…
-
File "/root/.cache/torch/hub/facebookresearch_dino_main/hubconf.py", line 17, in
import vision_transformer as vits
File "/root/.cache/torch/hub/facebookresearch_dino_main/vision_transformer…
-
### 🐛 Describe the bug
Hello, I've been trying to export the dinov2 vision transformer model to onnx format and have been getting an error:
```
torch.onnx.errors.UnsupportedOperatorError: Exporti…
-
### Description of the bug | 错误描述
Bug about loading pretrained model
I can't load pretrained-model although I had to assign path containing config.json and pytorch_model.bin
Error
```
Traceback…
-
reference model is from: https://github.com/pytorch/vision/blob/main/torchvision/models/swin_transformer.py
-
- https://arxiv.org/abs/2104.14294
- 2021
本論文では,自己教師付き学習がVision Transformer (ViT)に,畳み込みネットワーク(convnets)と比較して際立った新しい特性を与えるかどうかを疑問視している.
自己教師付き手法をこのアーキテクチャに適応させると、特にうまくいくという事実に加えて、次のような見解を得た:
第1…
e4exp updated
3 years ago
-
- https://arxiv.org/abs/2103.13023
- 2021
ヴィジョン・トランスフォーマー(ViT)の事前学習は、自然な画像と人の注釈付きラベルがなくても完了できるのだろうか?
ViTの事前学習には、大規模データセットと人の注釈付きラベルに大きく依存しているように見えるが、最近の大規模データセットには、プライバシー侵害、不十分な公平性の保護、手間のかかる注釈などの…
e4exp updated
3 years ago