-
Dear authors,
What is pretraining distribution of CTransPath and CHIEF? Is new CHIEF CTransPath model the same as previous one in Medical Image Analysis?
-
## 一言でいうと
2つのネットワークを使用した表現学習の提案。ネットワークはAutoEncoderの構成で、異なるAugmentationをかけた画像(view)をonlineとtargetの2種にそれぞれ入力、onlineの出力とtargetの出力が一致するよう学習する。targetは勾配からでなくonlineの移動平均で更新する。ImageNetでtop-1 74.3％を達成
…
-
## 一言でいうと
BERT(#959 )を軽量化しつつ精度も上げたという研究。Embeddingを行列分解することでパラメーター数を抑えつつ隠れ層のサイズを増やせるようにする、レイヤ間でパラメーターを共有する、連続文判定の代わりに文順序Swapを導入、の3点を実施している。
### 論文リンク
https://openreview.net/forum?id=H1eA7AEtvS…
-
Hi,
Beside [Hiera paper](https://arxiv.org/pdf/2306.00989) I have also read [WINDOW ATTENTION IS BUGGED:
HOW NOT TO INTERPOLATE POSITION EMBEDDINGS](https://arxiv.org/pdf/2311.05613) . Does this …
-
Thank you for releasing the pretraining code. As I try to reproduce it, I stumbled over some questions.
The first question regards the pre-processing, and more specifically the spacing of the data.…
-
### Motivation for the feature
[Self-supervised Learning](https://en.wikipedia.org/wiki/Self-supervised_learning) (SSL) is a hot topic in computer vision research that aims to make proper use o…
-
좋은 리뷰 감사합니다.
몇 가지 추가하면 좋겠다고 생각한 것은
1. BYOL architecture 그림을 추가하면 선행연구를 이해하기 더 좋을 것 같습니다
2. 본 논문의 중요한 idea 가 collapsing 을 막는 centering 과 sharpening 인 것 같은데, 그 방법에 대해서 조금 더 자세히 설명해주시면 더 좋을 것 같습니다.…
-
https://doi.org/10.1016/j.rse.2023.113888
-
# Simple and intuitive introduction to Self-Supervised Learning for beginners - Part 1 - Willogy.Insights
Knowledge is common. Our insights and experience on-top of them is unique
[http://localhost:…
-
Currently if you want to train and evaluate a model you run the following script:
```bash
#!/bin/bash
set -e # Exit immediately if a command exits with a non-zero status.
source $(conda info --…