-
# **어떤 내용의 논문인가요? 👋**
Gan을 연상시키는 새로운 Pre-train 방법을 소개합니다.
# **Abstract (요약) 🕵🏻♂️**
BERT와 같은 MLM Pretrain methods 는 NLP Task에서 좋은 성능을 내고 있지만, 많은 계산량을 요구하는 단점이 있다. 이 문제를 해결하기 위해 small …
-
Hi, Tengda.
I'm trying to reimplement your promising result using the small dataset UCF101. Can you provide the hyper-parameter setting of the Table 1 in your paper? Such as input size, training epoc…
-
> self.consi_w = hparams.consistent_loss_w
if self.consi_w == 0.:
consist_loss = torch.tensor(0.).cuda()
else:
consist_loss = self.MSELoss(text_hidden, mel_hidden)
mask = text_mask.un…
-
https://github.com/mila-iqia/atari-representation-learning/blob/59f3e3b94c4a0a61a6cb63acf247dd5a8662fadd/atariari/methods/global_local_infonce.py#L110
This line is a little confusing to me. How doe…
-
Apparently, a problem with Numpy version. No obvious way to fix besides downgrading Numpy.
```
Traceback (most recent call last):
File "/home/raph/Dropbox/Mestrado/Implementations/contrastive-s…
-
I've been working on this code base for quite a while, but I have still yet to see a working example. I've played with calculating the loss function differently, all sorts of hyperparameters, and diff…
-
Hello!
I came across texar-pytorch while in the process of writing my own version of the Executor, and am really happy that someone's already done the work for it, so firstly, thanks for the excell…
-
Per the [RFC](https://github.com/tensorflow/community/blob/393dfc9e03dd4150a839de6357a26e0259aa97d6/rfcs/20181214-move-to-addons.md), we need to move [metric_losses](https://github.com/tensorflow/tens…
-
To train our relationship network using a VGG16 backbone, run
```
python tools/train_net_step_rel.py --dataset vg --cfg configs/vg/e2e_faster_rcnn_VGG16_8_epochs_vg_v3_default_node_contrastive_los…
ghost updated
5 years ago
-
Okay, so... I'm trying to implement a custom loss function in tf-keras.
My tf version is 1.13.1, my keras version is 2.2.4, my OS is Linux Mint Ubuntu 16.04, and my python version is Anaconda Pyth…