-
https://github.com/rwightman/pytorch-image-models/blob/3f9959cdd28cb959980abf81fc4cf34f32e18399/timm/models/layers/drop.py#L140
Why the result of drop_path is divided by the keep_prob?
In my op…
-
## 🚀 Feature
Allow the optimizer to decay different parameters of a model with variable weight decay rates with variable weight decay values.
## Motivation
Many recent papers, such as [NFNets](…
-
I was wondering if there is anywhere that we can have the hyperparameters for each model (specially the transformers) that can produce results close to the papers? the models are very complicated and …
-
**Describe the bug**
Running either replace_conv this code form the readme on the front page:
model = vgg16()
replace_conv(model, WSConv2d) # This repo's original implementation
replace_conv(model…
-
Hi, is the `Top-1 accuracy this implementation` reported in the README the result of your code training from scratch?
-
Normalizer Free Network, recently released:
Paper: https://arxiv.org/pdf/2102.06171.pdf
Code: https://github.com/deepmind/deepmind-research/tree/master/nfnets
Questions:
- How does it get compar…
-
Thank you for the implementation. There is a bug in: https://github.com/vballoli/nfnets-pytorch/blob/main/nfnets/models/resnet.py#L235
```python3
nn.init.kaiming_normal_(m.weight, mode='fan_out', …
-
https://github.com/vballoli/nfnets-pytorch/blob/869e8d02ce69744057b33b26de8b8b17892f8cbf/nfnets/models/resnet.py#L291
-
* 原文链接:[Google DeepMind’s NFNets Offers Deep Learning Efficiency](https://www.infoq.com/news/2021/03/deepmind-NFNets-deep-learning/)
* Markdown文件:[文件地址](https://github.com/xitu/gold-miner/blob/master…
lsvih updated
3 years ago
-
Hi. I try to use nfnets, but I get the following error.
### Error
AttributeError: 'NFNet' object has no attribute 'variant'
### environment
- Ubuntu : 18.04
- Tensorflow : version 2.3 a…