-
I'm new to jaxline and I am having trouble figuring out the command to run experiment.py in nfnets.
I have been trying to use -
```
python3 -m nfnets.experiment --config=nfnets/experiment.py
``…
-
### 🐛 Describe the bug
```python
import torch
K1 = torch.tensor([[-0.3329024952074725, 0.0, 0.0, 0.0],
[ 0.0019572051122251537, -0.3244421706868837, 0.00000, 0.00000],
[-0.…
-
Please make sure that this is a feature request. As per our [GitHub Policy](https://github.com/tensorflow/tensorflow/blob/master/ISSUES.md), we only address code/doc bugs, performance issues, feature …
-
**System information**.
TensorFlow version (you are using): 2.8.0
Are you willing to contribute it (Yes/No) : Yes
**Describe the feature and the current behavior/state**.
Implement an option…
-
**Describe the bug**
I want to convert nfnet (eca_nfnet_l2, dm_nfnet_f3) models from pytorch to keras, so I used pytorch2keras package. Also, I tried converting the model first to onnx using torch.on…
-
Attempted mixed-precision training with [NFNets] on Colab TPUv3, ended up with a weird bug that JAX insists is some kind of an internal runtime error (its words, not mine). It's taken me days at this …
-
### 🐛 Describe the bug
Inconsistent output when using contiguous.
## Minimal example
```Python
import torch
import torch.nn as nn
import torch.nn.functional as F
class LayerNorm2d(nn.Laye…
-
## 🐛 Bug
Permuting more than two axes of a Tensor before feeding it to a checkpointed Conv2d layer causes a crash during the backward pass when CUDA is enabled. All three conditions appear to be ne…
-
### 🐛 Describe the bug
I got error with following code:
```
import torch
import torch.nn as nn
import torch.nn.functional as F
from torch.utils.checkpoint import checkpoint
class LayerNorm2…
-
Approx variants of gelu are apparently used in google's BERT / GPT-2 (`gelu_new` in [huggingface](https://github.com/huggingface/transformers/blob/master/src/transformers/activations.py#L25) and `gelu…