-
## 一言でいうと
LSTMに対する正則化と最適化方法を提案した研究。様々な手法を提案しているが、再帰(h_t-1)にかかる重みに対しDropConnectをかける手法は、CuDNNLSTMなど高速だがdropout非対応のセルの外側で使用できるため、速度と正則化を両立できる。PTB/WikiText2双方で顕著な効果を確認
![image](https://user-images.g…
-
## 一言でいうと
シンプルなLSTMを言語モデル用に限界までチューニングしてみるという研究。メインの工夫は、リカレントの接続にDropConnectを適用する+SGDで更新を行う際一定期間の平均を利用するASGDを、一定間隔の性能チェックで悪化していた場合に行うようにしたNT-ASGDの2点。
### 論文リンク
https://arxiv.org/abs/1708.02182…
-
I am getting the following error:
```
Traceback (most recent call last):
File "./ocropus-rtrain", line 286, in
pcs = network.trainSequence(line,cs,update=do_update,key=fname)
File "/ho…
-
I found tf2 not support this feature
-
I ran the example in the README.md file and it doesn't look like it produced the correct results. All the reconstructions in the result directory for the experiment are just a constant mean signal (0…
-
I want to apply CQR with a customized LSTM model created with Tensorflow. However, it does not support Tensorflow models. Is there a workaround or am I missing something?
Thanks!
-
Hi @HRLTY and @afathi3,
Thanks for releasing tf3d repo.
Got some questions regarding current model architecture for 3d object detection:
* The graph layer is missing compared with paper. Why? It s…
-
Recently engaged in NLP work, has been concerned about mxnet, want to add bi-lstm CRF model, TF already has a CRF module, Hope Mxnet and gluon as soon as possible. Thank you
-
This happens every time I choose the UVR-BVE-4B_SN-44100-1 model to extract lead vocals from the background vocals. Every time I do it, this message keeps popping up before it even starts to process. …
-
### System information
Linux OpenSuse Tumbleweed
- TensorFlow installation : pip
- TensorFlow library : Tf-nightly, occurs on earlier versions too
### Code
Converting a model containing an …