search

onnx / models

A collection of pre-trained, state-of-the-art models in the ONNX format
http://onnx.ai/models/
Apache License 2.0
7.95k stars 1.41k forks source link

Please post an ONNX LSTM model #110

Closed mathisdon closed 5 years ago

mathisdon commented 6 years ago

I have found no ONNX models containing an LSTM operator anywhere on the internet. Please post one,

prasanthpul commented 6 years ago

@guschmue I believe you have some

guschmue commented 6 years ago

let me think about something useful.

WilliamTambellini commented 5 years ago

+1 for a minimalist example onnx model with at least 1 rnn op (lstm or gru), whatever the task done by the NN. I ve seen that discussion on pytorch forum : https://discuss.pytorch.org/t/request-for-minimal-example-of-exporting-recurrent-models-rnn-lstm-gru-to-onnx/21694

mathisdon commented 5 years ago

I believe that there are no valid ONNX files in existence that contain LSTM layers. I would love to see an ONNX file containing LSTMs that can be imported into onnx-tf. I believe there are none, Would someone like to prove me wrong? I would apreciate it. Thanks

prasanthpul commented 5 years ago

Internally we have a number of LSTM and GRU models converted from TF thanks to the https://github.com/onnx/tensorflow-onnx converter. Unfortunately most of them cannot be shared externally. @mx-iao is working to identify some that can be posted to the model zoo.

guschmue commented 5 years ago

how about a mnist using lstm ?

WilliamTambellini commented 5 years ago

The "docnn" example from pytext seems to embed a lstm cell :
https://github.com/facebookresearch/pytext but the onnx export (at least for that model) is currently a little buggy : https://github.com/facebookresearch/pytext/issues/248

mathisdon commented 5 years ago

No. It has now been theee months. I do not believe that the onnx lstm spec is workable. There are no examples of a transfer from one framework to a different framework. This is not a good sign for the future of onnx.

WilliamTambellini commented 5 years ago

microsoft onnxruntime has a LSTM example : onnxruntime/onnxruntime/test/testdata/CNTK/test_LSTM.tanh.bidirectional/model.onnx https://github.com/Microsoft/onnxruntime/tree/master/onnxruntime/test/testdata/CNTK/test_LSTM.tanh.bidirectional

WilliamTambellini commented 5 years ago

Someone is trying to export the GNMT model to onnx : https://github.com/onnx/onnx/issues/1778 it s recurrent based embedding some LSTM cells. WIP...

guschmue commented 5 years ago

hm, we could try to export gnmt via tensorflow model but I think this will use dynamic lstm which uses control flow and not the lstm op.

WilliamTambellini commented 5 years ago

docnn-130.onnx.zip as obtained by running the docnn example from pytext https://github.com/facebookresearch/pytext and exporting to onnx via pytext/pytorch. There is a LSTM cell but unclear yet if needing control flow... tbc

ke1337 commented 5 years ago

Added BiDAF model, which has 5 layers of bidirectional LSTMs.