monikkinom / ner-lstm

Named Entity Recognition using multilayered bidirectional LSTM
540 stars 182 forks source link

Usage in production #15

Closed nitinmeharia closed 7 years ago

nitinmeharia commented 7 years ago

How can we use it in production. Lets say I made the model here and stored its object. Now in production when i get user's query, do we have to run tf.Session() 's run every time?

monikkinom commented 7 years ago

Yes but that would will not be very efficient. Once you have saved the trained model with the params, you can use https://tensorflow.github.io/serving/ which is Tensorflow's official solution for running models in production. Hope it answers your question.

nitinmeharia commented 7 years ago

Thanks mate. I'll read about it.