search

notAI-tech / deepsegment

A sentence segmenter that actually works!
http://bpraneeth.com/projects
GNU General Public License v3.0
303 stars 57 forks source link

tensorflow serving #5

Closed uriva closed 4 years ago

uriva commented 5 years ago

Hey! I want to use this with tensorflow serving but having trouble understanding how to generate an hd5 file. Any ideas how I can do that?

Thanks

bedapudi6788 commented 5 years ago

@uriva , the general process is: load the checkpoints into graph. Take a look at the graph in tensorboard and figure out the input and output nodes, export to .pb.

I am currently thinking of training a new version (with some more data). will take a look at tf serving part along with that.

guyling commented 5 years ago

Tensorflow serving does not support RNN (LSTM being an instance of which) natively since it does not support internal state memory. There are some work around nir they hamper performance

bedapudi6788 commented 5 years ago

Tensorflow serving does not support RNN (LSTM being an instance of which) natively since it does not support internal state memory.

This is not true. You are mixing up stateful RNNs (LSTMs) and stateless RNNs (LSTMs). Sequence Tagging (the general BiLSTM CRF implementation), doesn't need stateful lstms

bedapudi6788 commented 4 years ago

@uriva @guyling tf-serving is available now. Take a look at the readme.