bshao001 / ChatLearner

A chatbot implemented in TensorFlow based on the seq2seq model, with certain rules integrated.
Apache License 2.0
538 stars 212 forks source link

Allow Data to be gzipped and predictor to read gzipped data #71

Closed sr229 closed 5 years ago

sr229 commented 5 years ago

The recurring problem with this implementation is the Data generated can be too large (~5GB for the pre-trained). I believe we can improve this with application of gzip deflation during data training, and gzip inflation when data is going to be read.

This will be useful for applications who bases from this that has strict space requirements.

bshao001 commented 5 years ago

You can check another project of mine: https://github.com/bshao001/TF-Model-Deploy-Tutorial about how to freeze a model for deployment. Thanks.

sr229 commented 5 years ago

Thanks!