tensorflow / skflow

Simplified interface for TensorFlow (mimicking Scikit Learn) for Deep Learning
Apache License 2.0
3.18k stars 439 forks source link

Multi-threaded feed dict #93

Closed ilblackdragon closed 8 years ago

ilblackdragon commented 8 years ago

Currently, feed dicts are working in the same thread as main training thread, which slows down the training loop by the time it takes to process and sample record.

A better option would be to run sampling in the thread and feed into Queue and then main thread will just take full batches out of the queue.

As a performance test, would be interesting to get a match between speed of sklearn.linear_model.LogisticRegression and skflow.TensorFlowLinearClassifier.

ilblackdragon commented 8 years ago

Changing this, as it will be done a little bit differently - stay tuned in tensorflow/tensorflow.