tensorflow / ecosystem

Integration of TensorFlow with other open-source frameworks
Apache License 2.0
1.37k stars 392 forks source link

TensorFlow on Apache Ignite #81

Open dmitrievanthony opened 6 years ago

dmitrievanthony commented 6 years ago

Apache Ignite is a memory-centric distributed database. The goal of TensorFlow on Apache Ignite is to allow users to train and inference neural network models on a data stored in Apache Ignite utilizing all TensorFlow functionality and Apache Ignite data collocation abilities.

Our team is currently working on an Apache Ignite for this purpose, corresponding task is IGNITE-8335 in Apache JIRA. We would like to contribute our work here as well as accept any contribution.

As a first step we'd like to publish the first version of our design document. We will be grateful for any comments and remarks regarding this document and any other ideas from TensorFlow community.

pbk0 commented 5 years ago

@dmitrievanthony Does this mean that in near future Rapids which depends on Apache Arrow can support tensorflow? Currently, only PyTorch and Chainer might be supported.

dmitrievanthony commented 5 years ago

Hi, @SpikingNeurons. In case of Apache Arrow it makes sense to keep looking at https://github.com/tensorflow/tensorflow/pull/23002 pull requests (the goal of it is to add Apache Arrow support into TensorFlow).