DenseNet in this benchmark has "naive" implementaiton, will underperform

tensorflow / benchmarks

A benchmark framework for Tensorflow

Apache License 2.0

1.14k stars 630 forks source link

DenseNet in this benchmark has "naive" implementaiton, will underperform #93

Open ahundt opened 6 years ago

ahundt commented 6 years ago

At the time of writing, DenseNet is implemented in this benchmark with what is described as the "naive" implementation in Memory-Efficient Implementation of DenseNets. This will under perform compared to the ideal implementation because recursive tf.concat will lead to excessive memory usage.

Details are in the upstream tf issuse https://github.com/tensorflow/tensorflow/issues/12948.

bignamehyp commented 6 years ago

We currently don't have anybody working on this. It would be great if you could help us by working on this and submitting a PR. Let us know if you need further clarification. Thanks!