nlintz / TensorFlow-Tutorials

Simple tutorials using Google's TensorFlow Framework
6.01k stars 1.51k forks source link

Implement Multi-Task deep learning with Tensorflow #42

Closed MammadTavakoli closed 8 years ago

MammadTavakoli commented 8 years ago

How can implement Multi-Task deep learning with Tensorflow? how can i found any sample? Multi-Task deep learning

nlintz commented 8 years ago

I think that you can simply grab out the features from the final fully conv and create separate weight matrices for each of the outputs. You'll need to make sure to set scope.reuse_variables() to equal true or else tensorflow won't let you reuse features.

tarekiraki commented 8 years ago

Hello,

I also try to implement the 'Multi Task Learning' (MTL) paradigm with Tensorflow. I would like to use a 'Multilayer Perceptron' or an 'Convolutional Neural Network'. I use a faces dataset, with labels 'gender' and 'age'. These would be my two tasks.

The MTL approach consist of two kinds of parameter:

So, how do I get two kinds of labeled data into the net? should I concatenate the two vectors? And how do I "split" the neuron and create a label-specific neuron and get two outputs from the net? How can I reuse variables? Please can you give me some hint, or an code example?

I am very grateful if you could give me some hints. Thank you very much.