Tensor-Reloaded / Convergence

Artificial Neural Network training convergence boosting by smart data ordering
Academic Free License v3.0
0 stars 0 forks source link

Sort or sample using the loss that reaches the input layer #4

Open simi2525 opened 4 years ago

simi2525 commented 4 years ago

Instead of sorting or sampling our dataset based on the loss of the output neurons, back-propagate the loss up to the input layer, basically using how much did every input neuron contributed to the loss, and the samples with the largest mean loss on its input pixels should be given priority. (idk random thought but why not)