ctn-waterloo / modelling_ideas

Ideas for models that could be made with Nengo if anyone has time
9 stars 1 forks source link

Using Nengo to pre-train for deep net #71

Open tcstewar opened 7 years ago

tcstewar commented 7 years ago

It'd be great to have a few examples of taking a relatively hard task for deep nets to learn, implementing it in Nengo, and then using those connection weights as your starting point for deep learning.

I'm not sure what tasks, but I'm thinking something with recurrence. I saw one poster where people were feeding sequential inputs like:

( ( 3 + 4 ) - ( 7 - 2 ) )

and expecting an output of 2

That task might work, but I'm not sure it's the best example.