tcstewar
commented
11 years ago It sounds like there's another group of 4th-year software engineering students interested in adding large-scale visualization capabilities to Nengo. Here's a random wish-list of possible features I've come up with. Anyone else want to add to the list? These would all be things for showing a running model (basically a highly souped-up interactive plots mode).
- 3D brain view: show ensembles in physical locations within a transparent 3d brain model that we can zoom around in. Bonus points if we can zoom in to see individual realistic-looking neurons (and maybe glowy zappy bits running down an axon when the neuron spikes). Basically any fancy graphics like what gets shown in movies.
- Realtime spectrographs: generate the spectrograph plots as a model runs (see the spectrograph section in http://www.sfn.org/siteobjects/published/0000BDF20016F63800FD712C30FA42DD/3C7DD4CD67C8FFD21EF726E0AA9AD416/file/8%20Purpura%20Short%20Course%20Syllabus.pdf )
- compute LFP from spikes
- compute EEG from spikes
- compute fMRI from spikes & neurotransmitter usage
- play realtime audio from LFP
- peristimulus/poststimulus time histograms: either by running multiple versions of the same model at once, or by having marked periodic events
- live versions of the time graphs used in the Spaun papers to show activity in lots of different areas and their decodings
Spaun scale models are large and adding good ways to visualize the results for long runs and complex networks would enormously help development and analysis of these kinds of models.