ins-amu / vbjax

A nascent Jax-based package for virtual brain modeling.
Apache License 2.0
6 stars 2 forks source link

Add example w/ semantic decoding w/ neural field #53

Open maedoc opened 7 months ago

maedoc commented 7 months ago

This is a use case brainstormed during the brain hack in Marseille w/ someone who's name is ftm forgotten.

If instead of neural field it was a transformer, then the models already exist (e.g. whisper). The question is how to do this with from computational neuroscience first principles.

i-Zaak commented 7 months ago

This is very similar in spirit to the D1.9 demonstrator: https://wiki.ebrains.eu/bin/view/Collabs/sga3-d1-9-poc-simulations-for-validity

maedoc commented 7 months ago

Yeah I meant to ask you to post a link.. thanks!

These kinds of examples fit well within the JAX ecosystem since the NN training can be done simultaneously with the VB model training.