mne-tools / mne-python

MNE: Magnetoencephalography (MEG) and Electroencephalography (EEG) in Python
https://mne.tools
BSD 3-Clause "New" or "Revised" License
2.7k stars 1.31k forks source link

Remote visualization using dash and JS #6845

Closed SherazKhan closed 5 years ago

SherazKhan commented 5 years ago

Problem

Remote visualization for brain surfaces and time series from fif files using data from S3.

MVP:

A basic app that can load freesurfer segmented surface in the browser and overlay texture map.

GuillaumeFavelier commented 5 years ago

I'm no expert in Dash but by adding a basic dash backend I was able to obtain the following for the plot_source_alignment example:

$ MNE_3D_BACKEND=dash python tutorials/source-modeling/plot_source_alignment.py

image

image

image

Note The current PoC doesn't support color, transparency or glyphs.

agramfort commented 5 years ago

that's nice to see you could pull this off so quickly. Do you think it's a viable solution?

GuillaumeFavelier commented 5 years ago

I would need to investigate further to check if Dash built-in features can follow the _Renderer contract completely to be honest. It also depends how 'close' we want to be to the default 3d backend.

agramfort commented 5 years ago

ok. Let's see how far Sheraz can go with his approach

SherazKhan commented 5 years ago

MVP: https://github.com/mne-tools/mne-dash

drammock commented 5 years ago

If we ever decide to build a more custom remote data browser, I just learned about https://en.wikipedia.org/wiki/VirtualGL which seems to solve one of the biggest challenges.