openworm / org.geppetto

Geppetto is an open-source platform to build web-based applications to visualize and simulate neuroscience data and models.
http://geppetto.org
Other
209 stars 50 forks source link

Add support for electrophysiology data #431

Closed tarelli closed 8 years ago

tarelli commented 9 years ago

See https://github.com/openworm/org.geppetto/issues/430 for adding support for experimental data. This card in particular wants to track adding support for electrophysiology data. Currently there are different existing formats to analyse and evaluate:

And the Neo library which could (should?) be used as a proxy to access the different formats.

tarelli commented 9 years ago

@stripathy @nicain @rgerkin @mpsonntag @adrianq @apdavison Let's have the discussion here, please feel free to mention and bring in to the conversation anybody else who should be involved so that this can be a community effort as much as possible. I would also like to setup a meeting on Hangout next week to discuss, would that work for folks?

stripathy commented 9 years ago

I have a nice ipython notebook showing an example of getting data from the Allen Institute ephys dataset in NWB format here: https://github.com/stripathy/AIBS_cell_types/blob/master/Allen_ephys_playground.ipynb

Let's get Christian Kellner (@gicmo) who helped develop NIX in on this conversation too.

rgerkin commented 9 years ago

That works for me. I'd also like to mention that the OpenWorm ChannelWorm repo has digitized a lot of current traces from e.g. IV curve experiments, and it has a Django interface for pulling these data out into Python objects. For example, look at cell 4 here. The GraphData.objects.get part is using the Django ORM to grab some data and put it into a current array and a voltage array. I think they have something similar for a few actual current and voltage traces.

rgerkin commented 9 years ago

But the Allen data might be a better place to start. @stripathy and I can write a module to go from a brain area or cell type to the corresponding current trace for a specific sub-experiment (e.g. a specific train of voltage pulses), so there would be an easy entry point for getting traces corresponding to the cell of interest. @tarelli I'm available over the next 4 days for a hangout, but will be unavailble for about a week starting on Tuesday afternoon.

gicmo commented 9 years ago

Hi everyone and thanks a lot @stripathy for bringing me in. There is an exhaustive documentation for C++ and python 2+3. The latter includes a tutorial that also shows of our tagging features and metadata support. We have support for Matlab and since this summer also Java. @asobolev is working on a NEO backend already. Additionally there is a demo repo which contains some IPython Notebooks and actual ephys data converted to the NIX format, e.g. NWB's pvc-6, pvc-7. NB: the little plot class (Plotter) creates the correct plots, including axis labels from the data stored inside the NIX files. We (also @jgrewe and @stoewer) would be happy to work with you guys.

pgleeson commented 9 years ago

This might be quite relevant for accessing large data sets in HDF5 in distributed locations: http://bolt-project.org/docs/index.html.

Count me in on a hangout...

CC @ccluri & NSDF

tarelli commented 9 years ago

@pgleeson cool, note there's this card https://github.com/openworm/org.geppetto/issues/309 which is tracking NSDF, I didn't include it here since it's more about simulation results rather than experimental ones.

tarelli commented 9 years ago

This is the meeting event for Monday before Rich goes away, does it work for folks interested in joining? If not I can create a doodle poll.

ccluri commented 9 years ago

Thanks for including. I will try to join this hangout as an audience.

tarelli commented 8 years ago

@stripathy @nicain @rgerkin @mpsonntag @adrianq @apdavison @ccluri @jgrewe @stoewer a reminder the meeting will be on Hangout (link on the event) in 50 minutes for those interested to join!

ccluri commented 8 years ago

Perhaps I am missing something, I do not see a link on the google calendar page for the hangout. Correct link please? or add me ccluri is my id

stripathy commented 8 years ago

here is the link: https://plus.google.com/hangouts/_/calendar/YnF2bHJtNjQybTNpcmplaGJldGhva2tjZGdAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ.bdke7rupaviprjk26bfho7h8k4?authuser=0

tarelli commented 8 years ago

Minutes from today's meeting, thanks everyone for joining!

pgleeson commented 8 years ago

Paper relevant for all this: http://www.sciencedirect.com/science/article/pii/S0959438815000756

pgleeson commented 8 years ago

Also, have you seen this: http://biojs.net/

tarelli commented 8 years ago

@pgleeson thanks! Yes I've seen biojs before, it looks quite cool, I see many potential widgets there, do you know anybody involved?

pgleeson commented 8 years ago

Sorry, don't know anyone at biojs...

stripathy commented 8 years ago

Here's the updated documentation for NWB:

· Documentation and code have been added to publicly accessible repositories on Github

· Exemplar data sets in the NWB format can be downloaded from CRCNS

· Neurodata Without Borders web site, http://nwb.org, is now online

I also mentioned this activity to one of the NWB project leaders at Allen Institute - hopefully we can get some buy in from them.

tarelli commented 8 years ago

Thanks @stripathy will review!

stripathy commented 8 years ago

There'll be an info session on the NWB data format at the SFN conference in Chicago: http://alleninstitute.org/news-events/events-training/event/society-neuroscience-2015 (Sunday Oct 18). One of the topics to be discussed will be next steps for NWB, including getting the format adopted. If others in this thread are interested in attending, perhaps we can further discuss this there.

tarelli commented 8 years ago

Thanks @stripathy I won't be at SfN but @pgleeson and @slarson might be able to attend!

tarelli commented 8 years ago

Will be coordinating with @rgerkin adding support for this in the coming months. Rick do you have a tentative starting date yet?

rgerkin commented 8 years ago

@tarelli I am in the process of hiring an ASU computer science graduate student for this. Someone should hopefully be ready to contribute in the coming weeks.

rgerkin commented 8 years ago

@tarelli I'd like to welcome @niteshthali08 to the group. He is an ASU master's student who will be working on this issue. He'll officially start next week. What is the preferred documentation entry point for developers?

tarelli commented 8 years ago

@rgerkin great! Welcome onboard @niteshthali08! The docs for developers is here http://docs.geppetto.org/en/latest/devdocs.html The first thing is setting up the development environment, I recommend installing Eclipse Luna for this http://www.eclipse.org/downloads/packages/eclipse-ide-java-ee-developers/lunar (we have few blog posts with additional help for that http://blog.geppetto.org/). Nitesh why don't you join the next Geppetto meeting next Tuesday at 4pm GMT? If you send me an email I'll add you to the calendar invite.

tarelli commented 8 years ago

@nicain this will be for NWB support to Geppetto, I don't know David's Github account if you can ping him as well :)

niteshthali08 commented 8 years ago

Thanks @tarelli. I will join the upcoming meeting. My email id: nthali@asu.edu Could you please add me to the Calendar invite ?

nicain commented 8 years ago

David, what is your github user name?

Best, -n

On Jan 15, 2016, at 4:16 AM, Matteo Cantarelli notifications@github.com wrote:

@nicain https://github.com/nicain this will be for NWB support to Geppetto, I don't know David's Github account if you can ping him as well :)

— Reply to this email directly or view it on GitHub https://github.com/openworm/org.geppetto/issues/431#issuecomment-171946287.

tarelli commented 8 years ago

Some great progress from @niteshthali08

screen shot 2016-04-12 at 17 51 52
niteshthali08 commented 8 years ago

Plot for data from another sweep.

screen shot 2016-04-17 at 5 56 25 pm
LordKrabo commented 8 years ago

@niteshthali08 @tarelli Added to sprint 75.

tarelli commented 8 years ago

First NWB sample added to geppetto 0.3.0 link. Closing this card capturing additional improvements in separate cards.