Behavioral Video (Synchronous or at least known-time acquisition)

[ckemere]

Cross platform is particularly challenging, but it would be nice to include some basic stuff. In linux V4L has a great framework for simple analog capture cards. Additionally, there are a variety of webcams that appear to be reasonably cross platform, and Point Grey has some lower-cost scientific acquisition cameras that are fully cross platform.

A key feature would be integrating the frame times into the data record somehow

[mmyros]

I am also interested in this issue. previously, I have used Python's SimpleCV with Matlab-based acquizition using port communication. Is it possible to tie V4L or Open/SimpleCV with Matlab engine for OE?

[ckemere]

I've been using the PointGrey cameras, and developed a small Qt application to capture and compress video (and also control the TTL frame synchronization signals from the camera). It's still very beta, but you're welcome to take a look - https://github.com/ckemere/BehavioralVideo

[ubartsch]

Hi, We are about to get one of the acquisition systems, and I asked about video tracking, which apparently is not implemented yet. I came across this open source cross-platform video tracking application: http://en.wikibooks.org/wiki/Swistrack Maybe this could the base for a video tracking/acquisition system in GUI?

[mmyros]

Swistack is impossible to get up and running in my experience. It is also not updated anymore. I wrote a python script using opencv that does a pretty good job at tracking, but I am currently working on syncing it with open ephys. I would love to collaborate. On Mar 17, 2014 8:50 AM, "ubartsch" notifications@github.com wrote:

Hi, We are about to get one of the acquisition systems, and I asked about video tracking, which apparently is not implemented yet. I came across this open source cross-platform video tracking application: http://en.wikibooks.org/wiki/Swistrack Maybe this could the base for a video tracking/acquisition system in GUI?

Reply to this email directly or view it on GitHubhttps://github.com/open-ephys/GUI/issues/32#issuecomment-37811270 .

[ubartsch]

Hi, Sounds good to me. I guess I'll have to wait until our acquisition board arrives to actually be able to help with the open ephys syncing. I'm decent at writing Matlab code, but my python and cpp skills are basic at best. I am up for giving it a shot though, let's see if we can make this happen.

Cheers Ulli

On 17 March 2014 16:35, mmyros notifications@github.com wrote:

Swistack is impossible to get up and running in my experience. It is also not updated anymore. I wrote a python script using opencv that does a pretty good job at tracking, but I am currently working on syncing it with open ephys. I would love to collaborate. On Mar 17, 2014 8:50 AM, "ubartsch" notifications@github.com wrote:

Hi, We are about to get one of the acquisition systems, and I asked about video tracking, which apparently is not implemented yet. I came across this open source cross-platform video tracking application: http://en.wikibooks.org/wiki/Swistrack Maybe this could the base for a video tracking/acquisition system in GUI?

Reply to this email directly or view it on GitHub< https://github.com/open-ephys/GUI/issues/32#issuecomment-37811270> .

Reply to this email directly or view it on GitHubhttps://github.com/open-ephys/GUI/issues/32#issuecomment-37837682 .

Ullrich Bartsch, PhD School of Physiology and Pharmacology University of Bristol Medical Sciences Building University Walk Bristol BS8 1TD UK

phone + 44 (0) 117 33 11467 email ullrich.bartsch@bristol.ac.uk web MW Jones Labhttp://www.bristol.ac.uk/phys-pharm/research/staffresearch/mattjones.html

[mmyros]

So are mine. I will post the script and examples a bit later once I comment and pretty it up a bit.

Max

On 20 March 2014 07:25, ubartsch notifications@github.com wrote:

Hi, Sounds good to me. I guess I'll have to wait until our acquisition board arrives to actually be able to help with the open ephys syncing. I'm decent at writing Matlab code, but my python and cpp skills are basic at best. I am up for giving it a shot though, let's see if we can make this happen.

Cheers Ulli

On 17 March 2014 16:35, mmyros notifications@github.com wrote:

Swistack is impossible to get up and running in my experience. It is also not updated anymore. I wrote a python script using opencv that does a pretty good job at tracking, but I am currently working on syncing it with open ephys. I would love to collaborate. On Mar 17, 2014 8:50 AM, "ubartsch" notifications@github.com wrote:

Hi, We are about to get one of the acquisition systems, and I asked about video tracking, which apparently is not implemented yet. I came across this open source cross-platform video tracking application: http://en.wikibooks.org/wiki/Swistrack Maybe this could the base for a video tracking/acquisition system in GUI?

Reply to this email directly or view it on GitHub< https://github.com/open-ephys/GUI/issues/32#issuecomment-37811270> .

Reply to this email directly or view it on GitHub< https://github.com/open-ephys/GUI/issues/32#issuecomment-37837682> .

Ullrich Bartsch, PhD School of Physiology and Pharmacology University of Bristol Medical Sciences Building University Walk Bristol BS8 1TD UK

phone + 44 (0) 117 33 11467 email ullrich.bartsch@bristol.ac.uk web MW Jones Lab< http://www.bristol.ac.uk/phys-pharm/research/staffresearch/mattjones.html>

Reply to this email directly or view it on GitHubhttps://github.com/open-ephys/GUI/issues/32#issuecomment-38156321 .

[mmyros]

@ubartsch here is some messy code that works for video tracking my radial arm maze. It currently does not synch with OE but as soon as it does, I will post an update. https://github.com/mmyros/oram

[jsiegle]

The recommended way to synchronize ephys data with with behavioral videos is to acquire the video with another application (e.g. Bonsai) and send the frame trigger times to the Open Ephys acquisition board (or other data source acquired by the Open Ephys GUI).