sccn / clean_rawdata

Cleaning Raw EEG data
GNU General Public License v3.0
42 stars 17 forks source link

Formula for correlation #1

Closed vpKumaravel closed 4 years ago

vpKumaravel commented 4 years ago

Dear team,

The line 126 in clean_channels.m script, the formula for computing correlation seems to be missing the mean components (DC offset removal) corrs(:,o) = sum(XX.YY)./(sqrt(sum(XX.^2)).sqrt(sum(YY.^2)));

I was wondering if it is implemented this way for some valid reasons or if it is a bug to be reported. So, I open this thread. Kindly help me understand this. Thank you.

Cheers, Velu

arnodelorme commented 4 years ago

This is because the mean is assumed to have already been removed by the initial high-pass filter (first step in clean_rawdata).

vpKumaravel commented 4 years ago

Hi Arno,

Thanks for the comment. It's clear now. However, since I apply the HPF, then segment the data, and therefore I skip the filtering part in clean_rawdata pipeline. I see I will have to modify the correlation formula anyway for my data. :)

arnodelorme commented 4 years ago

Yes, it is fine to skip filtering if you have already done it. However, the function should be applied BEFORE you segment the data.

Cheers,

Arno

On Oct 5, 2019, at 3:42 PM, Velu44 notifications@github.com wrote:

Hi Arno,

Thanks for the comment. It's clear now. However, since I apply the HPF, then segment the data, and therefore I skip the filtering part in clean_rawdata pipeline. I see I will have to modify the correlation formula anyway for my data. :)

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

vpKumaravel commented 4 years ago

Thanks, Arno!

I have a peculiar situation and I would appreciate any suggestion/feedback from you.

I work with neonates data presented with visual stimuli. There are several portions of data at which the neonates were not quite "attentive" to the presented stimuli. Usually, these portions indicate the newborns moving their heads or crying or falling asleep or simply not looking at the screen. In other words, they typically indicate the very high variance noisy signals and they are not related to the presented stimuli. The timestamps of these portions of data are known to us through a video camera.

Would you still recommend performing ASR before segmenting in this case?

Sincerely, Velu

arnodelorme commented 4 years ago

Dear Velu,

I do not think it will hurt to run ASR as the time range (seconds) is smaller than the one at which you are presenting stimuli. But double check which portions are removed to be sure. Best,

Arno

On Oct 7, 2019, at 7:27 AM, Velu44 notifications@github.com wrote:

Thanks, Arno!

I have a peculiar situation and I would appreciate any suggestion/feedback from you.

I work with neonates data presented with visual stimuli. There are several portions of data at which the neonates were not quite "attentive" to the presented stimuli. Usually, these portions indicate the newborns moving their heads or crying or falling asleep or simply not looking at the screen. In other words, they typically indicate the very high variance noisy signals and they are not related to the presented stimuli. The timestamps of these portions of data are known to us through a video camera.

Would you still recommend performing ASR before segmenting in this case?

Sincerely, Velu

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.