search

xpdAcq / mission-control

Releases, Installers, Specs, and more!
0 stars 4 forks source link

Reduced representation of the data #134

Open dooryhee opened 5 years ago

dooryhee commented 5 years ago

Show some reduced representation of the data = f(time). It is suggested to consider the Spearman's rank correlation as an option for a rapid assessment of changes in the data flow.

Expected Behavior

See description on https://en.wikipedia.org/wiki/Spearman%27s_rank_correlation_coefficient or https://en.wikipedia.org/wiki/Pearson_correlation_coefficient

Current Behavior

How different is it from the pearson correlation coefficient?

Possible Solution

Mehmet Topsakal has a python code that compares 1D patterns. If two time-series are equal, their Spearman's r value will be equal to 1. If they are totally unrelated, r will be 0. r can be equal to -1 meaning two series behave in opposite manner.

Priority

Normal to low

CJ-Wright commented 5 years ago

@dooryhee thank you for reporting!

CJ-Wright commented 5 years ago

@Sasaank I think this qualifies as a QOI. It is most likely similar to Pearson's in terms of pipeline implementation.

sbillinge commented 5 years ago

yes, this is a QOI.

Eric, we are building the QOI infrastructure now that can handle this more broadly (and we can include spearman or anything else you want). My personal target for this is in the next milestone, (2019-1) and I think we can deliver that.

S

On Sun, Oct 28, 2018 at 4:11 PM Christopher J. Wright < notifications@github.com> wrote:

@Sasaank https://github.com/Sasaank I think this qualifies as a QOI. It is most likely similar to Pearson's in terms of pipeline implementation.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/xpdAcq/mission-control/issues/134#issuecomment-433737281, or mute the thread https://github.com/notifications/unsubscribe-auth/AEDrUXVxHCR7yPfWGdZa8xWYykLT2FJ7ks5upg9hgaJpZM4WCzqy .

dooryhee commented 5 years ago

Looking forward to it. Thank you so much. E

From: Simon Billinge notifications@github.com Sent: Tuesday, October 30, 2018 6:22 PM To: xpdAcq/mission-control mission-control@noreply.github.com Cc: Dooryhee, Eric edooryhee@bnl.gov; Mention mention@noreply.github.com Subject: Re: [xpdAcq/mission-control] Reduced representation of the data (#134)

yes, this is a QOI.

Eric, we are building the QOI infrastructure now that can handle this more broadly (and we can include spearman or anything else you want). My personal target for this is in the next milestone, (2019-1) and I think we can deliver that.

S

On Sun, Oct 28, 2018 at 4:11 PM Christopher J. Wright < notifications@github.com> wrote:

@Sasaank https://github.com/Sasaank I think this qualifies as a QOI. It is most likely similar to Pearson's in terms of pipeline implementation.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/xpdAcq/mission-control/issues/134#issuecomment-433737281, or mute the thread https://github.com/notifications/unsubscribe-auth/AEDrUXVxHCR7yPfWGdZa8xWYykLT2FJ7ks5upg9hgaJpZM4WCzqy .

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/xpdAcq/mission-control/issues/134#issuecomment-434491467, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ALyE3bVSxEDUQZpRlcl4x3SiVHWjTMJbks5uqND4gaJpZM4WCzqy.