mobeets / nullSpaceControl

1 stars 0 forks source link

improvement on minimum/baseline, where it uses true data? #269

Closed mobeets closed 8 years ago

mobeets commented 8 years ago

aaron's idea, to parallel what we'll have with uncontrolled after #268 is this possible?

mobeets commented 8 years ago

instead of solving for a spike, pick from intuitive sessions the point in spike null space that would bring you closest to minimum/baseline spikes

basically, this is exactly the same as what unconstrained does, except instead of sampling from the null space activity produced in the intuitive session, it picks the point that brings the total activity closest to baseline/minimum spikes. (also it works in spike space and not latent space.)

mobeets commented 8 years ago

screen shot 2016-08-12 at 11 07 22 am

screen shot 2016-08-12 at 11 17 47 am

screen shot 2016-08-12 at 11 18 07 am

mobeets commented 8 years ago

(also, it's definitely a lot better in spike space than fitting it in latent space)

mobeets commented 8 years ago

oh shit

screen shot 2016-08-12 at 12 51 32 pm screen shot 2016-08-12 at 12 51 56 pm

mobeets commented 8 years ago

i think it's doing better here because this hyp does better when there's fewer points in the intuitive session, for whatever reason.

screen shot 2016-08-12 at 1 13 26 pm

but it also does better with learning, which is negatively correlated with intuitive trial count.

screen shot 2016-08-12 at 1 10 58 pm

screen shot 2016-08-12 at 1 08 14 pm

mobeets commented 8 years ago

cloud, by comparison, does better with more intuitive trials

screen shot 2016-08-12 at 1 13 11 pm

mobeets commented 8 years ago

screen shot 2016-08-12 at 1 30 50 pm

mobeets commented 8 years ago

strangely enough, they're kinda indistinguishable from one another, baseline and minimum:

screen shot 2016-08-12 at 1 36 19 pm

mobeets commented 8 years ago

after adding more dates, and only keeping those with session-wide behavioral asymptote

screen shot 2016-08-15 at 1 13 02 pm screen shot 2016-08-15 at 1 12 55 pm

mobeets commented 8 years ago

screen shot 2016-08-15 at 1 20 50 pm

mobeets commented 8 years ago

screen shot 2016-08-15 at 1 24 22 pm

screen shot 2016-08-15 at 1 26 45 pm

mobeets commented 8 years ago

but if we only analyze sessions where Lrn > 0.7, cloud is still better:

screen shot 2016-08-15 at 1 33 11 pm

mobeets commented 8 years ago

wow, well i made a major mistake: this new minimum stuff was using all perturbation data by mistake! i.e., never using intuitive, only cheating!

that makes so much more sense. sheesh.