search

openEXO / cloud-kepler

Cloud Kepler is a cloud enabled Kepler Planet searching pipeline
8 stars 3 forks source link

Test Bulk De-Trending of Lightcurves Prior To BLS Search On Real and Simulated Data #6

Open scfleming opened 10 years ago

scfleming commented 10 years ago

This is a biggie: how best to de-trend the lightcurves, in an automated way, before running the BLS search. This is going to require a large amount of development and testing….

peter-r-mccullough commented 10 years ago

testing what happens if I reply to this email.

Detrending - Hogg's grad student has done that and it's on his github. We should recruit him to contribute it.

On Fri, Jan 17, 2014 at 2:38 PM, Scott notifications@github.com wrote:

This is a biggie: how best to de-trend the lightcurves, in an automated way, before running the BLS search. This is going to require a large amount of development and testing….

— Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6 .

scfleming commented 10 years ago

Sounds good. I'm thinking that integrating his student's code might be someting that Andrea could work on while I work on the simulated transit module...

zonca commented 10 years ago

Sure, can you point me to the code?

peter-r-mccullough commented 10 years ago

I just sent an email to danfm . I tried to find his de-trending code to answer Andrea's question, but a lot of stuff came up, so I figured I better just ask Dan Foreman-Mackey himself.

By the way, I spoke with Eric Ford today. His students at Penn State will have a class project this semester on high performance computing, and they have to pick topics soon. So if by Feb 1 we are ready to entice a few of them, we might get some enthusiastic and good undergrads contributing to some aspect of this project.

Peter

P.S. I don't know who all gets these emails (!?)

On Thu, Jan 23, 2014 at 7:26 PM, Andrea Zonca notifications@github.comwrote:

Sure, can you point me to the code?

— Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6#issuecomment-33185181 .

scfleming commented 10 years ago

Hi Peter,

I know that at least Andrea and myself are getting them. I'm guessing anyone who "watches" this repo will get them by default. So that would be the normal crew at the moment (including Pavel and Jack)...

On 1/23/14 8:01 PM, peter-r-mccullough wrote:

I just sent an email to danfm . I tried to find his de-trending code to answer Andrea's question, but a lot of stuff came up, so I figured I better just ask Dan Foreman-Mackey himself.

By the way, I spoke with Eric Ford today. His students at Penn State will have a class project this semester on high performance computing, and they have to pick topics soon. So if by Feb 1 we are ready to entice a few of them, we might get some enthusiastic and good undergrads contributing to some aspect of this project.

Peter

P.S. I don't know who all gets these emails (!?)

On Thu, Jan 23, 2014 at 7:26 PM, Andrea Zonca notifications@github.comwrote:

Sure, can you point me to the code?

— Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6#issuecomment-33185181 .

— Reply to this email directly or view it on GitHub https://github.com/openEXO/cloud-kepler/issues/6#issuecomment-33188012.

zonca commented 10 years ago

I've done a simple test with the PyKE detrending:

http://nbviewer.ipython.org/gist/zonca/9101113

it works fine for a dull example, it is implemented as a polynomial fit, it just requires to choose:

it fits the data with Least Square with sigma clipping, then we can remove the identified trend from the data.

peter-r-mccullough commented 10 years ago

Wonderful! Nice job!!

On Wed, Feb 19, 2014 at 3:48 PM, Andrea Zonca notifications@github.comwrote:

I've done a simple test with the PyKE detrending:

http://nbviewer.ipython.org/gist/zonca/9101113

it works fine for a dull example, it is implemented as a polynomial fit, it just requires to choose:

  • polynomial order
  • level of sigma clipping

it fits the data with Least Square with sigma clipping, then we can remove the identified trend from the data.

Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6#issuecomment-35546550 .

darthlegit commented 10 years ago

yeah I'm here and receiving but am just full to the brim with my school work at this point in time.

On Wed, Feb 19, 2014 at 4:46 PM, peter-r-mccullough < notifications@github.com> wrote:

Wonderful! Nice job!!

On Wed, Feb 19, 2014 at 3:48 PM, Andrea Zonca <notifications@github.com

wrote:

I've done a simple test with the PyKE detrending:

http://nbviewer.ipython.org/gist/zonca/9101113

it works fine for a dull example, it is implemented as a polynomial fit, it just requires to choose:

  • polynomial order
  • level of sigma clipping

it fits the data with Least Square with sigma clipping, then we can remove the identified trend from the data.

Reply to this email directly or view it on GitHub< https://github.com/openEXO/cloud-kepler/issues/6#issuecomment-35546550>

.

Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6#issuecomment-35570451 .

ivanmladek commented 10 years ago

Im getting the emails and it fills me with joy how much activity there is. I would love to try in and listen to the next skype call. Pavel

---Sent from Boxer | http://getboxer.com

On February 20, 2014 at 3:06:56 AM GMT+1, Jack Flowers wrote:yeah I'm here and receiving but am just full to the brim with my school work at this point in time. On Wed, Feb 19, 2014 at 4:46 PM, peter-r-mccullough < notifications@github.com> wrote: > Wonderful! Nice job!! > > > On Wed, Feb 19, 2014 at 3:48 PM, Andrea Zonca <notifications@github.com > >wrote: > > > > I've done a simple test with the PyKE detrending: > > > > http://nbviewer.ipython.org/gist/zonca/9101113 > > > > it works fine for a dull example, it is implemented as a polynomial fit, > > it just requires to choose: > > > > - polynomial order > > - level of sigma clipping > > > > > it fits the data with Least Square with sigma clipping, > > then we can remove the identified trend from the data. > > > > -- > > Reply to this email directly or view it on GitHub< > https://github.com/openEXO/cloud-kepler/issues/6#issuecomment-35546550> > > > . > > > > -- > Reply to this email directly or view it on GitHubhttps://github.com/openEXO/cloud-kepler/issues/6#issuecomment-35570451 > . > —Reply to this email directly or view it on GitHub.

scfleming commented 10 years ago

I've renamed this ticket since we have detrending implemented, but we need to test how it performs in a variety of cases.