GOTO-OBS / gtecs-alert

GOTO Telescope Control System: code for VOEvent alert processing
3 stars 2 forks source link

Determine alert strategy for O4 #70

Open martinjohndyer opened 1 year ago

martinjohndyer commented 1 year ago

This is a general issue to discuss what changes we want to make to the follow-up strategy in advance of O4.

TODO: write a bit about the current system.

Lyalpha commented 1 year ago

The HasRemnant property is probably more relevant than just HasNS for EM prospects.

At the very least ,the Slack notifications should indicate HasRemnant, and if the event rate of HasNS events is significant, we would certainly want to prioritise on HasRemnant (maybe eventually doing lesser follow-up of HasRemnant ~ 0 events.

bxg682 commented 1 year ago

Agree with what Joe said above, but I do think we want to have an expection for anything within (say) 200 Mpc (even BBH), since these will be rare opportunities to constrain models. They'll probably have small skymaps too.

dsteeghs commented 1 year ago

Trying to capture what was discussed during the scheduling sessions.

Can keep a near/far strategy using distance, though its more about how much sky there is to cover. We can only go deep if the visible area isn't too large. This ideally needs to look at visibility, but that we can deal with later.

martinjohndyer commented 1 year ago

First off, I'll look at adding a new IGNORE "strategy" for GW events we don't care about. In this case do we still want events to: a) be added to the alerts database? (if yes then they could still appear in the marshal cross-matching) b) be sent to Slack? (if no I'd want to turn off the "Sentinel processing" messages which is tricky) I'd be tempted to still say yes to both, perhaps mitigating if I make a priority alerts channel to highlight the interesting ones.

We could chose what to ignore on various factors: BBH (unless they're very close?), or anything with too large a skymap or poor FAR? We could always change our mind if an update alert came in with a better localisation.


On actually changing the observing strategy, here are some thoughts / questions to ask at the next telecon:

Under the current system tiles fall in rank as they are observed, and we'd only go back for a second pass iff there are no remaining visible tiles that haven't yet been observed once. In practice we care more about multiple epochs than coverage, so instead we could have the second pointing increase in priority. With a reasonable wait time (1h, 2h?) we'd get though a certain portion of the skymap, but then when the second pass starts becoming visible again they would jump to the top of the queue (assuming they're still visible).

Reading that it seems like the initial idea could use some improvement. We want the benefits of the tiebreaker and immediate replacement in the queue while still guaranteeing a second visit. Off the top of my head, how about you reinsert at the same rank but effectively halve the contained probability? I'm thinking of some of the voting systems with variable quotas. It would be more flexible but you'd lose the exact timing. Maybe you'd want a nominal 10 minute wait time just so you're not revising the same position constantly. It would probably need simulations.

dsteeghs commented 1 year ago

I like it indeed if we could still track these but just not insert targeted observations. But yes we would still want to be aware and be able to cross-match in the marshall.

kwrsema commented 1 year ago

I think a key thing is to have a "easy" way to re-insert a previously ignored alert by hand if information comes to light that makes it more interesting a few hours later (e.g. a weak signal in a GRB satellite is reported in a GCN, there is an exciting cluster/galaxy overdensity in the area, or some neutrinos were detected, or we hear informally there's some chance it may actually have a NS, etc). That way we can be more strict with ignoring certain alerts, as long as people are around to stick an alert back in.

Lyalpha commented 1 year ago

Should single-detector (i.e. practically a cut on area_p90) alerts get less-special treatment?

I'm wondering how we could shoot ourselves in the foot if we have a reasonable EM-bright source with a whole-skymap, and the scheduler is trying to be too-clever and repeating the same patch of sky (which isn't too special in terms of probability contained vs. any other area of sky, cf. the case with multiple detector skymaps).

This also impinges on any near-future alerts in that we would have spent the last several days continually scanning the same region, reducing the cadence elsewhere.

Ultimately, do we think we'd be doing a better job vs. the all-sky survey in these cases?

martinjohndyer commented 1 year ago

73 has made more changes including a new decision chart to filter out a lot more of the junk events. This far into O4 it seems we're getting a lot of them, although we do only have two detectors. I'll leave this open for now as we could still change things for instance when Virgo comes back online.

martinjohndyer commented 5 months ago

With O4b about to start I reviewed our responses to alerts from O4a at the meeting today. The main results are shown in the slide below, in short only 11 events of the 1684 we received would be selected for follow-up.

O4a

Any tweaks to the strategy will need more discussion, and we'll probably want to wait for O4b to get a way in to see if anything changes. But there's also the question about the 24 events we "missed", see #78.