Open wbenoit26 opened 2 days ago
Actually, it looks like the waveforms themselves are way too large.
It appears this is a known issue with IMRPhenomXPHM: https://git.ligo.org/reed.essick/rpo4-injection-triage/-/blob/main/rpo4a/README.md?ref_type=heads. Our rate of these instances is remarkably similar to what Reed reports for big_snr
events, a few every 500,000.
It seems that this issue was avoided by turning off multi-banding: https://git.ligo.org/reed.essick/rpo4-injection-triage/-/blob/main/rpo4a/MULTIBANDING.md?ref_type=heads. We can't doing that without dramatically changing our waveform generation process, so I think a reasonable solution would be to simply have an upper SNR threshold of about 1000 during waveform generation.
Four of the injected events in the recent O4b run had SNRs between 1e10 and 1e18. Their parameters, below, all look normal. I'll try to recreate the bug using these values.
Our network put all of these events well into the background distribution, which makes sense, and these outliers don't affect the results at all.