ahans30 / Binoculars

[ICML 2024] Binoculars: Zero-Shot Detection of LLM-Generated Text
https://arxiv.org/abs/2401.12070
BSD 3-Clause "New" or "Revised" License
189 stars 26 forks source link

fpr threshold #7

Closed nivancat closed 6 months ago

nivancat commented 6 months ago

What does BINOCULARS_FPR_THRESHOLD of 0.8536432310785527 correspond to? Is that 1% or 0.01% in the paper?

ahans30 commented 6 months ago

Thanks for your interest. It's 0.01%.

nivancat commented 6 months ago

thank you!

nivancat commented 6 months ago

Is there any chance you could share the 1% threshold value, am trying to compare? I cant seem to recalibrate for with the M4 to land on the same value