Claim level

[cant-access-rediska0123]

Claim-level UE implementation for benchmark and library usage:

• Claim-level utils
  • claim extraction and matching in lm_polygraph.stat_calculators.extract_claims.ClaimsExtractor
  • fact-checking in lm_polygraph.generation_metrics.openai_fact_check.OpenAIFactCheck
• Claim-level UE methods following https://arxiv.org/abs/2403.04696
  • MaximumClaimProbability
  • PerplexityClaim
  • MaxTokenEntropyClaim
  • PointwiseMutualInformationClaim
  • ClaimConditionedProbabilityClaim
  • PTrueClaim
• Benchmark configs for PersonBio and WikiBio datasets
• Example notebook claim_level_example.ipynb