Closed ruixing76 closed 1 month ago
Claim-level UE for Chinese (Jupyter notebook)
lm_polygraph.stat_calculators.extract_claims
claim_level_prompts.py
extract_claims.py
openai_fact_check.py
deberta.py
OPENAI_KEY=YOUR_KEY HYDRA_CONFIG=../examples/configs/polygraph_eval_person_bio_zh.yaml python3.10 ./polygraph_eval +model.device=cuda:0 ++model.load_model_args.device_map=0 model.path=01-ai/Yi-6B batch_size=1
Claim-level UE for Chinese (Jupyter notebook)
lm_polygraph.stat_calculators.extract_claims
claim_level_prompts.py
that contains all prompts (extract prompts, 2-step match prompts) for English and Chineseextract_claims.py
andopenai_fact_check.py
deberta.py