microsoft / RadFact

A metric suite leveraging the logical inference capabilities of LLMs, for radiology report generation both with and without grounding
MIT License
48 stars 6 forks source link

Resume radfact run after phrases generation #3

Open faustomilletari opened 1 month ago

faustomilletari commented 1 month ago

Hello,

I wanted to ask if there is a way to resume radfact evaluation after report phrases generation. I have run phrases generation for quite a bit, but unfortunately the run subsequently failed.

I’d love to restart from after report phrases generation rather than from scratch. Do you know if there is a way to do that?

kenza-bouzid commented 1 month ago

Hello @faustomilletari, thanks for raising this issue. I might have a solution for this but I still need to test that it works end to end. Will follow-up on this in the next days.