Yushi-Hu / tifa

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
https://tifa-benchmark.github.io/
Apache License 2.0
129 stars 7 forks source link

Fine-tuned Flan-T5 release #1

Closed SnowdenLee closed 1 year ago

SnowdenLee commented 1 year ago

Hi,

thanks for the amazing work. Could you maybe provide an estimated time for the fine-tuned Flan-T5 release?

Thanks a lot and looking forward to try it out!

Yushi-Hu commented 1 year ago

Thanks for your interest! We will release it in April.

bigbrother001 commented 1 year ago

while, has the Fine-tuned Flan-T5 been released now?

Yushi-Hu commented 1 year ago

Sorry for the long wait! Eventually we decided to release a fine-tuned LLaMA 2 checkpoint: https://huggingface.co/tifa-benchmark/llama2_tifa_question_generation . It works pretty well. Hope it is helpful!