OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
Apache License 2.0
2.39k stars 248 forks source link

Add Evaluation Code for Scene Graph Generation #423

Open JackCai1206 opened 10 months ago

JackCai1206 commented 10 months ago

I have added code to fintune and evaluate OFA on Scene Graph Generation task. I have used a popular evaluation codebase from the SGG literature to calculate the metrics.

Specifically, I take the data from visual genome, and linearize the graphs into a string. I finetune OFA using image as the input and the graph-string as the output.

Would the OFA team be interested in this new feature?