JHU-CLSP / turking-bench

Web-grounded natural language instructions
https://turkingbench.github.io
Apache License 2.0
13 stars 6 forks source link

Evaluate model given dumped data #118

Closed klxu03 closed 11 months ago

klxu03 commented 11 months ago

Add in the dumped data (or model generated outputs of the same format as the dumped data) in a folder called model_output in src/

Then run evaluate_model.py

@danyaljj

danyaljj commented 11 months ago

Thanks! I am assuming gpt/field-dist.png is added by mistake?

klxu03 commented 11 months ago

Thanks! I am assuming gpt/field-dist.png is added by mistake?

Added it in as an example of how to send a GPT request by local image! Used as a reference for the future