search

isi-vista / unified-io-inference

Apache License 2.0
0 stars 0 forks source link

Captioning using alternative prompts #12

Closed elizlee closed 1 year ago

elizlee commented 1 year ago

Closes #8

Adds a script caption_vg.py that provides image captions to a sample of images from Visual Genome, while allowing the option to caption with a list of alternative prompts. A sample of such prompts is provided in alternative_prompts.txt.

Sample output can be found in /nas/gaia02/data/paper2023/vg/vg_output.tsv, and was produced by the following command:

docker run -it --rm --gpus=1 -e VG_DATA_DIR=/input/data -v /nas/gaia02/data/paper2023/vg/visual_genome_python_driver:/input -v /nas/gaia/users/elee/repos/unified-io-inference/output:/output -e OUTPUT_FILE=/output/vg_output.tsv unified-io-inference:vg_caption_test