clp-research / clp-vision

Our code for working with language and vision corpora.
3 stars 5 forks source link

David Schlangen, 2019-04-07

clp-vision: Code for Working with Image Corpora

This repository collects code for working with (= preprocessing, extracting features from, etc) image corpora used by the CompLing-Potsdam group (formerly "dialogue systems group Bielefeld"). It started as a re-factorisation of the code from our ACL 2016 paper.

A collection of notebooks that make use of the joint preprocessed format created here can be found in the semantics with pictures repository.

Citation

If you make use of any material in here, please cite

David Schlangen, Natural Language Semantics with Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics, Proceedings of the International Conference on Computational Semantics (IWCS), 2019, Gothenburg, May

or

Schlangen D, Zarrieß S, Kennington C. Resolving References to Objects in Photographs using the Words-As-Classifiers Model. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016). Berlin; 2016.