AIDe – Corpus of Annotated Image Descriptions

AIDe is a corpus of image descriptions in Polish. It consists of 2K natural language descriptions of 1K images. The descriptions are morphosyntactically analysed (part-of-speech tagged and dependency parsed) and the pairs of these descriptions are annotated in terms of semantic relatedness and entailment. All annotations are provided by people with strong linguistic background.

The dataset can be used for evaluation of various systems integrating language and vision. It is applicable for evaluation of systems designed to generation of images based on provided descriptions (text-to-image generation) or to generation of captions based on images (image-to-text generation). Furthermore, as elected images are split into thematic groups based on WordNet, the dataset is also useful for validating image classification approaches.

Download

• Dataset of annotated image descriptions: AIDe

• Images: If you wish to get the pictures please contact alina <at> ipipan.waw.pl (replace <at> with @).

Publication

Alina Wróblewska. Polish corpus of annotated descriptions of images. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), pages 2141–2146. European Language Resources Association (ELRA), 2018.

Licence

The resource is distributed under the CC BY-SA 4.0 licence.

Contact

For contacting Alina Wróblewska, please write to the email alina <at> ipipan.waw.pl.

Acknowledgments

The building of the resource was founded by SONATA 8 grant no 2014/15/D/HS2/03486 from the National Science Centre Poland and by the Polish Ministry of Science and Higher Education as part of the investment in the CLARIN-PL research infrastructure.