Archives

2024

ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models

Kesen, I., Pedrotti, A., Dogan, M., Cafagna, M., Acikgoz, E., Parcalabescu, L., Calixto, I., Frank, A., Gatt, A., Erdem, A., Erdem, E. (2024)

arXiv preprint arXiv:2311.07022.

On Measuring Faithfulness or Self-consistency of Natural Language Explanations

Parcalabescu, L., Frank, A. (2024)

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) .

Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations?

Parcalabescu, L., Frank, A. (2024)

arXiv preprint arXiv:2404.18624.

2023

MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Tasks

Parcalabescu, L., Frank, A. (2023)

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), Toronto, Canada.

2022

MAGMA – Multimodal Augmentation of Generative Models through Adapter-based Finetuning

Eichenberg, C., Black, S., Weinbach, S., Parcalabescu, L., Frank, A. (2022)

Findings of EMNLP.

Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning

Erdem, E., Kuyu, M., Yagcioglu, S., Frank, A., Parcalabescu, L., Plank, B., Babii, A., Turuta, O., Erdem, A., Calixto, I., Lloret, E., Apostol, E., Truica, C., Sandrih, B., Gatt, A., Martincic-Ipsic, S., Berend, G., Korvel, G. (2022)

Journal of Artificial Intelligence Research (JAIR).

VALSE💃: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

Parcalabescu, L., Cafagna, M., Muradjan, L., Frank, A., Calixto, I., Gatt, A. (2022)

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.

2021

What is Multimodality?

Parcalabescu, L., Trost, N., Frank, A. (2021)

Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online).

Seeing Past Words: Testing the Cross-Modal Capabilities of Pretrained V&L Models

Parcalabescu, L., Gatt, A., Frank, A., Calixto, I. (2021)

Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online).

Grounding Plural Phrases: Countering Evaluation Biases by Individuation

Suter, J., Parcalabescu, L., Frank, A. (2021)

Proceedings of the 2nd Workshop on Advances in Language and Vision Research (ALVR 2021) at NAACL 2021, Online.

2020

AMR Similarity Metrics from Principles

Opitz, J., Parcalabescu, L., Frank, A. (2020)

Transactions of the Association for Computational Linguistics.

Exploring Phrase Grounding without Training: Contextualisation and Extension to Text-Based Image Retrieval

Parcalabescu, L., Frank, A. (2020)

Proceedings of the Workshop on Multimodal Learning (In conjunction with CVPR 2020), Seattle, WA, USA.

2018

WEADE: a workflow for enrichment analysis and data exploration

Trost, N., Rempel, E., Ermakova, O., Tamirisa, S., Parcalabescu, L., Boutros, M., Lohmann, J., Lohmann, I. (2018)

PloS one.