2024
ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models
Kesen, I., Pedrotti, A., Dogan, M., Cafagna, M., Acikgoz, E., Parcalabescu, L., Calixto, I., Frank, A., Gatt, A., Erdem, A., Erdem, E. (2024)
arXiv preprint arXiv:2311.07022.
On Measuring Faithfulness or Self-consistency of Natural Language Explanations
Parcalabescu, L., Frank, A. (2024)
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) .
Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Explanations?
Parcalabescu, L., Frank, A. (2024)
arXiv preprint arXiv:2404.18624.
2023
MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Tasks
Parcalabescu, L., Frank, A. (2023)
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), Toronto, Canada.
2022
MAGMA – Multimodal Augmentation of Generative Models through Adapter-based Finetuning
Eichenberg, C., Black, S., Weinbach, S., Parcalabescu, L., Frank, A. (2022)
Findings of EMNLP.
Neural Natural Language Generation: A Survey on Multilinguality, Multimodality, Controllability and Learning
Erdem, E., Kuyu, M., Yagcioglu, S., Frank, A., Parcalabescu, L., Plank, B., Babii, A., Turuta, O., Erdem, A., Calixto, I., Lloret, E., Apostol, E., Truica, C., Sandrih, B., Gatt, A., Martincic-Ipsic, S., Berend, G., Korvel, G. (2022)
Journal of Artificial Intelligence Research (JAIR).
VALSE💃: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena
Parcalabescu, L., Cafagna, M., Muradjan, L., Frank, A., Calixto, I., Gatt, A. (2022)
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.
2021
What is Multimodality?
Parcalabescu, L., Trost, N., Frank, A. (2021)
Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online).
Seeing Past Words: Testing the Cross-Modal Capabilities of Pretrained V&L Models
Parcalabescu, L., Gatt, A., Frank, A., Calixto, I. (2021)
Proceedings of the First Workshop on Multimodal Semantic Representations (MMSR), Groningen, The Netherlands (Online).
Grounding Plural Phrases: Countering Evaluation Biases by Individuation
Suter, J., Parcalabescu, L., Frank, A. (2021)
Proceedings of the 2nd Workshop on Advances in Language and Vision Research (ALVR 2021) at NAACL 2021, Online.
2020
AMR Similarity Metrics from Principles
Opitz, J., Parcalabescu, L., Frank, A. (2020)
Transactions of the Association for Computational Linguistics.
Exploring Phrase Grounding without Training: Contextualisation and Extension to Text-Based Image Retrieval
Parcalabescu, L., Frank, A. (2020)
Proceedings of the Workshop on Multimodal Learning (In conjunction with CVPR 2020), Seattle, WA, USA.
2018
WEADE: a workflow for enrichment analysis and data exploration
Trost, N., Rempel, E., Ermakova, O., Tamirisa, S., Parcalabescu, L., Boutros, M., Lohmann, J., Lohmann, I. (2018)
PloS one.