Papers from the workshop "JOKER: Automatic Humour Analysis" have now been published in the proceedings of CLEF 2025, the 16th Conference and Labs of the Evaluation Forum.
The JOKER workshop, co-organized by OFAI's Tristan Miller, aims to bring translators and computer scientists together to develop data and evaluation metrics for the (semi-)automatic translation of humorous language. The workshop consists of a number of shared tasks, held in the spring of 2025, followed by a series of sessions at the CLEF 2025 conference in Madrid from 9 to 12 September 2025.
A peer-reviewed overview of the entire workshop appears in Experimental IR Meets Multilinguality, Multimodality, and Interaction, a volume in Springer's Lecture Notes in Computer Science series. Papers describing the individual shared tasks of the workshop, as well as the participating systems, are published in Working Notes of CLEF 2025, a volume in the CEUR Workshop Proceedings series.
Full bibliographic details of the OFAI-coauthored papers are as follows:
- Liana Ermakova, Ricardo Campos, Anne-Gwenn Bosser, and Tristan Miller. Overview of the CLEF 2025 JOKER lab: Humour in the machine. In Jorge Carrillo de Albornoz, Julio Gonzalo, Laura Plaza, Alba García Seco de Herrera, Josiane Mothe, Florina Piroi, Paolo Rosso, Damiano Spina, Guglielmo Faggioli, and Nicola Ferro, editors, Experimental IR Meets Multilinguality, Multimodality, and Interaction: 16th International Conference of the CLEF Association, CLEF 2025, Madrid, Spain, September 9–12, 2025, Proceedings, volume 16089 of Lecture Notes in Computer Science (ISSN 0302-9743), pages 315–337, Cham, Switzerland, September 2025. Springer. ISBN 978-3-032-04353-5. DOI: 10.1007/978-3-032-04354-2_18.
- Liana Ermakova, Ricardo Campos, Anne-Gwenn Bosser, and Tristan Miller. Overview of the CLEF 2025 JOKER task 1: Humour-aware information retrieval. In Guglielmo Faggioli, Nicola Ferro, Paolo Rosso, and Damiano Spina, editors, CLEF 2025 Working Notes, CEUR Workshop Proceedings, pages 2744–2760. CEUR-WS.org, 2025.
- Liana Ermakova, Anne-Gwenn Bosser, Tristan Miller, and Ricardo Campos. Overview of the CLEF 2025 JOKER task 2: Wordplay translation from English into French. In Guglielmo Faggioli, Nicola Ferro, Paolo Rosso, and Damiano Spina, editors, CLEF 2025 Working Notes, CEUR Workshop Proceedings, pages 2761–2779. CEUR-WS.org, 2025.
- Liana Ermakova, Tristan Miller, Yaël Naud, Anne-Gwenn Bosser, and
Ricardo Campos.
Overview of the CLEF 2025 JOKER task 3: Onomastic wordplay translation. In Guglielmo Faggioli, Nicola Ferro, Paolo Rosso, and Damiano Spina, editors, CLEF 2025 Working Notes, CEUR Workshop Proceedings, pages 2780–2790. CEUR-WS.org, 2025.
