|
Size: 16950
Comment:
|
← Revision 862 as of 2026-10-26 04:13:09 ⇥
Size: 36500
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| = Natural Language Processing Seminar 2022–2023 = | = Natural Language Processing Seminar 2026–2027 = |
| Line 7: | Line 7: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''3 October 2022'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Sławomir Dadas''' (National Information Processing Institute)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=TGwLeE1Y5X4|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2022-10-03.pdf|Our experience with training neural sentence encoders for the Polish language]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Representing sentences or short texts as dense vectors with a fixed number of dimensions is a common technique in tasks such as information retrieval, question answering, text clustering or plagiarism detection. A simple method to construct such representation is to aggregate vectors generated by a language model or extracted from word embeddings. However, higher quality representations can be obtained by fine-tuning a language model on a dataset of semantically similar sentence pairs. In this presentation, we will introduce methods for learning sentence encoders based on the Transformer architecture as well as our experiences with training such models for the Polish language. In addition, we will discuss approaches for building large datasets of paraphrases using publicly available corpora. We will also show a practical application of sentence encoders in a system developed for finding abusive clauses in consumer agreements.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''7 September 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Varvara Magomedova''' (University of Nova Gorica)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=hveN6krWBuQ|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2026-09-07.pdf|Veje – a future treebank of Slovenian dialectal texts]]'''  {{attachment:seminarium-archiwum/icon-en.gif|Talk in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Slovenian dialect research has produced a lot of literature, but not as many data sources. The lack of available syntactically annotated corpora limits research for those, who do not have access to native speakers. This talk presents the first phase of Veje – to become a Slovenian dialect treebank. The present version of the pipeline is designed to reduce the manual work. The pipeline has two modules – normalization and annotation. In the first stage, dialectal surface forms are normalized towards standard Slovenian through a sequence of corrected lexical replacements, deterministic phonological rules, Sloleks-based morphological validation, and a constrained GaMS residual corrector. The process preserves token order and alignment wherever possible and records substitutions that cannot be morphologically verified for later review. In the second stage, normalized sentences are parsed with the non-standard Slovenian CLASSLA-Stanza model, while SloBERTa identifies whatever could not be normalized and sends it to GaMS for a second check of the annotation. The resulting extended CoNLL-U representation retains the original dialect form alongside its normalized equivalent, Universal Dependencies annotation, dialect metadata, and audit information. The current output is intentionally silver-standard: native speakers and dialectologists will correct selected data into a gold subset, which will subsequently support evaluation and model fine-tuning. I will also show the web-platform developed based on user needs study held with corpora users.|| |
| Line 12: | Line 12: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''14 November 2022'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Łukasz Augustyniak''', '''Kamil Tagowski''', '''Albert Sawczyn''', '''Denis Janiak''', '''Roman Bartusiak''', '''Adrian Dominik Szymczak''', '''Arkadiusz Janz''', '''Piotr Szymański''', '''Marcin Wątroba''', '''Mikołaj Morzy''', '''Tomasz Jan Kajdanowicz''', '''Maciej Piasecki''' (Wrocław University of Science and Technology)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://pwr-edu.zoom.us/j/96657909989?pwd=VXFmcEc5blNyM0M3ekxvNGc3Q2Rsdz09|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2022-11-14.pdf|This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}} {{attachment:seminarium-archiwum/icon-en.gif|Slides in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">The availability of compute and data to train larger and larger language models increases the demand for robust methods of benchmarking the true progress of LM training. Recent years witnessed significant progress in standardized benchmarking for English. Benchmarks such as GLUE, SuperGLUE, or KILT have become a de facto standard tools to compare large language models. Following the trend to replicate GLUE for other languages, the KLEJ benchmark (''klej'' is the word for glue in Polish) has been released for Polish. In this paper, we evaluate the progress in benchmarking for low-resourced languages. We note that only a handful of languages have such comprehensive benchmarks. We also note the gap in the number of tasks being evaluated by benchmarks for resource-rich English/Chinese and the rest of the world. In this paper, we introduce LEPISZCZE (''lepiszcze'' is the Polish word for glew, the Middle English predecessor of glue), a new, comprehensive benchmark for Polish NLP with a large variety of tasks and high-quality operationalization of the benchmark. We design LEPISZCZE with flexibility in mind. Including new models, datasets, and tasks is as simple as possible while still offering data versioning and model tracking. In the first run of the benchmark, we test 13 experiments (task and dataset pairs) based on the five most recent LMs for Polish. We use five datasets from the Polish benchmark and add eight novel datasets. As the paper's main contribution, apart from LEPISZCZE, we provide insights and experiences learned while creating the benchmark for Polish as the blueprint to design similar benchmarks for other low-resourced languages.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''21 September 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Mirosław Koziarski''' (independent researcher)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=OlNVqLLv_SE|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2026-09-21.pdf|The Digital Edition of the “Varsovian Dictionary”]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:5px">''The Dictionary of the Polish Language'', edited by Jan Karłowicz, Adam Kryński, and Władysław Niedźwiedzki and commonly known as the ''Varsovian Dictionary'', is one of the most important and extensive works of Polish lexicography. Its eight volumes, published between 1900 and 1927 and comprising almost 7,800 pages, document Polish from a wide range of periods, regions, registers, and domains. Although scans of the dictionary are available in digital libraries, its content has largely remained locked within images of printed pages.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">In this presentation, I will introduce the project of a digital edition of the Varsovian Dictionary, which develops the methodology and tools designed as part of my doctoral dissertation. I will discuss the successive stages of processing: source selection and analysis, image processing and segmentation, OCR—now also supported by AI-based tools—text correction and normalisation, hierarchical parsing of dictionary entries, validation, indexing, and the generation of derived data. The core component is a parser that transforms a linear transcription into a structured XML representation. It identifies several dozen types of segments, including headwords, variants, grammatical information, senses and subsenses, definitions, qualifiers, usage examples, etymologies, cross-references, and phraseological units, as well as the relations between them. Given the complexity and inconsistency of the source material, the process is iterative and combines automatic methods with manual verification.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">The online edition extends an earlier research prototype into a gradually expanding platform. Users can compare a formatted entry with its source transcription, raw XML, and the corresponding facsimile. Structuring the content also makes it possible to create new paths of access to the data: a corpus of examples, collections of derivative pairs, a consolidated index of abbreviations, quantitative statistics, and a matrix comparing the dictionary’s headword inventory with those of other Polish dictionaries.|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Finally, I will present the current state of the project, its quality-control mechanisms, and the limitations of automatic processing of historical lexicographic material. I will also outline planned developments.|| |
| Line 17: | Line 20: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''28 November 2022'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Aleksander Wawer''' (Institute of Computer Science, Polish Academy of Sciences), '''Justyna Sarzyńska-Wawer''' (Institute of Psychology, Polish Academy of Sciences)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=zVbQ7gmbqvA|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2022-11-28.pdf|Lying in Polish: language analysis and methods of automated detection]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Lying is an integral part of daily communication in both written and oral form. In this presentation, we will present the results obtained on a collection of nearly 1,500 true and false statements, half of which are transcripts and the other half are written statements, from probably the largest study on lying in the Polish language. In the first part of the presentation, we will examine the differences between true and false statements: we will check whether they differ in terms of complexity and sentiment, as well as characteristics such as length, concreteness and distribution of parts of speech. In the second part of the presentation, we will discuss models that automatically distinguish true from false statements. We will cover simple approaches, such as models trained on dictionary features, as well as more complex, pre-trained transformer neural networks. We will also talk about an attempt to detect lying with the use of automated fact-checking and present the preliminary results of work on the interpretability (explanations) of lie detection models.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''19 October 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Justyna Gromada''', '''Natalia Krawczyk''' (Orange Research)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=OF58bJDpjM4|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2026-10-19.pdf|Evaluation of Conversational Agents and Interpretable Satisfaction Modeling in Sales Dialogues]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk in Polish.}} {{attachment:seminarium-archiwum/icon-en.gif|Slides in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">The first part of the talk will introduce the CURIE research program, within Orange Research in Poland. We will focus on the evaluation of conversational agents, particularly in sales dialogues. The second part will present an approach to modeling user satisfaction in sales dialogues. Using 5200 simulated phone-sales conversations between the bot and the user, we developed an annotation framework for offers, cross-selling attempts, and customer decisions. We then derived metrics capturing aspects such as sales outcomes, negotiation patterns, and final cart contents. A model based on these metrics achieved results close to those of a model analyzing the dialogue text, while also helping to identify what influences customer satisfaction.|| |
| Line 22: | Line 25: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''19 December 2022'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Wojciech Kryściński''' (Salesforce Research)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=54qidiBmiok|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2022-12-19.pdf|Long Story Short: A Talk about Text Summarization]]'''  {{attachment:seminarium-archiwum/icon-en.gif|Talk and slides in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Automatic Text Summarization is a challenging task within Natural Language Processing that requires advanced language understanding and generation capabilities. In recent years substantial progress has been made in developing neural models for the task thanks to the efforts of the research community and advancements in the broader field of NLP. Despite this progress, text summarization remains a challenging task that is far from being solved. In this talk, we will first discuss the early approaches and the current state of the field. Next, we will critically evaluate key ingredients of the existing research setup: datasets, evaluation metrics, and models. Finally, we will focus on emerging research directions and consider the future of text summarization.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''22 October 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Nina Smirnova''' (GESIS – Leibniz Institute for the Social Sciences)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[https://www.youtube.com/watch?v=_We0gUtKw-I|{{attachment:seminarium-archiwum/youtube.png}}]] '''[[attachment:seminarium-archiwum/2026-10-22.pdf|Open Political Corpora: Structuring, Searching, and Analyzing Parliamentary Transcripts]]'''  {{attachment:seminarium-archiwum/icon-en.gif|Talk in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:1px">This seminar presents our work on processing and providing access to parliamentary transcripts as part of a specialized information service for political science. Our goal is to create a unified, searchable collection of parliamentary speeches from different countries and languages, with a particular focus on making these resources accessible to researchers without extensive programming expertise.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">At the center of this work is [[https://policorp.pollux-fid.de/|PoliCorp]], a web-based platform for searching and exploring processed political texts. In contrast to initiatives such as [[https://github.com/clarin-eric/parla-clarin|Parla-CLARIN]] and related parliamentary corpora, !PoliCorp emphasizes intuitive, browser-based access to the data. Its advanced search functionality allows researchers to combine or exclude criteria using logical operators and to search across multiple metadata and text fields. This makes it possible to construct targeted subcorpora and investigate complex patterns within large collections of parliamentary debates. Selected data can subsequently be downloaded in JSON format for further computational analysis.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">The current collection includes transcripts from the German Bundestag and German state parliaments. We are extending the corpus to include parliamentary debates from France and Poland, moving toward a multilingual and cross-national research infrastructure.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">The seminar will introduce the main stages involved in building such a resource, from preprocessing and structuring parliamentary transcripts to storing, indexing, and making them searchable on the web. We will discuss both the technical and methodological challenges of harmonizing heterogeneous parliamentary data across institutions, countries, and languages.|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Finally, we will demonstrate how these corpora can support substantive research in political science and computational social science.|| |
| Line 27: | Line 34: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''9 January 2023'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Marzena Karpińska''' (University of Massachusetts Amherst)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">'''[[attachment:seminarium-archiwum/2023-01-09.pdf|Challenges in Evaluation of Machine Generated Text]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">The recent progress in natural language generation (NLG) has made it difficult for researchers to effectively evaluate the output of their models. Traditional metrics, such as BLEU and ROUGE, are no longer sufficient to distinguish between high quality and low quality outputs, especially in open-ended tasks like story and poetry generation, or at the paragraph level. As a result, many researchers rely on crowdsourced human evaluations of text quality, using platforms like Amazon Mechanical Turk (AMT) to collect ratings of coherence or grammaticality. In this talk, I will first present a series of experiments highlighting the challenges and pitfalls of such approaches showing that even experts may struggle to accurately evaluate model-generated text using Likert-style scales, especially in the story generation task. Next, I will address similar issues in automatic evaluation of machine translation of the literary domain, and outline some unique difficulties inherent in the translation task itself.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''9 November 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Piotr Pęzik''', '''Filip Żarnecki''', '''Wojciech Janowski''', '''Jakub Kwiatkowski''', '''Paweł Wilk''', '''Łukasz Stolarski''' (University of Łódź)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''LLMs in corpus search. From orchestration to exploration'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Talk summary will be made available shortly.|| |
| Line 32: | Line 39: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''6 February 2023'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Agnieszka Mikołajczyk-Bareła''' (!VoiceLab / Politechnika Gdańska / HearAI)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">'''[[attachment:seminarium-archiwum/2023-02-06.pdf|HearAI: Towards Deep learning-based Sign Language Recognition]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}} {{attachment:seminarium-archiwum/icon-en.gif|Slides in English.}}|||| ||<style="border:0;padding-left:30px;padding-bottom:15px">Deaf and hearing-impaired people have a huge communication barrier. Different nationalities use different sign languages, and there is no universal one, as they are natural human languages with their own grammatical rules and lexicons. Deep learning-based methods for sign language translation need a lot of adequately labeled training data to perform well. In [[https://www.hearai.pl/|the HearAI non-profit project]], we addressed this problem and investigated different multilingual open sign language corpora labeled by linguists in the language-agnostic Hamburg Notation System (!HamNoSys). First, we simplified the difficult-to-understand structure of the !HamNoSys without significant loss of gloss meaning by introducing numerical multilabels. Second, we utilized estimated pose landmarks and selected video keyframes' image-level features to recognize isolated glosses. We separately analyzed possibilities of dominant hand location, its position and shape, and overall movement symmetry, which allowed us to deeply explore the usefulness of !HamNoSys for gloss recognition.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''19 November 2026'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Sabina Tomkins''' (University of Michigan)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''The title of the talk will be made available soon'''  {{attachment:seminarium-archiwum/icon-en.gif|Talk in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Talk summary will be made available shortly.|| |
| Line 37: | Line 44: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''13 February 2023'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Artur Nowakowski, Gabriela Pałka, Kamil Guttmann, Mikołaj Pokrywka''' (Adam Mickiewicz University in Poznań)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">'''[[attachment:seminarium-archiwum/2023-02-13.pdf|AMU at WMT 2022: state-of-the-art machine translation methods]]'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}} {{attachment:seminarium-archiwum/icon-en.gif|Slides in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">The majority of machine translation systems are trained at the sentence level. However, today, the expectation is that the translation system will take into account the context of the entire document. To meet this expectation, the organizers of the WMT 2022 conference created the General MT Task, which involves translating texts from different domains: news articles, social media content, conversations, and e-commerce texts. The presentation will discuss the task faced during the WMT 2022 conference in the Czech-Ukrainian and Ukrainian-Czech translation directions. The encountered problems such as correct translation of named entities, consideration of document context, and proper inclusion of rarely used characters like emojis will be discussed. Additionally, methods for selecting the best translation among the translations generated by the system using automatic translation quality assessment models will be presented. The primary goal of the presentation is to showcase the components of the system that contributed to achieving the best results among all shared task participants.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''23 November 2026'''||<rowspan=4 style="border:0;padding-left:30px;">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/pas-logo.png|PAN|width=120}}]]|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Persuasion in Parliament and Beyond: Computational Analysis of Political Discourse'''|| ||<style="border:0;padding-left:30px;padding-bottom:5px">Mini-conference supported by the Polish Academy od Sciences (MOST PAN)  {{attachment:seminarium-archiwum/icon-en.gif|Talks in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''!ParlaMint – Comparable and Interoperable Parliamentary Corpora''' (Tomaž Erjavec, Jožef Stefan Institute)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">The talk presents the [[https://www.clarin.eu/parlamint|ParlaMint corpora of parliamentary debates]] of 29 European countries and autonomous regions, covering at least the period from 2015 to 2022, and containing over 1 billion words. The corpora are uniformly encoded, contain rich metadata about their 24 thousand speakers, and are linguistically annotated, as well as machine translated to English. We present the compilation of the corpora, including the encoding infrastructure, use of !GitHub, the production of individual corpora, the common pipeline for producing their distribution, and use of CLARIN services for dissemination. We also present associated efforts, such corpora of additional countries, and the [[https://clarinsi.github.io/parlaspeech/|ParlaSpeech]] corpora. Finally, the use of the corpora and further work are discussed.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Beyond the Polish Parliamentary Corpus''' (Maciej Ogrodniczuk, Institute of Computer Science, Polish Academy of Sciences)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">The [[https://clip.ipipan.waw.pl/PPC|Polish Parliamentary Corpus]], which is also represented in ParlaMint, served as a model for a series of Polish corpora containing similar types of material, which are ideally suited to research into persuasion techniques. The presentation will introduce these datasets: the [[https://clip.ipipan.waw.pl/PRTC|Round Table Corpus]], documenting the opposition’s negotiations with the communist authorities of the Polish People’s Republic in 1989, and the [[https://zil.ipipan.waw.pl/LocalGovPL|Polish Local Government Debates Corpus]] – a collection of transcripts from the proceedings of provincial assemblies, city councils, county councils and local councils from 2018 to 2026.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Multilingual Corpora of Persuasion Techniques in News and Parliamentary Debates''' (Jakub Piskorski, Joint Research Centre of the European Commission)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">This talk provides an overview of recently developed multilingual corpora with text span-level annotation of persuasion techniques in online news, parliamentary debates, and other types of texts. The talk will elaborate on the corpora characteristics, taxonomies, creation process, and annotation complexity aspects. The talk will also reflect on the experience gained from shared tasks revolving around detection and classification of persuasion techniques which exploit these corpora, and covers state-of-the-art performance and cross-corpora comparison.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Leveraging Persuasion and Intent for Analysis and Reasoning-based Detection of Disinformation with Large Language Models''' (Arkadiusz Modzelewski, Uniwersytet Padewski / NASK)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">This talk introduces novel human-annotated disinformation datasets that enable the analysis of manipulation techniques and malicious intent in Polish and English. It presents reasoning approaches that explicitly incorporate persuasion and intent to improve LLM-based disinformation detection across domains, genres, and languages. Finally, it introduces a multilingual benchmark of human- and AI-generated persuasive content, showing that AI-generated persuasive text exhibits linguistic differences and poses new challenges for detection. Overall, the talk presents new datasets, reasoning frameworks, and empirical insights toward more transparent and generalizable disinformation detection in the era of generative AI.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Talk title will be made available soon''' (Philipp Mayr-Schlegel, GESIS – Leibniz Institute for the Social Sciences)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Talk summary will be made available soon.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''!ParlSent-EU: Three Decades of Interpersonal Sentiment in European Parliamentary Debates Since the 1990s''' (Kamil Orzechowski, Warsaw University of Technology)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Parliamentary corpora offer rich speech texts and speaker metadata but rarely capture interpersonal sentiment between legislators. Research on legislative relationships relies mainly on roll-call votes and co-sponsorship, reflecting behavioural alignment rather than expressed attitudes such as approval, criticism, or hostility. We introduce !ParlSent-EU, a cross-national dataset of directed interpersonal sentiment relations from plenary speeches in the Polish Sejm, German Bundestag, and French Assemblée nationale, spanning over three decades from the 1990s. It was developed by Warsaw University of Technology (OMINO project) and GESIS – Leibniz Institute for the Social Sciences (POLLUX project). Each relation records a speaker, a targeted legislator, and the expressed sentiment (positive, neutral, or negative), with temporal, parliamentary, and demographic metadata, enabling the reconstruction of directed, signed, and temporal networks. Relations are identified by a pipeline combining lexical filtering, LLM-based sentiment extraction, and rule-based entity disambiguation, validated against manually annotated gold standards with performance metrics and inter-annotator agreement. !ParlSent-EU enables comparative, longitudinal studies of elite affective polarization, cross-party hostility, intra-party cohesion, and gendered political communication in European parliamentary democracies.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''From Detecting Persuasion to Predicting Its Success: Persuasion Strategies as Predictive Signals''' (Tiziano Labruna, Fondazione Bruno Kessler)|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Computational work on persuasion has largely focused on detecting rhetorical techniques in text. This talk would ask a complementary question: do those techniques tell us anything about whether an argument actually changes someone's mind? [[https://aclanthology.org/2026.findings-eacl.97/|Multi-Strategy Persuasion Scoring]] is a zero-shot framework in which a large language model reasons about each of six persuasion strategies independently and produces a per-strategy score, which can then be aggregated directly or used as input to a lightweight classifier. The strategy has been tested across three datasets, proving that strategy-guided reasoning consistently outperforms both direct pairwise comparison and generic chain-of-thought baselines.|| |
| Line 42: | Line 62: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''27 February 2023'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Sebastian Vincent''' (University of Sheffield)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''MTCUE: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Efficient use of both intra- and extra-textual context is one of the critical gaps between human and neural machine translation. Research so far has mostly focused on individual, well-defined types of context, such as the surrounding text or discrete external variables such as the gender of the speaker. This work introduces MTCue, a novel neural machine translation framework which rewrites all context as text and learns an abstract representation of context enabling transfer across different data settings and leveraging similar attributes in low resource settings. Focusing on the domain of dialogue with access to document and metadata context, we evaluate multiple variants of MTCue, with four choices for context-source combination and several context vectorisation functions. Our experiments across six language pairs show gains in translation quality over a non-contextual baseline. Further analysis shows that the context encoder of MTCue learns a context space representation which is organised w.r.t. specific attributes such as formality, effectively enabling their zero-shot control. Pre-training on context embeddings also lets MTCue learn new control codes with less data than a tagging baseline.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''30 November 2026'''||<rowspan=4 style="border:0;padding-left:30px;">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/pas-logo.png|PAN|width=120}}]]|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''AI without Borders'''|| ||<style="border:0;padding-left:30px;padding-bottom:5px">Mini-conference supported by the Polish Academy od Sciences (MOST PAN)  {{attachment:seminarium-archiwum/icon-en.gif|Talks in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Universalist modelling and processing of idiomaticity in the PARSEME and !UniDive framework – recent developments and the state of Polish''' (Agata Savary, Paris-Saclay University)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">Multiword expressions (MWEs), like "biały kruk" (lit. a white crow, 'a rare person or thing') or "krew kogoś zalewa" (lit. blood floods someone, 'someone get furious'), a "być komuś na rękę (lit. to be on hand to someone, 'to be convenient'), or "wchodzić w grę" (lit. to enter the play, 'to come into play'), are combinations of words which exhibit idiosyncratic behavior on the lexical, morphological, syntactic, and semantic levels. Their most outstanding feature is their semantic non-compositionality, i.e. the fact that their meaning cannot be straightforwardly deduced form the meanings of their components.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">MWEs pose severe challenges in semantically-oriented NLP tasks. For instance paraphrasing sentences containing idioms is hindered by their lexical and morpho-syntactic inflexibility. Thus, when applying usual paraphrasing techniques to "krew kogoś zalewa", we often obtain incorrect paraphrases, in which the idiomatic meaning is lost, e.g. "ktoś jest zalany krwią" (someone is flooded with blood) or "krew kogoś oblewa" (lit. blood poured onto someone). One of the ways to tackle this challenge is to identify MWEs in running text and apply dedicated treatment to them.|| ||<style="border:0;padding-left:30px;padding-bottom:10px">MWE identification has been the object of many efforts, and is one of the tasks where supervised encoder-based methods still outperform more recent generative LLMs. Paraphrasing of MWEs is an understudied task, especially in multilingual contexts. These two tasks have been the subject of longstanding effort within two European COST networks: [[https://www.cost.eu/actions/IC1207/|PARSEME]] (2013–2017) and [[https://www.cost.eu/actions/CA21167/|UniDive]] (2022–2026), which are notably the organizers of 5 multilingual evaluation campaigns on these topics. I will summarize major challenges and findings from these campaigns and highlight future work.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Detecting AI generated content on surface- and idea-level''' (Marzena Karpińska, Simon Fraser University)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Modern detectors identify only who wrote the words. However, AI-assisted writing is becoming more common. For instance, a user may use AI tools to polish their writing or produce the text from their supplied content. Hence, it is becoming important to detect who contributed the ideas not only the prose. In this talk, I will first discuss the specificities of AI writing at the prose and content levels. Then I will talk about training Idealens, an AI detector that works based on document content, rather than its prose.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Can Neural Network Models Learn Logic?''' (Jakub Szymanik, University of Trento)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Large language models now produce chains of reasoning that look like proofs, but it remains unclear whether they have acquired the rules of inference or merely the patterns that usually accompany them. I will describe a line of joint work with Manuel Vargas Guzmán and Maciej Malicki {{attachment:seminarium-archiwum/info.png|Vargas Guzmán, M., Szymanik, J., & Malicki, M. (2024). Testing the limits of logical reasoning in neural and hybrid models. Findings of the Association for Computational Linguistics: NAACL 2024, 2267–2279. • Bertolazzi, L., Vargas Guzmán, M., Bernardi, R., Malicki, M., & Szymanik, J. (2026). Teaching small language models to learn logic through meta-learning. Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL), 8049–8080. • Vargas Guzmán, M., Szymanik, J., & Malicki, M. (2026). Hybrid models for natural language reasoning: The case of syllogistic logic. Proceedings of the 23rd International Conference on Principles of Knowledge Representation and Reasoning (KR), 1143–1152.}} that tries to make this question precise enough to answer. We use syllogistic logic — a small, fully controlled fragment of natural language — as a testbed, and ask models not whether a conclusion holds but which premises are needed to derive it. This lets us separate two things usually conflated under "compositional generalization": extending a learned pattern to longer chains of reasoning, and recovering the underlying rules from complex cases to apply them to simpler ones. Models turn out to be markedly better at the first than the second, and their success depends systematically on the shape of the inference rather than its difficulty. I will end with two more encouraging results — that training on examples of the task itself substantially helps smaller models, and that even imperfect neural reasoners make effective assistants to a symbolic prover — and with what all this suggests about what "learning logic" could mean for a system that learns from data.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Faithful Explanations in the Age of Large Language Models''' (Mateusz Lango, Charles University in Prague)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">The fluency of modern large language models may lead to a perception that natural language generation is close to solved, yet a closer look reveals a recurring pattern of failure whenever a task requires exact, discrete fidelity to some underlying structure rather than fluent pattern completion. Reasoning that is straightforward in a single turn becomes surprisingly brittle across a dialogue; generation under explicit lexical or content constraints remains difficult to guarantee; and explanations produced by LLM-as-judge systems are frequently unfaithful to the actual decision process they claim to justify. I will argue that these three failures share a common shape: each is a case where an LLM must maintain or produce something exact and discrete, but is instead relying on an implicit, continuous representation not well suited to that job. This talk focuses on the third case - faithful explanation - and asks what happens when we make the intermediate representation explicit and symbolic, rather than leaving it to the model to reconstruct implicitly. I will present two lines of work built on this idea. The first constructs faithful explanations for image classifiers via a pipeline that separates the extraction of the (symbolic, verifiable) evidence behind a decision from its realization into fluent natural language, so that plausibility and faithfulness can be optimized somewhat independently. The second uses LLMs not to generate text directly, but to author interpretable, rule-based generation systems from scratch, producing data-to-text generators that are faithful and inspectable by construction rather than by post-hoc checking. Together, these case studies suggest a general recipe for faithful explanation: let neural models handle fluency and search, and let symbolic structure carry the guarantees.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Towards Temporal Intelligence in Language Technologies: Modeling, Retrieval, and Reasoning''' (Adam Jatowt, University of Innsbruck)|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Time is central to how we understand the world. It shapes how we interpret events, construct narratives, and reason about change, causality, and evidence. In this talk, I will first examine how well large language models handle temporal information and temporal reasoning, an essential but still less explored dimension of language intelligence. I will then discuss recent advances in incorporating temporal awareness into language technologies, including time-aware representation learning, retrieval from evolving document collections, and the development of new resources for training and evaluation. I will also introduce temporal reasoning-oriented question answering and retrieval benchmarks that highlight the challenges of retrieving time-sensitive information, answering complex temporal questions, and reasoning over changing evidence. The talk will conclude with open challenges for building language technologies that can better understand, retrieve, and reason over information across time.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''In Search for Universal Language Similarity Metric with Application in Multilingual AI''' (Michał Ptaszyński, Kitami Institute of Technology)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">How similar must two languages be for an AI model trained on one to work on the other, and can we know before training? Multilingual AI models are usually trained on a few high-resource languages and then applied to many others. This lecture presents qWALS, an open-source metric of structural distance between more than 2,600 languages, built on nearly 200 features from the World Atlas of Language Structures (WALS), including word order, morphology, phonology, negation and grammatical gender. Unlike vector-based measures, every qWALS feature can be inspected and re-weighted for a given task.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">I show that cross-lingual transfer works better the more similar the source and target languages are. Once the features relevant to a task are selected, qWALS predicts transfer performance in syntactic parsing almost perfectly (up to r = −0.99). For Polish, a model trained on other Slavic languages clearly outperforms one trained on English. To additionally valuidate qWALS, three professional linguists judged 769 language-pair similarity questions, and their answers agreed with qWALS at least as closely as with each other.|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Finally, I discuss what this means for multilingual models and LLMs, namely, choosing source languages for transfer, estimating performance before training, and deciding which languages to include in training data. This matters most for low-resource and endangered languages, where data is scarce and the choice of source language matters most.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''AI Argues Differently: Distinctive Persuasive Patterns and Communicative Strategies of LLMs''' (Agnieszka Faleńska, University of Stuttgart)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">Large language models are becoming remarkably good at producing language that sounds convincing, respectful, and socially appropriate. But does this mean they are becoming better communicators?|| ||<style="border:0;padding-left:30px;padding-bottom:5px">In this talk, I explore this question through a series of studies examining how language models differ from human writers, construct persuasive arguments, and adapt to their conversational partners. We will see that AI-generated language exhibits distinctive linguistic patterns, while often appearing more agreeable and persuasive than human writing. Beyond the quality of their arguments, models also reproduce subtle communicative strategies, such as expressing trust, acknowledging different perspectives, and establishing common ground. Yet the very linguistic choices that make communication seem natural and engaging can also carry unintended social meanings, signalling familiarity, hierarchy, or social expectations that may be inappropriate in a given context.|| ||<style="border:0;padding-left:30px;padding-bottom:10px">Together, these findings highlight a fundamental challenge for human–AI interaction: producing human-like language is not the same as navigating its social meaning. Understanding AI communication requires looking beyond fluency and correctness to the social functions of language and how people interpret them.|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Safety Vulnerabilities in Spoken Language Models and Web Agents''' (Karolina Stańczak, ETH Zurich)|| ||<style="border:0;padding-left:30px;padding-bottom:15px">LLM-based AI systems are rapidly expanding beyond single-modality text generation. Spoken language models combine speech and text to enable natural voice-based interaction, while web agents now act autonomously on real websites, completing complex tasks on a user's behalf. Both introduce new attack opportunities that existing safety evaluations were not designed to capture. This presentation will explore these two topics. First, I will present JAMA (Joint Audio-text Multimodal Attack), which shows that jailbreaking spoken language models by perturbing a single modality is insufficient. Jointly optimizing adversarial perturbations across both text and audio increases jailbreak success by up to 20x over unimodal attacks, while a sequential approximation keeps this attack computationally efficient. Second, I will introduce !SafeArena, the first benchmark designed to evaluate the deliberate misuse of web agents across categories such as misinformation, illegal activity, and cybercrime. Our Agent Risk Assessment framework reveals that leading agents, including GPT-4o and Claude-3.5 Sonnet, complete an alarming number of harmful tasks. I will conclude this talk by discussing why safety evaluation must keep pace with how LLM-based systems are deployed, accounting for both their expanding modalities and growing agentic capabilities.|| |
| Line 47: | Line 88: |
||<style="border:0;padding-top:10px">Please see also [[http://nlp.ipipan.waw.pl/NLP-SEMINAR/previous-e.html|the talks given in 2000–2015]] and [[http://zil.ipipan.waw.pl/seminar-archive|2015–2020]].|| |
||<style="border:0;padding-top:10px">Please see also [[http://nlp.ipipan.waw.pl/NLP-SEMINAR/previous-e.html|the talks given in 2000–2015]] and [[http://zil.ipipan.waw.pl/seminar-archive|2015–2026]].|| |
| Line 53: | Line 92: |
| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''2 April 2020'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Stan Matwin''' (Dalhousie University)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">'''Efficient training of word embeddings with a focus on negative examples'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk delivered in Polish.}} {{attachment:seminarium-archiwum/icon-en.gif|Slides in English.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">This presentation is based on our [[https://pdfs.semanticscholar.org/1f50/db5786913b43f9668f997fc4c97d9cd18730.pdf|AAAI 2018]] and [[https://aaai.org/ojs/index.php/AAAI/article/view/4683|AAAI 2019]] papers on English word embeddings. In particular, we examine the notion of “negative examples”, the unobserved or insignificant word-context co-occurrences, in spectral methods. we provide a new formulation for the word embedding problem by proposing a new intuitive objective function that perfectly justifies the use of negative examples. With the goal of efficient learning of embeddings, we propose a kernel similarity measure for the latent space that can effectively calculate the similarities in high dimensions. Moreover, we propose an approximate alternative to our algorithm using a modified Vantage Point tree and reduce the computational complexity of the algorithm with respect to the number of words in the vocabulary. We have trained various word embedding algorithms on articles of Wikipedia with 2.3 billion tokens and show that our method outperforms the state-of-the-art in most word similarity tasks by a good margin. We will round up our discussion with some general thought s about the use of embeddings in modern NLP.|| |
||<style="border:0;padding-top:5px;padding-bottom:5px">'''17 November 2025''' '''(NOTE: the seminar will start at 16:00)'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Marzena Karpińska''' (Microsoft) || ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''!OneRuler: testing multilingual language models on long contexts'''  {{attachment:seminarium-archiwum/icon-pl.gif|Talk in Polish}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">In this presentation, I will look at how well language models perform when extracting information from texts of up to 128,000 tokens (approximately 100,000 words) in 26 languages, including Polish. The results of the experiments show that as the length of the context increases, the differences between languages with large and small data resources also increase. Surprisingly, even minimal changes in the command (adding the possibility that the information does not exist) cause a significant decrease in effectiveness, especially with longer texts.|| ||<style="border:0;padding-top:5px;padding-bottom:5px">'''11 March 2024'''|| ||<style="border:0;padding-left:30px;padding-bottom:0px">'''Mateusz Krubiński''' (Charles University in Prague)|| ||<style="border:0;padding-left:30px;padding-bottom:5px">[[http://zil.ipipan.waw.pl/seminarium-online|{{attachment:seminarium-archiwum/teams.png}}]] '''Talk title will be given shortly'''  {{attachment:seminarium-archiwum/icon-en.gif|Talk in Polish.}}|| ||<style="border:0;padding-left:30px;padding-bottom:15px">Talk summary will be made available soon.|| |
Natural Language Processing Seminar 2026–2027
The NLP Seminar is organised by the Linguistic Engineering Group at the Institute of Computer Science, Polish Academy of Sciences (ICS PAS). It takes place on (some) Mondays, usually at 10:15 am, often online – please use the link next to the presentation title. All recorded talks are available on YouTube. |
7 September 2026 |
Varvara Magomedova (University of Nova Gorica) |
Slovenian dialect research has produced a lot of literature, but not as many data sources. The lack of available syntactically annotated corpora limits research for those, who do not have access to native speakers. This talk presents the first phase of Veje – to become a Slovenian dialect treebank. The present version of the pipeline is designed to reduce the manual work. The pipeline has two modules – normalization and annotation. In the first stage, dialectal surface forms are normalized towards standard Slovenian through a sequence of corrected lexical replacements, deterministic phonological rules, Sloleks-based morphological validation, and a constrained GaMS residual corrector. The process preserves token order and alignment wherever possible and records substitutions that cannot be morphologically verified for later review. In the second stage, normalized sentences are parsed with the non-standard Slovenian CLASSLA-Stanza model, while SloBERTa identifies whatever could not be normalized and sends it to GaMS for a second check of the annotation. The resulting extended CoNLL-U representation retains the original dialect form alongside its normalized equivalent, Universal Dependencies annotation, dialect metadata, and audit information. The current output is intentionally silver-standard: native speakers and dialectologists will correct selected data into a gold subset, which will subsequently support evaluation and model fine-tuning. I will also show the web-platform developed based on user needs study held with corpora users. |
21 September 2026 |
Mirosław Koziarski (independent researcher) |
The Dictionary of the Polish Language, edited by Jan Karłowicz, Adam Kryński, and Władysław Niedźwiedzki and commonly known as the Varsovian Dictionary, is one of the most important and extensive works of Polish lexicography. Its eight volumes, published between 1900 and 1927 and comprising almost 7,800 pages, document Polish from a wide range of periods, regions, registers, and domains. Although scans of the dictionary are available in digital libraries, its content has largely remained locked within images of printed pages. |
In this presentation, I will introduce the project of a digital edition of the Varsovian Dictionary, which develops the methodology and tools designed as part of my doctoral dissertation. I will discuss the successive stages of processing: source selection and analysis, image processing and segmentation, OCR—now also supported by AI-based tools—text correction and normalisation, hierarchical parsing of dictionary entries, validation, indexing, and the generation of derived data. The core component is a parser that transforms a linear transcription into a structured XML representation. It identifies several dozen types of segments, including headwords, variants, grammatical information, senses and subsenses, definitions, qualifiers, usage examples, etymologies, cross-references, and phraseological units, as well as the relations between them. Given the complexity and inconsistency of the source material, the process is iterative and combines automatic methods with manual verification. |
The online edition extends an earlier research prototype into a gradually expanding platform. Users can compare a formatted entry with its source transcription, raw XML, and the corresponding facsimile. Structuring the content also makes it possible to create new paths of access to the data: a corpus of examples, collections of derivative pairs, a consolidated index of abbreviations, quantitative statistics, and a matrix comparing the dictionary’s headword inventory with those of other Polish dictionaries. |
Finally, I will present the current state of the project, its quality-control mechanisms, and the limitations of automatic processing of historical lexicographic material. I will also outline planned developments. |
19 October 2026 |
Justyna Gromada, Natalia Krawczyk (Orange Research) |
|
The first part of the talk will introduce the CURIE research program, within Orange Research in Poland. We will focus on the evaluation of conversational agents, particularly in sales dialogues. The second part will present an approach to modeling user satisfaction in sales dialogues. Using 5200 simulated phone-sales conversations between the bot and the user, we developed an annotation framework for offers, cross-selling attempts, and customer decisions. We then derived metrics capturing aspects such as sales outcomes, negotiation patterns, and final cart contents. A model based on these metrics achieved results close to those of a model analyzing the dialogue text, while also helping to identify what influences customer satisfaction. |
22 October 2026 |
Nina Smirnova (GESIS – Leibniz Institute for the Social Sciences) |
|
This seminar presents our work on processing and providing access to parliamentary transcripts as part of a specialized information service for political science. Our goal is to create a unified, searchable collection of parliamentary speeches from different countries and languages, with a particular focus on making these resources accessible to researchers without extensive programming expertise. |
At the center of this work is PoliCorp, a web-based platform for searching and exploring processed political texts. In contrast to initiatives such as Parla-CLARIN and related parliamentary corpora, PoliCorp emphasizes intuitive, browser-based access to the data. Its advanced search functionality allows researchers to combine or exclude criteria using logical operators and to search across multiple metadata and text fields. This makes it possible to construct targeted subcorpora and investigate complex patterns within large collections of parliamentary debates. Selected data can subsequently be downloaded in JSON format for further computational analysis. |
The current collection includes transcripts from the German Bundestag and German state parliaments. We are extending the corpus to include parliamentary debates from France and Poland, moving toward a multilingual and cross-national research infrastructure. |
The seminar will introduce the main stages involved in building such a resource, from preprocessing and structuring parliamentary transcripts to storing, indexing, and making them searchable on the web. We will discuss both the technical and methodological challenges of harmonizing heterogeneous parliamentary data across institutions, countries, and languages. |
Finally, we will demonstrate how these corpora can support substantive research in political science and computational social science. |
9 November 2026 |
Piotr Pęzik, Filip Żarnecki, Wojciech Janowski, Jakub Kwiatkowski, Paweł Wilk, Łukasz Stolarski (University of Łódź) |
Talk summary will be made available shortly. |
19 November 2026 |
Sabina Tomkins (University of Michigan) |
Talk summary will be made available shortly. |
23 November 2026 |
|
Persuasion in Parliament and Beyond: Computational Analysis of Political Discourse |
|
Mini-conference supported by the Polish Academy od Sciences (MOST PAN) |
|
|
|
The talk presents the ParlaMint corpora of parliamentary debates of 29 European countries and autonomous regions, covering at least the period from 2015 to 2022, and containing over 1 billion words. The corpora are uniformly encoded, contain rich metadata about their 24 thousand speakers, and are linguistically annotated, as well as machine translated to English. We present the compilation of the corpora, including the encoding infrastructure, use of GitHub, the production of individual corpora, the common pipeline for producing their distribution, and use of CLARIN services for dissemination. We also present associated efforts, such corpora of additional countries, and the ParlaSpeech corpora. Finally, the use of the corpora and further work are discussed. |
|
|
|
The Polish Parliamentary Corpus, which is also represented in ParlaMint, served as a model for a series of Polish corpora containing similar types of material, which are ideally suited to research into persuasion techniques. The presentation will introduce these datasets: the Round Table Corpus, documenting the opposition’s negotiations with the communist authorities of the Polish People’s Republic in 1989, and the Polish Local Government Debates Corpus – a collection of transcripts from the proceedings of provincial assemblies, city councils, county councils and local councils from 2018 to 2026. |
|
|
|
This talk provides an overview of recently developed multilingual corpora with text span-level annotation of persuasion techniques in online news, parliamentary debates, and other types of texts. The talk will elaborate on the corpora characteristics, taxonomies, creation process, and annotation complexity aspects. The talk will also reflect on the experience gained from shared tasks revolving around detection and classification of persuasion techniques which exploit these corpora, and covers state-of-the-art performance and cross-corpora comparison. |
|
|
|
This talk introduces novel human-annotated disinformation datasets that enable the analysis of manipulation techniques and malicious intent in Polish and English. It presents reasoning approaches that explicitly incorporate persuasion and intent to improve LLM-based disinformation detection across domains, genres, and languages. Finally, it introduces a multilingual benchmark of human- and AI-generated persuasive content, showing that AI-generated persuasive text exhibits linguistic differences and poses new challenges for detection. Overall, the talk presents new datasets, reasoning frameworks, and empirical insights toward more transparent and generalizable disinformation detection in the era of generative AI. |
|
|
|
Talk summary will be made available soon. |
|
|
|
Parliamentary corpora offer rich speech texts and speaker metadata but rarely capture interpersonal sentiment between legislators. Research on legislative relationships relies mainly on roll-call votes and co-sponsorship, reflecting behavioural alignment rather than expressed attitudes such as approval, criticism, or hostility. We introduce ParlSent-EU, a cross-national dataset of directed interpersonal sentiment relations from plenary speeches in the Polish Sejm, German Bundestag, and French Assemblée nationale, spanning over three decades from the 1990s. It was developed by Warsaw University of Technology (OMINO project) and GESIS – Leibniz Institute for the Social Sciences (POLLUX project). Each relation records a speaker, a targeted legislator, and the expressed sentiment (positive, neutral, or negative), with temporal, parliamentary, and demographic metadata, enabling the reconstruction of directed, signed, and temporal networks. Relations are identified by a pipeline combining lexical filtering, LLM-based sentiment extraction, and rule-based entity disambiguation, validated against manually annotated gold standards with performance metrics and inter-annotator agreement. ParlSent-EU enables comparative, longitudinal studies of elite affective polarization, cross-party hostility, intra-party cohesion, and gendered political communication in European parliamentary democracies. |
|
|
|
Computational work on persuasion has largely focused on detecting rhetorical techniques in text. This talk would ask a complementary question: do those techniques tell us anything about whether an argument actually changes someone's mind? Multi-Strategy Persuasion Scoring is a zero-shot framework in which a large language model reasons about each of six persuasion strategies independently and produces a per-strategy score, which can then be aggregated directly or used as input to a lightweight classifier. The strategy has been tested across three datasets, proving that strategy-guided reasoning consistently outperforms both direct pairwise comparison and generic chain-of-thought baselines. |
30 November 2026 |
|
AI without Borders |
|
Mini-conference supported by the Polish Academy od Sciences (MOST PAN) |
|
|
|
Multiword expressions (MWEs), like "biały kruk" (lit. a white crow, 'a rare person or thing') or "krew kogoś zalewa" (lit. blood floods someone, 'someone get furious'), a "być komuś na rękę (lit. to be on hand to someone, 'to be convenient'), or "wchodzić w grę" (lit. to enter the play, 'to come into play'), are combinations of words which exhibit idiosyncratic behavior on the lexical, morphological, syntactic, and semantic levels. Their most outstanding feature is their semantic non-compositionality, i.e. the fact that their meaning cannot be straightforwardly deduced form the meanings of their components. |
|
MWEs pose severe challenges in semantically-oriented NLP tasks. For instance paraphrasing sentences containing idioms is hindered by their lexical and morpho-syntactic inflexibility. Thus, when applying usual paraphrasing techniques to "krew kogoś zalewa", we often obtain incorrect paraphrases, in which the idiomatic meaning is lost, e.g. "ktoś jest zalany krwią" (someone is flooded with blood) or "krew kogoś oblewa" (lit. blood poured onto someone). One of the ways to tackle this challenge is to identify MWEs in running text and apply dedicated treatment to them. |
|
MWE identification has been the object of many efforts, and is one of the tasks where supervised encoder-based methods still outperform more recent generative LLMs. Paraphrasing of MWEs is an understudied task, especially in multilingual contexts. These two tasks have been the subject of longstanding effort within two European COST networks: PARSEME (2013–2017) and UniDive (2022–2026), which are notably the organizers of 5 multilingual evaluation campaigns on these topics. I will summarize major challenges and findings from these campaigns and highlight future work. |
|
|
|
Modern detectors identify only who wrote the words. However, AI-assisted writing is becoming more common. For instance, a user may use AI tools to polish their writing or produce the text from their supplied content. Hence, it is becoming important to detect who contributed the ideas not only the prose. In this talk, I will first discuss the specificities of AI writing at the prose and content levels. Then I will talk about training Idealens, an AI detector that works based on document content, rather than its prose. |
|
|
|
Large language models now produce chains of reasoning that look like proofs, but it remains unclear whether they have acquired the rules of inference or merely the patterns that usually accompany them. I will describe a line of joint work with Manuel Vargas Guzmán and Maciej Malicki |
|
|
|
The fluency of modern large language models may lead to a perception that natural language generation is close to solved, yet a closer look reveals a recurring pattern of failure whenever a task requires exact, discrete fidelity to some underlying structure rather than fluent pattern completion. Reasoning that is straightforward in a single turn becomes surprisingly brittle across a dialogue; generation under explicit lexical or content constraints remains difficult to guarantee; and explanations produced by LLM-as-judge systems are frequently unfaithful to the actual decision process they claim to justify. I will argue that these three failures share a common shape: each is a case where an LLM must maintain or produce something exact and discrete, but is instead relying on an implicit, continuous representation not well suited to that job. This talk focuses on the third case - faithful explanation - and asks what happens when we make the intermediate representation explicit and symbolic, rather than leaving it to the model to reconstruct implicitly. I will present two lines of work built on this idea. The first constructs faithful explanations for image classifiers via a pipeline that separates the extraction of the (symbolic, verifiable) evidence behind a decision from its realization into fluent natural language, so that plausibility and faithfulness can be optimized somewhat independently. The second uses LLMs not to generate text directly, but to author interpretable, rule-based generation systems from scratch, producing data-to-text generators that are faithful and inspectable by construction rather than by post-hoc checking. Together, these case studies suggest a general recipe for faithful explanation: let neural models handle fluency and search, and let symbolic structure carry the guarantees. |
|
|
|
Time is central to how we understand the world. It shapes how we interpret events, construct narratives, and reason about change, causality, and evidence. In this talk, I will first examine how well large language models handle temporal information and temporal reasoning, an essential but still less explored dimension of language intelligence. I will then discuss recent advances in incorporating temporal awareness into language technologies, including time-aware representation learning, retrieval from evolving document collections, and the development of new resources for training and evaluation. I will also introduce temporal reasoning-oriented question answering and retrieval benchmarks that highlight the challenges of retrieving time-sensitive information, answering complex temporal questions, and reasoning over changing evidence. The talk will conclude with open challenges for building language technologies that can better understand, retrieve, and reason over information across time. |
|
|
|
How similar must two languages be for an AI model trained on one to work on the other, and can we know before training? Multilingual AI models are usually trained on a few high-resource languages and then applied to many others. This lecture presents qWALS, an open-source metric of structural distance between more than 2,600 languages, built on nearly 200 features from the World Atlas of Language Structures (WALS), including word order, morphology, phonology, negation and grammatical gender. Unlike vector-based measures, every qWALS feature can be inspected and re-weighted for a given task. |
|
I show that cross-lingual transfer works better the more similar the source and target languages are. Once the features relevant to a task are selected, qWALS predicts transfer performance in syntactic parsing almost perfectly (up to r = −0.99). For Polish, a model trained on other Slavic languages clearly outperforms one trained on English. To additionally valuidate qWALS, three professional linguists judged 769 language-pair similarity questions, and their answers agreed with qWALS at least as closely as with each other. |
|
Finally, I discuss what this means for multilingual models and LLMs, namely, choosing source languages for transfer, estimating performance before training, and deciding which languages to include in training data. This matters most for low-resource and endangered languages, where data is scarce and the choice of source language matters most. |
|
|
|
Large language models are becoming remarkably good at producing language that sounds convincing, respectful, and socially appropriate. But does this mean they are becoming better communicators? |
|
In this talk, I explore this question through a series of studies examining how language models differ from human writers, construct persuasive arguments, and adapt to their conversational partners. We will see that AI-generated language exhibits distinctive linguistic patterns, while often appearing more agreeable and persuasive than human writing. Beyond the quality of their arguments, models also reproduce subtle communicative strategies, such as expressing trust, acknowledging different perspectives, and establishing common ground. Yet the very linguistic choices that make communication seem natural and engaging can also carry unintended social meanings, signalling familiarity, hierarchy, or social expectations that may be inappropriate in a given context. |
|
Together, these findings highlight a fundamental challenge for human–AI interaction: producing human-like language is not the same as navigating its social meaning. Understanding AI communication requires looking beyond fluency and correctness to the social functions of language and how people interpret them. |
|
|
|
LLM-based AI systems are rapidly expanding beyond single-modality text generation. Spoken language models combine speech and text to enable natural voice-based interaction, while web agents now act autonomously on real websites, completing complex tasks on a user's behalf. Both introduce new attack opportunities that existing safety evaluations were not designed to capture. This presentation will explore these two topics. First, I will present JAMA (Joint Audio-text Multimodal Attack), which shows that jailbreaking spoken language models by perturbing a single modality is insufficient. Jointly optimizing adversarial perturbations across both text and audio increases jailbreak success by up to 20x over unimodal attacks, while a sequential approximation keeps this attack computationally efficient. Second, I will introduce SafeArena, the first benchmark designed to evaluate the deliberate misuse of web agents across categories such as misinformation, illegal activity, and cybercrime. Our Agent Risk Assessment framework reveals that leading agents, including GPT-4o and Claude-3.5 Sonnet, complete an alarming number of harmful tasks. I will conclude this talk by discussing why safety evaluation must keep pace with how LLM-based systems are deployed, accounting for both their expanding modalities and growing agentic capabilities. |
Please see also the talks given in 2000–2015 and 2015–2026. |





that tries to make this question precise enough to answer. We use syllogistic logic — a small, fully controlled fragment of natural language — as a testbed, and ask models not whether a conclusion holds but which premises are needed to derive it. This lets us separate two things usually conflated under "compositional generalization": extending a learned pattern to longer chains of reasoning, and recovering the underlying rules from complex cases to apply them to simpler ones. Models turn out to be markedly better at the first than the second, and their success depends systematically on the shape of the inference rather than its difficulty. I will end with two more encouraging results — that training on examples of the task itself substantially helps smaller models, and that even imperfect neural reasoners make effective assistants to a symbolic prover — and with what all this suggests about what "learning logic" could mean for a system that learns from data.