The NLP Seminar is organised by the Linguistic Engineering Group at the Institute of Computer Science, Polish Academy of Sciences (ICS PAS). It takes place on (some) Mondays, normally at 10:15 am, in the seminar room of the ICS PAS (ul. Jana Kazimierza 5, Warszawa). All recorded talks are available on YouTube.

NOTE: Due to restriction of admission to the Institute building, only staff and speakers (including external ones) may currently take part in the seminar. For all other participants the seminar will be broadcast on https://www.youtube.com/channel/UC5PEPpMqjAr7Pgdvq0wRn0w.

5 October 2020

Piotr Rybak, Robert Mroczkowski, Janusz Tracz (ML Research at Allegro.pl), Ireneusz Gawlik (ML Research at Allegro.pl & AGH University of Science and Technology)

Review of BERT-based Models for Polish Language  

In recent years, a series of BERT-based models improved the performance of many natural language processing systems. During this talk, we will briefly introduce the BERT model as well as some of its variants. Next, we will focus on the available BERT-based models for Polish language and their results on the KLEJ benchmark. Finally, we will dive into the details of the new model developed in cooperation between ICS PAS and Allegro.

19 October 2020

Inez Okulska (NASK National Research Institute)

Concise, robust, sparse? Algebraic transformations of word2vec embeddings versus precision of classification  

The talk summary will be available shortly.

Please see also the talks given in 2000–2015 and 2015–2020.