Size: 3061
Comment:
|
Size: 3251
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 7: | Line 7: |
The current version of PDB consists of 22,208 trees and 351,175 tokens (i.e. 15.8 tokens per sentence on average). There are four parts of PDB: 1. NKJP1M trees (14K) 2. PDB_projected trees (4K) 3. CDScorpus trees (2K) |
PDB 2.0 is an extended version of ''Składnica zależnościowa'' (the first Polish dependency treebank). It consists of 22,208 trees and 351,406 tokens (i.e. 15.8 tokens per sentence on average). There are four parts of PDB 2.0: 1. NKJP1M-based trees (14K) 2. Projection-based trees (4K) 3. CDScorpus-based trees (2K) |
Line 13: | Line 13: |
=== PDB data === | The PDB sentences contain some problematic linguistic phenomena, e.g. ellipsis, comparative constructions, constructions with the bi-functional subordinating conjunction JAKO, directed speech, interpolations and comments, nominative noun phrases used in the vocative function and many others. There are 28 Polish dependency relation types: abbrev_punct, adjunct, adjunct_compar, adjunct_qt, adjunct_rc, aglt, app, aux, comp, comp_ag, comp_fin, comp_inf, cond, conjunct, imp, item, mwe, ne, neg, obj, obj_th, pd, pre_coord, punct, refl, root, subj, vocative. Descritptions of Polish dependency relation types are at [[http://zil.ipipan.waw.pl/PDB/DepRelTypes]] (outdated). Some dependents are annotated with semantic roles, e.g. Beneficiary/Recipient. |
Line 15: | Line 15: |
* Updated [[attachment:NKJP1M_Skladnica_sem.conll|Składnica zależnościowa]] (It is the previous version of PDB with 8K trees) If you wish to get the entire PDB corpus (22K sentences annotated with the dependency trees) please contact ''alina'' <at> ''ipipan.waw.pl'' (replace <at> with @). === PDB relation types === Descritptions of Polish dependency relation types are at [[http://zil.ipipan.waw.pl/PDB/DepRelTypes]] (outdated). |
'''Download''': The updated version of [[attachment:NKJP1M_Skladnica_sem.conll|Składnica zależnościowa]] (the first version of PDB). If you wish to get the entire PDB corpus (22K sentences annotated with the dependency trees) please contact ''alina'' <at> ''ipipan.waw.pl'' (replace <at> with @). |
Line 23: | Line 18: |
== Polish Dependency Bank in Universal Dependencies format (PDBUD) == | |
Line 25: | Line 19: |
PDB is an extended version of Składnica treebank. Since the UD conversion of Składnica trees constitutes the Polish treebank in Universal Dependencies collection (the release 2.1), PDBUD is thus an extended and corrected version of this treebank. | |
Line 27: | Line 20: |
The converted PDBUD trees are largely consistent with Polish UD trees. Składnica trees are rather simple and the sentences underlying this data set do not contain some linguistic phenomena, e.g. ellipsis, comparative constructions, constructions with the bi-functional subordinating conjunction JAKO, directed speech, interpolations and comments, nominative noun phrases used in the vocative function and many others. Therefore, the repertoire of UD relation subtypes and language-specific features is slightly extended to cover these phenomena. Furthermore, PDBUD trees contain enhanced edges encoding shared dependents of coordinated elements, e.g. Dziewczynka śpiewa i tańczy. (The girl sings and dances.), and shared governors of coordinated elements, e.g. Dziewczynka i chłopiec śpiewają. (A girl and a boy sing.) | == PDB in Universal Dependencies format (PDB-UD) == |
Line 29: | Line 22: |
PDBUD trees are currently used in: * Shared task on automatic identification of verbal multiword expressions (LAW-MWE-CxG-2018) * Shared task on dependency parsing of Polish (PolEval 2018, [[http://poleval.pl]]) |
PDB-UD is a conversion of PDB in the UD-like format. It is an extended and corrected version of the Polish UD treebank (the release 2.1). PDB-UD contains enhanced graphs, i.e. trees with enhanced edges encoding shared dependents of coordinated elements, e.g. ''Dziewczynka śpiewa i tańczy'' (The girl sings and dances), and shared governors of coordinated elements, e.g. ''Dziewczynka i chłopiec śpiewają'' (A girl and a boy sing). PDB-UD trees were used in two shared tasks: [[http://multiword.sourceforge.net/PHITE.php?sitesig=CONF&page=CONF_04_LAW-MWE-CxG_2018___lb__COLING__rb__&subpage=CONF_40_Shared_Task|LAW-MWE-CxG-2018]] and [[http://poleval.pl|PolEval 2018]]. |
Line 33: | Line 25: |
=== PDBUD data === Link to [[http://git.nlp.ipipan.waw.pl/alina/PDBUD|PDBUD]] |
'''Download:''' PDB-UD is publicly available on [[http://git.nlp.ipipan.waw.pl/alina/PDBUD]] |
Line 36: | Line 27: |
== PDB parser == Some dependency parsing models estimated on PDB are available at [[http://zil.ipipan.waw.pl/PDB/PDBparser]] |
== PDB-based parsers == Some dependency parsing models estimated on PDB and PDB-UD are available at [[http://zil.ipipan.waw.pl/PDB/PDBparser]] |
Line 39: | Line 30: |
== Publications == | === Publications === |
Line 41: | Line 32: |
== Acknowledgements == | <<BibMate(key, "wro:14", omitYears=true)>> <<BibMate(key, "wrob:18", omitYears=true)>> === Acknowledgements === |
Line 45: | Line 39: |
== Licence == | === Licence === |
Line 47: | Line 41: |
The resources is distributed under the [[https://creativecommons.org/licenses/by-nc-sa/4.0/|CC BY-NC-SA 4.0]] licence. | The resources are distributed under the [[https://creativecommons.org/licenses/by-nc-sa/4.0/|CC BY-NC-SA 4.0]] licence. |
Line 49: | Line 43: |
== Contact == | === Contact === |
Polish Dependency Bank 2.0 (PDB 2.0)
PDB 2.0 is an extended version of Składnica zależnościowa (the first Polish dependency treebank). It consists of 22,208 trees and 351,406 tokens (i.e. 15.8 tokens per sentence on average). There are four parts of PDB 2.0:
- NKJP1M-based trees (14K)
- Projection-based trees (4K)
- CDScorpus-based trees (2K)
- OTHER trees (2K)
The PDB sentences contain some problematic linguistic phenomena, e.g. ellipsis, comparative constructions, constructions with the bi-functional subordinating conjunction JAKO, directed speech, interpolations and comments, nominative noun phrases used in the vocative function and many others. There are 28 Polish dependency relation types: abbrev_punct, adjunct, adjunct_compar, adjunct_qt, adjunct_rc, aglt, app, aux, comp, comp_ag, comp_fin, comp_inf, cond, conjunct, imp, item, mwe, ne, neg, obj, obj_th, pd, pre_coord, punct, refl, root, subj, vocative. Descritptions of Polish dependency relation types are at http://zil.ipipan.waw.pl/PDB/DepRelTypes (outdated). Some dependents are annotated with semantic roles, e.g. Beneficiary/Recipient.
Download: The updated version of Składnica zależnościowa (the first version of PDB). If you wish to get the entire PDB corpus (22K sentences annotated with the dependency trees) please contact alina <at> ipipan.waw.pl (replace <at> with @).
PDB in Universal Dependencies format (PDB-UD)
PDB-UD is a conversion of PDB in the UD-like format. It is an extended and corrected version of the Polish UD treebank (the release 2.1). PDB-UD contains enhanced graphs, i.e. trees with enhanced edges encoding shared dependents of coordinated elements, e.g. Dziewczynka śpiewa i tańczy (The girl sings and dances), and shared governors of coordinated elements, e.g. Dziewczynka i chłopiec śpiewają (A girl and a boy sing). PDB-UD trees were used in two shared tasks: LAW-MWE-CxG-2018 and PolEval 2018.
Download: PDB-UD is publicly available on http://git.nlp.ipipan.waw.pl/alina/PDBUD
PDB-based parsers
Some dependency parsing models estimated on PDB and PDB-UD are available at http://zil.ipipan.waw.pl/PDB/PDBparser
Publications
Acknowledgements
The creation of PDB was supported by grant no POIG.01.01.02-14-013/09 from Innovative Economy Operational Programme co-financed by the European Union (European Regional Development Fund) and by the grant from the Polish Ministry of Science and Higher Education as part of the investment in the CLARIN-PL research infrastructure (2016-2018).
Licence
The resources are distributed under the CC BY-NC-SA 4.0 licence.
Contact
Any questions, comments? Please send them to Alina Wróblewska <alina AT SPAMFREE ipipan DOT waw DOT pl>.