Locked History Actions

Diff for "Prolexbase"

Differences between revisions 1 and 22 (spanning 21 versions)
Revision 1 as of 2013-01-22 21:51:33
Size: 4210
Editor: AgataSavary
Comment:
Revision 22 as of 2013-01-23 09:21:43
Size: 4682
Editor: AgataSavary
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
= Prolexbase = = Prolexbase 2.0 =
Line 4: Line 4:
Prolexbase is a multilingual relational dictionary of proper names, conceived at the University of Tours, France and further developed at the University of Belgrade, Serbia, and at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. Currently, the resources counts about 40,000 Polish, 33,000 English and 100,000 French proper names together with their corresponding 165,000 Polish, 18,000 English and 142,393 English inflected forms. A large majority of the data have been extracted from Wikipedia. All data have been manually validated. Prolexbase 2.0 is a multilingual relational dictionary of proper names, conceived initially at the University of Tours, France and at the University of Belgrade, Serbia, and further developed at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. A large majority of the data have been extracted from [[http://pl.wikipedia.org|Wikipedia]] and [[http://www.geonames.org/|GeoNames]]. ''All data have been manually validated''.
Line 6: Line 6:
Prolexbase creation has been supported by numerous projects: Prolexbase creation has been supported by the following projects:
Line 9: Line 9:
 *


. The French data

 the ERDF [[http://zil.ipipan.waw.pl/NEKST|Nekst]] project.
 * ERDF [[http://zil.ipipan.waw.pl/NEKST|Nekst]] project,
 * European (CIP ICT-PSP) [[http://clip.ipipan.waw.pl/CESAR|CESAR]] project, part of [[http://www.meta-net.eu/|META-NET]].
Line 17: Line 13:
 * Savary, A., Manicki, L., Baron, M.: [[http://|ProlexFeeder— Populating a Multilingual Ontology of Proper Names from Open Sources]]. Submitted to Journal of Language Modelling.
 * Bouchou, B., Maurel, D. (2008): [[http://www.atala.org/IMG/pdf/TAL-2008-49-1-04-Bouchou.pdf|Prolexbase et LMF : vers un standard pour les ressources lexicales sur les noms propres]]. In Traitement Automatique des Langues, 49(1).
 * Maurel, D. (2008): [[http://www.lrec-conf.org/proceedings/lrec2008/summaries/91.html|Prolexbase: a Multilingual Relational Lexical Database of Proper Names]]. In proceedings of LREC 2008, Marrakech, Morocco.
 * Tran, M., Maurel, D. (2006): [[http://www.atala.org/IMG/pdf/TAL-2006-47-3-06-Tran.pdf|Prolexbase. Un dictionnaire relationnel multilingue de noms propres]]. In Traitement Automatique des Langues, 47(3).
 * Krstev S., Vitas D., Maurel D., Tran M. (2005), Multilingual Ontology of Proper Names, Second Language & Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, Poznan, Poland.
Line 18: Line 19:
 * GRALIŃSKI, F., SAVARY, A., CZEREPOWICKA, M., MAKOWIECKI, F. (2010): ''[[http://multiword.sourceforge.net/CONF_30_MWE_2010___lb__COLING__rb__/CONF_50_Online_Proceedings/pdf/MWE01.pdf|Computational Lexicography of Multi-Word Units: How Efficient Can It Be?]]'', in Proceedings of Multiword Expressions: from Theory to Applications ([[http://multiword.sourceforge.net/PHITE.php?sitesig=CONF&page=CONF_30_MWE_2010___lb__COLING__rb__|MWE 2010]]), Workshop at COLING 2010, Beijing, China, August 28.
 * SAVARY, A., ZABOROWSKI, B., KRAWCZYK-WIECZOREK, A., MAKOWIECKI, F. (2012): ''SEJFEK — a Lexicon and a Shallow Grammar of Polish Economic Multi-Word Units'', in Proceedings of Cognitive Aspects of the Lexicon ([[http://pageperso.lif.univ-mrs.fr/~michael.zock/cogalex-3.html|COGALEX-III]]), a Workshop at COLING 2012, Mumbai, India.
Prolexbase 2.0 of the resource contains the following interlinked data:
 * 67,000 languge-independent pivots,
 * 40,000 Polish proper names and their corresponding 165,000 inflected forms,
 * 33,000 English proper names and their corresponding 18,000 inflected forms,
 * 100,000 French proper names and their corresponding 142,000 inflected forms,
 * 65,500 relations.
Line 21: Line 26:
The lexicon contains:
 * 11,212 multi-word nominal lexemes (e.g. ''aktywne ryzyko płynności''),
 * 146,861 corresponding inflected forms (e.g. ''aktywnego ryzyka płynności''),
 * 305 graph-based inflection paradigms.

See also [[http://zil.ipipan.waw.pl/SEJFEK4Spejd|SEJFEK4Spejd]] – a shallow grammar for [[http://zil.ipipan.waw.pl/Spejd|Spejd]] with fully lexicalized rules automatically generated from SEJFEK lexicon entries.
See also [[http://www.cnrtl.fr/lexiques/prolex/|Prolexbase on CNRTL]] for a previous version of the French data, serialized in an LMF standard format.
Line 29: Line 29:
 * Filip Makowiecki – lexicography
 * [[http://www.info.univ-tours.fr/~savary/English/indexgb.html|Agata Savary]] – automatic inflection and validation
 
 * Małgorzata Baron - lexicography,
 * [[http://www.info.univ-tours.fr/~bouchou/index_a.html|Béatrice Bouchou Markhoff]] - LMF format design,
 * Leszek Manicki - design and implementation of ProlexFeeder (Prolexbase population from Wikipedia),
 * [[http://www.univ-tours.fr/acces-rapide/m-maurel-denis-84407.kjsp|Denis Maurel]] - design and dissemination, project management,
 * [[http://www.info.univ-tours.fr/~savary/English/indexgb.html|Agata Savary]] – project management,
 * Mickaël Tran - database design and implementation.
Line 33: Line 37:
The lexicon has been created within [[http://zil.ipipan.waw.pl/Toposlaw|Toposław]], tool for developping and managing inflectional dictionaries of multi-word units. Toposław integrates:
 * [[http://sgjp.pl/morfeusz/|Morfeusz SGJP]] – a morphological analyser and generator of Polish,
 * [[http://www.springerlink.com/content/n265j22n73084433/|Multiflex]] – a morpho-syntactic generator of multi-word units,
 * graph editor stemming from [[http://igm.univ-mlv.fr/~unitex/|Unitex]].
 * ''ProlexFeeder'', a tool for semi-automatic population of Prolexbase from open sources, notably Wikipedia and Geonames,
 * [[http://www.translatica.pl/|Translatica]]'s automatic inflection tool for multi-word units.
Line 40: Line 42:
The data are available under the [[http://creativecommons.org/licenses/by-sa/3.0/|CC BY-SA license]]. All Prolexbase 2.0 data are available under the [[http://creativecommons.org/licenses/by-sa/3.0/|CC BY-SA license]], i.e. the same as for [[http://en.wikipedia.org/wiki/Wikipedia:Text_of_Creative_Commons_Attribution-ShareAlike_3.0_Unported_License|Wikipedia]] and [[http://www.geonames.org/|GeoNames]].
Line 44: Line 46:
 * [[attachment:Slownik.tar.gz|Slownik]] – the binary source file in [[http://zil.ipipan.waw.pl/Toposlaw|Toposław]] format
 * [[http://www.springerlink.com/content/n265j22n73084433/|Multiflex]]-compatible [[attachment:SEJFEK.tar.gz|archive]] containing:
   * the list of morphologically annotated lexemes,
   * the list of corresponding inflected forms and variants,
   * inflection graphs compatible with [[http://igm.univ-mlv.fr/~unitex/|Unitex]] graph editor,
   * list of known problems.
 * [[attachment:prolexbase.mysql.tar.gz|MySQL export]] file (to appear),
 * List of all inflected forms of [[attachment:prolexbase-polish-inflected.tar.gz|Polish names]] together with their semantic and grammatical tags (to appear).
 * [[attachment:prolmf.xsd|XML Schema]] for LMF serialisation.
Line 53: Line 52:
Defining an [[http://www.lexicalmarkupframework.org/|LMF]] format for the lexicon.  * Exporting Prolexbase 2.0 to LMF.
 * Opening a web interface for Prolexbase 2.0 navigation.
 * Releasing ProlexFeeder under an open license.

Prolexbase 2.0

Prolexbase 2.0 is a multilingual relational dictionary of proper names, conceived initially at the University of Tours, France and at the University of Belgrade, Serbia, and further developed at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. A large majority of the data have been extracted from Wikipedia and GeoNames. All data have been manually validated.

Prolexbase creation has been supported by the following projects:

  • Technolangue programme from the French Ministry of Industry (2003-2005),

  • Egide Pavle-Savic programme from the Serbian Ministry of Science, the French Ministry of Foreign Affairs and the French Ministry of Research,

  • ERDF Nekst project,

  • European (CIP ICT-PSP) CESAR project, part of META-NET.

Some aspects of its construction, contents and use have been described in:

Prolexbase 2.0 of the resource contains the following interlinked data:

  • 67,000 languge-independent pivots,
  • 40,000 Polish proper names and their corresponding 165,000 inflected forms,
  • 33,000 English proper names and their corresponding 18,000 inflected forms,
  • 100,000 French proper names and their corresponding 142,000 inflected forms,
  • 65,500 relations.

See also Prolexbase on CNRTL for a previous version of the French data, serialized in an LMF standard format.

Authors

  • Małgorzata Baron - lexicography,
  • Béatrice Bouchou Markhoff - LMF format design,

  • Leszek Manicki - design and implementation of ProlexFeeder (Prolexbase population from Wikipedia),

  • Denis Maurel - design and dissemination, project management,

  • Agata Savary – project management,

  • Mickaël Tran - database design and implementation.

Tools

  • ProlexFeeder, a tool for semi-automatic population of Prolexbase from open sources, notably Wikipedia and Geonames,

  • Translatica's automatic inflection tool for multi-word units.

License

All Prolexbase 2.0 data are available under the CC BY-SA license, i.e. the same as for Wikipedia and GeoNames.

Available resources

  • MySQL export file (to appear),

  • List of all inflected forms of Polish names together with their semantic and grammatical tags (to appear).

  • XML Schema for LMF serialisation.

Future work

  • Exporting Prolexbase 2.0 to LMF.
  • Opening a web interface for Prolexbase 2.0 navigation.
  • Releasing ProlexFeeder under an open license.