Locked History Actions

Diff for "Prolexbase"

Differences between revisions 1 and 50 (spanning 49 versions)
⇤ ← Revision 1 as of 2013-01-22 21:51:33 →
Size: 4210
Editor: AgataSavary
Comment:
← Revision 50 as of 2015-02-11 19:22:22 → ⇥
Size: 5800
Editor: AgataSavary
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
= Prolexbase = = Prolexbase 2.0 =
Line 4: Line 4:
Prolexbase is a multilingual relational dictionary of proper names, conceived at the University of Tours, France and further developed at the University of Belgrade, Serbia, and at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. Currently, the resources counts about 40,000 Polish, 33,000 English and 100,000 French proper names together with their corresponding 165,000 Polish, 18,000 English and 142,393 English inflected forms. A large majority of the data have been extracted from Wikipedia. All data have been manually validated. Prolexbase 2.0 is a multilingual relational dictionary of proper names, conceived initially at the University of Tours, France and at the University of Belgrade, Serbia, and further developed at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. A large majority of the data have been extracted from [[http://pl.wikipedia.org|Wikipedia]] and [[http://www.geonames.org/|GeoNames]]. ''All data have been manually validated''.
Line 6: Line 6:
Prolexbase creation has been supported by numerous projects: Prolexbase creation has been supported by the following projects:
Line 8: Line 8:
 * Egide [[http://tln.li.univ-tours.fr/Tln_Pavle_Savic.html|Pavle-Savic]] programme from the Serbian Ministry of Science, the French Ministry of Foreign Affairs and the French Ministry of Research,
 * 		 * Egide [[http://tln.li.univ-tours.fr/Tln_Pavle_Savic.html|Pavle-Savic]] programme from the French Ministry of Foreign Affairs, the French Ministry of Research, and the Serbian Ministry of Science (2004-2005),
 * ERDF [[http://zil.ipipan.waw.pl/NEKST|Nekst]] project (2009-2014),
 * European (CIP ICT-PSP) [[http://clip.ipipan.waw.pl/CESAR|CESAR]] project, part of [[http://www.meta-net.eu/|META-NET]] (2011-2013).
      
The construction and contents of Prolexbase have been described in:
 * Savary, A., Manicki, L., Baron, M. (2013): [[http://nlp.ipipan.waw.pl/ojs/index.php/JLM/article/view/63|Populating a Multilingual Ontology of Proper Names from Open Sources]]. In Journal of Language Modelling, Vol 2, No. 2, pp. 189-225.
 * Savary, A., Manicki, L., Baron, M. (2013): [[http://www.info.univ-tours.fr/~savary/Papers/sav-man-bar-rapport-306.pdf|ProlexFeeder - Populating a Multilingual Ontology of Proper Names from Open Sources]]. Technical Report 306, Laboratoire d'Informatique, Université François Rabelais Tours, France.
 * Maurel, D., Bouchou, B. (2013): ''Prolmf, a Multilingual Dictionary of Proper Names and their Relations''. In Gil Francopoulo (ed.), LMF: Lexical Markup Framework, theory and practice, Iste-Wiley, pp. 67-81.
 * Spędzia, M., Maurel, D., Savary, A. (2011): ''[[attachment:prolexbase.documentation.pdf|Multilingual Relational Database of Proper Names: Prolexbase Documentation]]''. Technical report #297, Laboratoire d'informatique, Université François Rabelais Tours.
 * Bouchou, B., Maurel, D. (2008): ''[[http://www.atala.org/IMG/pdf/TAL-2008-49-1-04-Bouchou.pdf|Prolexbase et LMF : vers un standard pour les ressources lexicales sur les noms propres]]''. In Traitement Automatique des Langues, 49(1).
 * Maurel, D. (2008): ''[[http://www.lrec-conf.org/proceedings/lrec2008/summaries/91.html|Prolexbase: a Multilingual Relational Lexical Database of Proper Names]]''. In proceedings of LREC 2008, Marrakech, Morocco.
 * Tran, M., Maurel, D. (2006): ''[[http://www.atala.org/IMG/pdf/TAL-2006-47-3-06-Tran.pdf|Prolexbase. Un dictionnaire relationnel multilingue de noms propres]]''. In Traitement Automatique des Langues, 47(3).
 * Krstev S., Vitas D., Maurel D., Tran M. (2005): ''Multilingual Ontology of Proper Names''. In Second Language & Technology Conference (LTC'05), Poznań, Poland.
Line 11: Line 22:
Prolexbase 2.0 contains the following interlinked data:
 * 67,000 language-independent pivots,
 * 40,000 Polish proper names and their corresponding 165,000 inflected forms,
 * 33,000 English proper names and their corresponding 18,000 inflected forms,
 * 100,000 French proper names and their corresponding 142,000 inflected forms,
 * 65,500 relations.
Line 12: Line 29:
. The French data

 the ERDF [[http://zil.ipipan.waw.pl/NEKST|Nekst]] project.
      
Some aspects of its construction, contents and use have been described in:

 * GRALIŃSKI, F., SAVARY, A., CZEREPOWICKA, M., MAKOWIECKI, F. (2010): ''[[http://multiword.sourceforge.net/CONF_30_MWE_2010___lb__COLING__rb__/CONF_50_Online_Proceedings/pdf/MWE01.pdf|Computational Lexicography of Multi-Word Units: How Efficient Can It Be?]]'', in Proceedings of Multiword Expressions: from Theory to Applications ([[http://multiword.sourceforge.net/PHITE.php?sitesig=CONF&page=CONF_30_MWE_2010___lb__COLING__rb__|MWE 2010]]), Workshop at COLING 2010, Beijing, China, August 28.
 * SAVARY, A., ZABOROWSKI, B., KRAWCZYK-WIECZOREK, A., MAKOWIECKI, F. (2012): ''SEJFEK — a Lexicon and a Shallow Grammar of Polish Economic Multi-Word Units'', in Proceedings of Cognitive Aspects of the Lexicon ([[http://pageperso.lif.univ-mrs.fr/~michael.zock/cogalex-3.html|COGALEX-III]]), a Workshop at COLING 2012, Mumbai, India.

The lexicon contains:
 * 11,212 multi-word nominal lexemes (e.g. ''aktywne ryzyko płynności''),
 * 146,861 corresponding inflected forms (e.g. ''aktywnego ryzyka płynności''),
 * 305 graph-based inflection paradigms.

See also [[http://zil.ipipan.waw.pl/SEJFEK4Spejd|SEJFEK4Spejd]] – a shallow grammar for [[http://zil.ipipan.waw.pl/Spejd|Spejd]] with fully lexicalized rules automatically generated from SEJFEK lexicon entries.		 See also [[http://www.cnrtl.fr/lexiques/prolex/|Prolexbase on CNRTL]] for a proofread version (2.2), serialized in an LMF standard format.
Line 29: Line 32:
 * Filip Makowiecki – lexicography
 * [[http://www.info.univ-tours.fr/~savary/English/indexgb.html|Agata Savary]] – automatic inflection and validation
 		  * Małgorzata Baron - lexicography,
 * [[http://www.info.univ-tours.fr/~bouchou/index_a.html|Béatrice Bouchou Markhoff]] - LMF format design,
 * Leszek Manicki - design and implementation of Prolexbase population from Wikipedia,
 * [[http://www.univ-tours.fr/acces-rapide/m-maurel-denis-84407.kjsp|Denis Maurel]] - design and dissemination, project management,
 * [[http://www.info.univ-tours.fr/~savary/English/indexgb.html|Agata Savary]] – project management,
 * Mickaël Tran - database design and implementation.
 * [[http://poincare.matf.bg.ac.rs/~vitas//index-en.html|Duško Vitas]] - design and management of Serbian data.
Line 33: Line 41:
The lexicon has been created within [[http://zil.ipipan.waw.pl/Toposlaw|Toposław]], tool for developping and managing inflectional dictionaries of multi-word units. Toposław integrates:
 * [[http://sgjp.pl/morfeusz/|Morfeusz SGJP]] – a morphological analyser and generator of Polish,
 * [[http://www.springerlink.com/content/n265j22n73084433/|Multiflex]] – a morpho-syntactic generator of multi-word units,
 * graph editor stemming from [[http://igm.univ-mlv.fr/~unitex/|Unitex]].		  * ''ProlexFeeder'', a tool for semi-automatic population of Prolexbase from open sources, notably Wikipedia and Geonames,
 * [[http://www.translatica.pl/|Translatica]]'s automatic inflection tool for multi-word units.
Line 40: Line 46:
The data are available under the [[http://creativecommons.org/licenses/by-sa/3.0/|CC BY-SA license]]. All Prolexbase 2.0 data are available under the [[http://creativecommons.org/licenses/by-sa/3.0/|CC BY-SA license]], i.e. the same as for [[http://en.wikipedia.org/wiki/Wikipedia:Text_of_Creative_Commons_Attribution-ShareAlike_3.0_Unported_License|Wikipedia]] and [[http://www.geonames.org/|GeoNames]].
Line 44: Line 50:
 * [[attachment:Slownik.tar.gz|Slownik]] – the binary source file in [[http://zil.ipipan.waw.pl/Toposlaw|Toposław]] format
 * [[http://www.springerlink.com/content/n265j22n73084433/|Multiflex]]-compatible [[attachment:SEJFEK.tar.gz|archive]] containing:
   * the list of morphologically annotated lexemes,
   * the list of corresponding inflected forms and variants,
   * inflection graphs compatible with [[http://igm.univ-mlv.fr/~unitex/|Unitex]] graph editor,
   * list of known problems.		 For version 2.2
 * XML serialisation in an LMF standard format, and its documentation in French -- see [[http://www.cnrtl.fr/lexiques/prolex/|Prolexbase on CNRTL]].

For version 2.0
 * Prolexbase [[attachment:prolexbase.documentation.pdf|documentation]].
 * Prolexbase [[attachment:prolexbase-schema.tar.gz|schema]] description.
 * [[attachment:prolexbase_en_fr_pl_20130204.sql.tar.gz|MySQL dump]] file,
 * List of all inflected forms of [[attachment:prolexbase-polish-inflected.tar.gz|Polish names]] together with their semantic and grammatical tags.
Line 53: Line 61:
Defining an [[http://www.lexicalmarkupframework.org/|LMF]] format for the lexicon.  * Opening a web interface for Prolexbase 2.0/2.2 navigation.
 * Releasing ProlexFeeder under an open license.

Prolexbase 2.0

Prolexbase 2.0 is a multilingual relational dictionary of proper names, conceived initially at the University of Tours, France and at the University of Belgrade, Serbia, and further developed at the Polish Academy of Sciences (IPIPAN). It contains a language-independent typology of proper names with 4 supertypes and 34 types, as well as various language-independent or language-specific relations (synonymy, meronymy accessibility, variation etc.). A pivot-oriented design of concepts yields alignment of proper names in a language with their counterparts if other languages. A large majority of the data have been extracted from Wikipedia and GeoNames. All data have been manually validated.

Prolexbase creation has been supported by the following projects:

  • Technolangue programme from the French Ministry of Industry (2003-2005),

  • Egide Pavle-Savic programme from the French Ministry of Foreign Affairs, the French Ministry of Research, and the Serbian Ministry of Science (2004-2005),

  • ERDF Nekst project (2009-2014),

  • European (CIP ICT-PSP) CESAR project, part of META-NET (2011-2013).

The construction and contents of Prolexbase have been described in:

Prolexbase 2.0 contains the following interlinked data:

  • 67,000 language-independent pivots,
  • 40,000 Polish proper names and their corresponding 165,000 inflected forms,
  • 33,000 English proper names and their corresponding 18,000 inflected forms,
  • 100,000 French proper names and their corresponding 142,000 inflected forms,
  • 65,500 relations.

See also Prolexbase on CNRTL for a proofread version (2.2), serialized in an LMF standard format.

Authors

  • Małgorzata Baron - lexicography,

  • Béatrice Bouchou Markhoff - LMF format design,

  • Leszek Manicki - design and implementation of Prolexbase population from Wikipedia,

  • Denis Maurel - design and dissemination, project management,

  • Agata Savary – project management,

  • Mickaël Tran - database design and implementation.

  • Duško Vitas - design and management of Serbian data.

Tools

  • ProlexFeeder, a tool for semi-automatic population of Prolexbase from open sources, notably Wikipedia and Geonames,

  • Translatica's automatic inflection tool for multi-word units.

License

All Prolexbase 2.0 data are available under the CC BY-SA license, i.e. the same as for Wikipedia and GeoNames.

Available resources

For version 2.2

  • XML serialisation in an LMF standard format, and its documentation in French -- see Prolexbase on CNRTL.

For version 2.0

Future work

  • Opening a web interface for Prolexbase 2.0/2.2 navigation.

  • Releasing ProlexFeeder under an open license.

last edited 2015-02-11 19:37:25 by AgataSavary