Idiosyncratic frequency as a measure of derivation vs. inflection

Copot, Maria; Mickus, Timothee; Bonami, Olivier

doi:10.15398/jlm.v10i2.301

Artykuł - szczegóły

Tytuł artykułu

Idiosyncratic frequency as a measure of derivation vs. inflection

Autorzy

Copot Maria , Mickus Timothee , Bonami Olivier

Treść / Zawartość

Pełne teksty:

Pobierz

Identyfikatory

DOI

10.15398/jlm.v10i2.301

Warianty tytułu

Języki publikacji

Abstrakty

There is ongoing discussion about how to conceptualize the nature of the distinction between inflection and derivation. A common approach relies on qualitative differences in the semantic relationship between inflectionally versus derivationally related words: inflection yields ways to discuss the same concept in different syntactic contexts, while derivation gives rise to words for related concepts. This differential can be expected to manifest in the predictability of word frequency between words that are related derivationally or inflectionally: predicting the token frequency of a word based on information about its base form or about related words should be easier when the two words are in an inflectional relationship, rather than a derivational one. We compare prediction error magnitude for statistical models of token frequency based on distributional and frequency information of inflectionally or derivationally related words in French. The results conform to expectations: it is easier to predict the frequency of a word from properties of an inflectionally related word than from those of a derivationally related word. Prediction error provides a quantitative, continuous method to explore differences between individual processes and differences yielded by employing different predicting information, which in turn can be used to draw conclusions about the nature and manifestation of the inflection–derivation distinction.

Słowa kluczowe

morphology derivation– inflection gradient distributional semantics

Wydawca

Instytut Podstaw Informatyki PAN

Czasopismo

Journal of Language Modelling

Rocznik

2022

Tom

Vol. 10, No. 2

Strony

193--240

Opis fizyczny

Bibliogr. 86 poz., tab., rys. wykr.

Twórcy

autor

Copot Maria

maria.copot@etu.u-paris.fr

Université Paris Cité, Laboratoire de linguistique formelle, CNRS

https://orcid.org/0000-0001-5182-9482

autor

Mickus Timothee

timothee.mickus@helsinki.fi

University of Helsinki

https://orcid.org/0000-0001-9538-7209

autor

Bonami Olivier

olivier.bonami@u-paris.fr

Université Paris Cité, Laboratoire de linguistique formelle, CNRS

https://orcid.org/0000-0003-0688-3855

Bibliografia

1. Anne ABEILLÉ and Danièle GODARD (2002), The syntactic structure of French auxiliaries, Language, 78:404–452.
2. Farrell ACKERMAN, James P. BLEVINS, and Robert MALOUF (2009), Parts and wholes: implicative patterns in inflectional paradigms, in James P. BLEVINS and Juliette BLEVINS, editors, Analogy in Grammar, pp. 54–82, Oxford University Press, Oxford.
3. Paolo ACQUAVIVA (2008), Lexical Plurals: A Morphosemantic Approach, Oxford University Press, Oxford.
4. Stephen R. ANDERSON (1982), Where’s morphology?, Linguistic Inquiry, 13:571–612.
5. Stephen R. ANDERSON (1992), A-Morphous Morphology, Cambridge University Press, Cambridge.
6. Mark ARONOFF (1976), Word Formation in Generative Grammar, MIT Press, Cambridge, MA.
7. Mark ARONOFF (1994), Morphology by itself: Stems and Inflectional Classes, MIT Press, Cambridge, MA.
8. Charles BALLY (1944), Linguistique générale et linguistique française, Francke, Berne.
9. Laurie BAUER (2004), The function of word-formation and the inflection-derivation distinction, in Henk AERTSEN, Mike HANNAY, and Rod LYALL, editors, Words in their Places. A Festschrift for J. Lachlan Mackenzie, pp. 283–292, Vrije Universiteit, Amsterdam.
10. Laurie BAUER and Winifred BAUER (2012), The inflection-derivation divide in Māori and its implications, Te Reo, 55:3–24.
11. Leonard BLOOMFIELD (1933), Language, Holt, Rinehart and Winston, Inc., New York, NY.
12. Harry BOCHNER (1993), Simplicity in Generative Morphology, De Gruyter Mouton, Berlin.
13. Piotr BOJANOWSKI, Edouard GRAVE, Armand JOULIN, and Tomas MIKOLOV (2017), Enriching word vectors with subword information, Transactions of the Association for Computational Linguistics, 5:135–146, doi:10.1162/tacl_a_00051, https://aclanthology.org/Q17-1010.
14. Gemma BOLEDA (2020), Distributional semantics and linguistic theory, Annual Review of Linguistics, 6(1):213–234, doi:10.1146/annurev- linguistics- 011619- 030303.
15. Olivier BONAMI (2015), Periphrasis as collocation, Morphology, 25(1):63–110.
16. Olivier BONAMI and Denis PAPERNO (2018), Inflection vs. derivation in a distributional vector space, Lingue e Linguaggio, 17:173–195, https://www.rivisteweb.it/doi/10.1418/91864.
17. Olivier BONAMI and Jana STRNADOVÁ (2019), Paradigm structure and predictability in derivational morphology, Morphology, 29:167–197, doi:10.1007/s11525- 018- 9322- 6.
18. Geert BOOIJ (1996), Inherent versus contextual inflection and the split morphology hypothesis, in Geert BOOIJ and Jaap VAN MARLE, editors, Yearbook of Morphology 1995, pp. 1–16, Kluwer, Dordrecht, https://scholarlypublications.universiteitleiden.nl/access/ item%3A2717489/view.
19. David V. BUDESCU (1993), Dominance analysis: a new approach to the problem of relative importance of predictors in multiple regression, Psychological Bulletin, 114(3):542–551, https://doi.org/10.1037/0033-2909.114.3.542.
20. Joan L. BYBEE (1985), Morphology: A Study of the Relation between Meaning and Form, John Benjamins Publishing Company, Amsterdam/Philadelphia.
21. Greville G. CORBETT (2010), Canonical derivational morphology, Word structure, 3(2):141–155.
22. Greville G. CORBETT (2019), Pluralia tantum nouns and the theory of features: a typology of nouns with non-canonical number properties, Morphology, 29(1):51–108, https://doi.org/10.1007/s11525-018-9336-0.
23. William CROFT (1991), Syntactic Categories and Grammatical Relations: The Cognitive Organization of Information, The University of Chicago Press, Chicago.
24. Jacob DEVLIN, Ming-Wei CHANG, Kenton LEE, and Kristina TOUTANOVA (2019), BERT: Pre-training of deep bidirectional transformers for language understanding, in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186, Association for Computational Linguistics, Minneapolis, MN, doi:10.18653/v1/N19-1423, https://aclanthology.org/N19-1423.
25. Wolfgang U. DRESSLER (1989), Prototypical differences between inflection and derivation, STUF – Language Typology and Universals, 42(1):3–10, https://doi.org/10.1515/stuf-1989-0102.
26. Carl ECKART and Gale YOUNG (1936), The approximation of one matrix by another of lower rank, Psychometrika, 1(3):211–218, https://doi.org/10.1007/BF02288367.
27. Katrin ERK and Sebastian PADÓ (2010), Exemplar-based models for word meaning in context, in Proceedings of the ACL 2010 Conference Short Papers, pp. 92–97, Association for Computational Linguistics, Uppsala, Sweden, https://aclanthology.org/P10-2017.
28. Alan FORD, Rajendra SINGH, and Gita MARTOHARDJONO (1997), Pace Panini:Towards a Word-based Theory of Morphology, Peter Lang, Berlin.
29. Bernard FRADIN (2007), Three puzzles about denominal adjectives in -eux, Acta Linguistica Hungarica, 54(1):3–32.
30. Livio GAETA (2007), On the double nature of productivity in inflectional paradigms, Morphology, 17:181–205.
31. Juan Luis GASTALDI (2021), Why can computers understand natural language? The structural image of language behind word embeddings, Philosophy & Technology, 34(1):149–214, https://doi.org/10.1007/s13347-020-00393-9.
32. Bruno GUILLAUME, Marie-Catherine DE MARNEFFE, and Guy PERRIER (2019), Conversion et améliorations de corpus du français annotés en Universal Dependencies, TAL, 60(2):71–95.
33. Matías GUZMÁN NARANJO and Olivier BONAMI (2023), A distributional assessment of rivalry in word formation, Word Structure, 16(1):86–113.
34. Zellig HARRIS (1954), Distributional structure, Word, 10(23):146–162.
35. Frank W. HARWOOD and Alison M. WRIGHT (1956), Statistical study of English word formation, Language, 32(2):260–273.
36. Martin HASPELMATH (1996), Word-class-changing inflection and morphological theory, in G. BOOIJ and J. VAN MARLE, editors, Yearbook of Morphology 1995, pp. 43–66, Springer Netherlands, Dordrecht, https://doi.org/10.1007/978-94-017-3716-6_3.
37. Martin HASPELMATH (forthcoming), Inflection and derivation as traditional comparative concepts, Linguistics.
38. Nabil HATHOUT and Fiammetta NAMER (2014), Démonette, a French derivational morpho-semantic network, Linguistic Issues in Language Technology, 11(5):125–168, https://aclanthology.org/2014.lilt-11.6/.
39. Nabil HATHOUT, Marc PLÉNAT, and Ludovic TANGUY (2004), Enquête sur les dérivés en -able, Cahiers de grammaire, 28:49–90, https://shs.hal.science/halshs-00284612/.
40. Nabil HATHOUT, Franck SAJOUS, and Basilio CALDERONE (2014), GLÀFF, a large versatile French lexicon, in Proceedings of Conference on Language Resources and Evaluation (LREC), May 2014, Reykjavik, Iceland, pp. 1007–1012, https://hal.science/hal-00998467/.
41. Jennifer HAY (2001), Lexical frequency in morphology: Is everything relative?, Linguistics, 39(6):1041–1070, https://doi.org/10.1515/ling.2001.041.
42. Paul KIPARSKY (2005), Blocking and periphrasis in inflectional paradigms, in Geert BOOIJ and Jaap van MARLE, editors, Yearbook of Morphology 2004, pp. 113–135, Springer, Dordrecht, https://doi.org/10.1007/1-4020-2900-4_5.
43. Christo KIROV, Ryan COTTERELL, John SYLAK-GLASSMAN, Géraldine WALTHER, Ekaterina VYLOMOVA, Patrick XIA, Manaal FARUQUI, Sabrina J. MIELKE, Arya MCCARTHY, Sandra KÜBLER, David YAROWSKY, Jason EISNER, and Mans HULDEN (2018), UniMorph 2.0: Universal Morphology, in Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), pp. 3922–3931, European Language Resources Association (ELRA), Miyazaki, Japan, https://aclanthology.org/L18-1293.
44. Christo KIROV, John SYLAK-GLASSMAN, Roger QUE, and David YAROWSKY (2016), Very-large scale parsing and normalization of Wiktionary morphological paradigms, in Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pp. 3121–3126, European Language Resources Association (ELRA), Portorož, Slovenia, https://aclanthology.org/L16-1498.
45. Max KISSELEW, Laura RIMELL, Alexis PALMER, and Sebastian PADÓ (2016), Predicting the direction of derivation in English conversion, in Proceedings of the 14th Annual SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology, pp. 93–98, Berlin, Germany. Association for Computational Linguistics, https://aclanthology.org/W16-2015/.
46. Aurore KOEHL (2012), La construction morphologique des noms désadjectivaux suffixés en français, Ph.D. thesis, Université de Lorraine.
47. Thomas K. LANDAUER and Susan T. DUMAIS (1997), A solution to Plato’s problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge, Psychological Review 1997, 104:211–240, https://doi.org/10.1037/0033-295X.104.2.211.
48. Alessandro LENCI (2018), Distributional models of word meaning, Annual Review of Linguistics, 4(1):151–171, https://doi.org/10.1146/annurev-linguistics-030514-125254.
49. Alessandro LENCI, Magnus SAHLGREN, Patrick JEUNIAUX, Amaru CUBA GYLLENSTEN, and Martina MILIANI (2022), A comparative evaluation and analysis of three generations of Distributional Semantic Models, Language Resources and Evaluation, 56:1269–1313, https://doi.org/10.1007/s10579-021-09575-z.
50. Tal LINZEN (2016), Issues in evaluating semantic spaces using word analogies, in Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, pp. 13–18, Association for Computational Linguistics, Berlin, Germany, https://www.aclweb.org/anthology/W16-2503.
51. Robert MALOUF, Farrell ACKERMAN, and Arturs SEMENUKS (2020), Lexical databases for computational analyses: A linguistic perspective, in Proceedings of the Society for Computation in Linguistics 2020, pp. 446–456, Association for Computational Linguistics, New York, New York, https://aclanthology.org/2020.scil-1.52.
52. Marco MARELLI and Marco BARONI (2015), Affixation in semantic space: modeling morpheme meanings with compositional distributional semantics, Psychological Review, 122:485–515.
53. Peter H. MATTHEWS (1991), Morphology, Cambridge University Press, Cambridge, second edition.
54. Arya D. MCCARTHY, Christo KIROV, Matteo GRELLA, Amrit NIDHI, Patrick XIA, Kyle GORMAN, Ekaterina VYLOMOVA, Sabrina J. MIELKE, Garrett NICOLAI, Miikka SILFVERBERG, Timofey ARKHANGELSKIY, Nataly KRIZHANOVSKY, Andrew KRIZHANOVSKY, Elena KLYACHKO, Alexey SOROKIN, John MANSFIELD, Valts ERNŠTREITS, Yuval PINTER, Cassandra L. JACOBS, Ryan COTTERELL, Mans HULDEN, and David YAROWSKY (2020), UniMorph 3.0: Universal Morphology, in Proceedings of the 12th Language Resources and Evaluation Conference, pp. 3922–3931, European Language Resources Association, Marseille, France, ISBN 979-10-95546-34-4, https://aclanthology.org/2020.lrec-1.483.
55. Louise MCNALLY and Gemma BOLEDA (2004), Relational adjectives as properties of kinds, in Olivier BONAMI and Patricia Cabredo HOFHERR, editors, Empirical Issues in Syntax and Semantics, volume 5, pp. 179–196, http://www.cssp.cnrs.fr/eiss5.
56. Timothee MICKUS, Olivier BONAMI, and Denis PAPERNO (2019), Distributional effects of gender contrasts across categories, in Proceedings of the Society for Computation in Linguistics (SCiL) 2019, pp. 174–184, https://aclanthology.org/W19-0118.
57. Timothee MICKUS, Denis PAPERNO, Mathieu CONSTANT, and Kees VAN DEEMTER (2020), What do you mean, BERT?, in Proceedings of the Society for Computation in Linguistics 2020, pp. 279–290, Association for Computational Linguistics, New York, NY, https://aclanthology.org/2020.scil-1.35.
58. Tomas MIKOLOV, Kai CHEN, G. s. CORRADO, and Jeffrey DEAN (2013a), Efficient estimation of word Representations in vector space, Proceedings of Workshop at ICLR, 2013, https://arxiv.org/abs/1301.3781.
59. Tomas MIKOLOV, Wen-tau YIH, and Geoffrey ZWEIG (2013b), Linguistic regularities in continuous space word representations, in Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 746–751, Association for Computational Linguistics, Atlanta, GA, https://aclanthology.org/N13-1090.
60. Fiammetta NAMER, Lucie BARQUE, Olivier BONAMI, Pauline HAAS, Nabil HATHOUT, and Delphine TRIBOUT (2019), Demonette2 – Une base de données dérivationnelles du français à grande échelle : premiers résultats, in Actes de TALN, Toulouse, France, https://halshs.archives-ouvertes.fr/halshs-02275652/document.
61. Doris L. PAYNE (1986), Inflection versus derivation: is there a difference?, in Proceedings of the First Annual Meeting of the Pacific Linguistics Conference, pp. 247–260, U. of Oregon.
62. Matthew E. PETERS, Mark NEUMANN, Mohit IYYER, Matt GARDNER, Christopher CLARK, Kenton LEE, and Luke ZETTLEMOYER (2018), Deep contextualized word representations, in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 2227–2237, Association for Computational Linguistics, New Orleans, LA, https://aclanthology.org/N18-1202.
63. Frans PLANK (1991), Inflection and derivation, Noun phrase structure, Theme 7, EUROTYP Working Papers, pp. 1–28.
64. Franz RAINER (2013), Can relational adjectives really express any relation? An onomasiological perspective, SKASE Journal of Theoretical Linguistics, 10(1):12–40.
65. Radim ŘEHŮŘEK and Petr SOJKA (2010), Software Framework for Topic Modelling with Large Corpora, in Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, pp. 45–50, ELRA, Valletta, Malta, http://is.muni.cz/publication/884893/en.
66. Susanne RIEHEMANN (1998), Type-based derivational morphology, Journal of Comparative Germanic Linguistics, 2(1):49–77, https://www.jstor.org/stable/23741052.
67. Anna ROGERS, Aleksandr DROZD, and Bofang LI (2017), The (too many) problems of analogical reasoning with word vectors, in Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017), pp. 135–148, Association for Computational Linguistics, Vancouver, Canada, https://www.aclweb.org/anthology/S17-1017.
68. Rudolf ROSA and Zdeněk ŽABOKRTSKÝ (2019), Attempting to separate inflection and derivation using vector space representations, in Proceedings of the Second International Workshop on Resources and Tools for Derivational Morphology, pp. 61–70, Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics, Prague, Czechia, https://aclanthology.org/W19-8508.
69 .Magnus SAHLGREN (2008), The distributional hypothesis, Italian Journal of Linguistics, 20(1):33–54, https://www.italian-journal-linguistics. com/app/uploads/2021/05/Sahlgren-1.pdf.
70. Ferdinand de SAUSSURE (1916), Cours de Linguistique Générale, Payot & Rivage, Paris.
71. Roland SCHÄFER and Felix BILDHAUER (2012), Building large corpora from the web using a new efficient tool chain, pp. 242–246, Istanbul, Turkey. European Language Resources Association (ELRA).
72. Natalie SCHLUTER (2018), The word analogy testing caveat, in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 242–246, Association for Computational Linguistics, New Orleans, LA, https://www.aclweb.org/anthology/N18-2039.
73. Robert SCHREUDER and R. Harald BAAYEN (1997), How complex simple words can be, Journal of Memory and Language, 37:118–139, https://doi.org/10.1006/jmla.1997.2510.
74. Roland SCHÄFER (2015), Processing and querying large web corpora with the COW14 architecture, in Piotr BAŃSKI, Hanno BIBER, Evelyn BREITENEDER, Marc KUPIETZ, Harald LÜNGEN, and Andreas WITT, editors, Proceedings of Challenges in the Management of Large Corpora 3 (CMLC-3), UCREL, IDS, Lancaster, http://rolandschaefer.net/?p=749.
75. Andrew SPENCER (2013), Lexical Relatedness, Oxford University Press, Oxford, ISBN 9780199679928, doi:10.1093/acprof:oso/9780199679928.001.0001.
76. Gilbert W. STEWART (1993), On the early history of the singular value decomposition, SIAM Review, 35(4):551–566, https://doi.org/10.1137/1035134.
77. Jana STRNADOVÁ (2014), Les réseaux adjectivaux: Sur la grammaire des adjectifs dénominaux en français, Ph.D. thesis, Université Paris Diderot et Univerzita Karlova v Praze, https://theses.hal.science/tel-01536100/.
78. Gregory T. STUMP (1998), Inflection, in Andrew SPENCER and Arnold ZWICKY, editors, The Handbook of Morphology, pp. 13–43, Blackwell, London.
79. Gregory T. STUMP and Raphael FINKEL (2013), Morphological Typology: From Word to Paradigm, Cambridge University Press, Cambridge.
80. Pavol ŠTEKAUER (2005), Meaning Predictability in Word Formation, John Benjamins, Amsterdam.
81. Pavol ŠTEKAUER (2014), Derivational paradigms, in Rochelle LIEBER and Pavol ŠTEKAUER, editors, The Oxford Handbook of Derivational Morphology, pp. 354–369, Oxford University Press, Oxford.
82. Pavol ŠTEKAUER (2015), The delimitation of derivation and inflection, in Peter O. MÜLLER, Ingeborg OHNHEISER, Susan OLSEN, and Franz RAINER, editors, Volume 1 Word-Formation: An International Handbook of the Languages of Europe, chapter 14, pp. 218–235, De Gruyter Mouton, doi:10.1515/9783110246254- 016, https://doi.org/10.1515/9783110246254-016.
83. Delphine TRIBOUT (2010), Les conversions de nom à verbe et de verbe à nom en français, Ph.D. thesis, Université Paris Diderot.
84. Rossella VARVARA (2017), Verbs as nouns: empirical investigations on event-denoting nominalizations, Ph.D. thesis, Università degli Studi di Trento, http://eprints-phd.biblio.unitn.it/2538/.
85. Géraldine WALTHER (2013), De la canonicité en morphologie: perspective empirique, théorique et computationnelle, Ph.D. thesis, Université Paris Diderot, https://theses.hal.science/tel-01535976/document.
86. Marine WAUQUIER, Nabil HATHOUT, and Cécile FABRE (2020), Semantic discrimination of technicality in French nominalizations, Zeitschrift für Wortbildung / Journal of Word Formation, 4:100–119, doi:10.3726/zwjw.2020.02.06, https://hal.archives-ouvertes.fr/hal-03090796.

Uwagi

Opracowanie rekordu ze środków MEiN, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2022-2023).

Typ dokumentu

Bibliografia

Identyfikator YADDA

bwmeta1.element.baztech-fd0c23f7-edb0-4329-a237-828acb081bc6