• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16095 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16095 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • Proceedings of the Seventh Italian Confe...
  • ›
  • Contributed Papers
  • ›
  • A Case Study of Natural Gender Phenomena...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 2. Related Work 3. Experimental setup 4. Results 5. Conclusions and Future Work Bibliographie Notes de bas de page Auteurs

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    A Case Study of Natural Gender Phenomena in Translation. A Comparison of Google Translate, Bing Microsoft Translator and DeepL for English to Italian, French and Spanish

    Argentina Anna Rescigno, Eva Vanmassenhove, Johanna Monti et Andy Way

    p. 359-364

    Résumé

    This paper presents the results of an evaluation of Google Translate, DeepL and Bing Microsoft Translator with reference to natural gender translation and provides statistics about the frequency of female, male and neutral forms in the translations of a list of personality adjectives, and nouns referring to professions and bigender nouns. The evaluation is carried out for EnglishSpanish, EnglishItalian and EnglishFrench.

    Texte intégral 1. Introduction 2. Related Work 3. Experimental setup 3.1 Compilation of Datasets 3.2 Description of the MT Systems GT BMT DL 4. Results 4.1 Analysis GT BMT DL 5. Conclusions and Future Work Bibliographie Notes de bas de page Auteurs

    Texte intégral

    1. Introduction

    1Gender manifests itself in a language in many ways, and different languages use different linguistic devices to mark (or sometimes ‘not mark’) gender. When dealing with language, three types of gender come into play: natural gender, grammatical gender and social gender. Natural gender is generally based on the sex of a person or an animal realised by means of the male/female polarity or on the absence of sex for neutral nouns. Grammatical gender, instead, is not always coherent with the semantic categorization of a word and can vary from language to language since it depends on the representation of objects in the world on the basis of specific properties attributed to them in a specific cultural context. Social gender is used in relation to the properties of a word on the basis of which the speakers of a language associate the natural gender of a person to a word (Hellinger and Motschenbacher 2015): this mainly happens with names of professions, such as for instance doctor or nurse which are interpreted according to social stereotypes concerning the roles of males and females in the society. Gender is present in the data we use to train MT systems due to the demographic features of the human training data and because of the nature of stereotypes and biases we communicate in our day-to-day communications. As most state-of-the-art MT systems handle translations on the sentence-level, gender phenomena are, usually, resolved on statistics inferred from the training data. Mistranslations of gender information occur more frequently when translating from gender-neutral languages, such as English1, into morphological-rich languages, such as Italian or French, which explicitly mark gender and require additional information to correctly translate gender phenomena. When such additional information or context is not provided, the system will pick the most likely variant. A recent study by showed how Google Translate (GT) yields more male defaults than what ought to be expected when looking at demographic data on its own, alluding that there might be a phenomenon they refer to as machine bias (Prates, Avelar, and Lamb 2018; Vanmassenhove, Shterionov, and Way 2019). In this paper, we systematically evaluate: (a) single-word queries, containing personality adjectives and profession nouns, and (b) bigender nouns2 in an EN  IT, FR, ES translation setting for GT, DeepL (DL) and Bing Microsoft Translator (BMT) to verify the diversity in translations provided by these MT providers.

    2. Related Work

    2As recent years have seen an increase in literature on bias in NLP, we focus particularly on work that has attempted controlling the seemingly random fluctuations in terms of gender in the translations provided by large MT providers, with a specific focus on neural approaches. conducted a more elaborate series of experiments very similar to the work by . Their work on preserving original author traits focuses particularly on gender. They treated personalizing PB-SMT systems as a domain-adaptation task where the female and male gender are two separate domains. In NMT, experimented with the insertion of an artificial token at the beginning of the sentence, indicating the gender of the speaker (Vanmassenhove and Hardmeier 2018). This approach is similar to who added an ‘informal’ or ‘polite’ tag indicating the level of politeness expressed to the training sentences.

    3The work by  presents a technique for the translation of speech-like texts focusing particularly on English-to-Arabic. They train a baseline on generic data (4M sentences) and use a set of gender-labelled sentences (900k) in order to tune the system towards generating translations with correct gender agreement.

    4More recently, presented a simple yet effective black-box approach to control the NMT system’s translations in case of gender ambiguity. Instead of appending a token, they concatenate unambiguous artificial antecedents with information on the speaker and the interlocutors to ambiguous English sentences. Some recent studies have addressed the problem of the scarcity of publicly available corpora and create corpora specifically designed to evaluate or to test MT performance with respect to gender translation (Font and Costa-Jussa 2019; Di Gangi et al. 2019). Finally, provides an overview of outstanding issues and topics related to gender in MT and a literature review of work related to gender bias in the field of NLP.

    3. Experimental setup

    5For the experiments, we compiled a dataset with the translation of both English single-word queries and short sentences into Italian (IT), French (FR) and Spanish (ES) with GT, BMT and DL. We experimented with both single-words and short sentences as e.g. GT provides, since end 20183 gendered translations for single-word queries (limited to nouns and adjectives) for EN–FR, EN–ES and EN–IT. Similarly, BMT and DL provide users with alternative translations on the user interface. Differently from GT, these are simply alternative translations for the word in question. As such, GT is the only system that currently, to some extent, deals with gendered variants in a systematic way.

    3.1 Compilation of Datasets

    6The datasets4 are compiled on the basis of a list of nouns and adjectives collected from different sources (see Table 1). The translations generated and their manual evaluations are also part of the datasets. The setup for this experiment consists of both words and sentences. We collected a set of 136 personality adjectives and 107 nouns of professions from three different sources and 30 of the most common bigender nouns in the Italian language. We tested these separate sets and analysed the behaviour of the major state-of-the-art MT systems, comparing the translations of the three language pairs. The first two sets of words have been assessed alone, without any context, while the last set has been examined within the sentence level.

    7Alongside with the number of adjectives and nouns retrieved, Table 1 provides more detailed information on the sources and the original language in which the data was retrieved.

    Table 1

    #

    Sources

    Adjectives

    136

    (A. S. I 2019); (A. S. II 2019);(III 2019)

    Professions

    107

    (P. S. I 2019); (P. S. II 2019)

    Bigender

    30

    (Cacciari, Carreiras, and Cionini 1997);

    (Cacciari et al. 2011)

    (Thornton and Anna 2004)

    Overview of adjectives, profession and bigender nouns along with the sources from which they were retrieved

    3.2 Description of the MT Systems

    8To evaluate the gender issues in translation we used three state-of-the-art, freely available, MT systems:

    GT

    9Launched in 2003 as a statistical MT system, GT has switched to a NMT system in 2016  (Monti 2017). The translations are generated at the sentence level. Since 2018, Google provides two alternatives when translating ’ambiguous’ or underspecified English words into languages that have male\female alternatives for various languages (e.g. Italian, French and Spanish). The male\female variants are listed alphabetically (i.e. first the female variant, then the male one).

    BMT

    10MT system owned by Microsoft that originally used a statistical approach (Monti 2017) but more recently switched to a neural system (Almahasees 2018). Unlike GT, BMT does not provide alternatives in the translation box itself. However, it does give synonyms in the “Other ways to say” section and provides examples of usage in the “How to use...” section, where sometimes the female form of a word is listed (by chance rather than in a consistent way).

    DL

    11The most recent platform launched in August 2017 by a German company, DeepL GmbH. DL uses convolutional neural networks based on the Linguee database  (Morán Vallejo and others 2019). Even though it only supports nine languages (all Indoeuropean), DL is, according to a recent study, outperforming the other competitors (Morán Vallejo and others 2019). The layout of the interface is similar to that of GT. Nevertheless, its suggestions for alternatives are not systematically morphological variants (although they are often somehow included in the alternatives provided). Underneath the actual translations, there is also a dictionary-like section when translating words in isolation.

    4. Results

    12In this section, the results obtained with our experiments and our subsequent evaluation will be presented. A more in-depth analysis and a discussion of some concrete examples is provided in Section 4.1. All the manual evaluations were conducted in November, 20195.

    13The adjectives and profession nouns were both evaluated in single-word settings. The bigender nouns were evaluated in short sentences. Bigender nouns in Italian, such as for example the nouns giornalista, pianista are by themselves not marked for gender. As such, a single-word query would not reveal any gender marking. However, the articles, adjectives, verbs, etc. that agree with these bigender nouns are (often) marked for gender. Therefore, these specific nouns were evaluated in short sentence settings.

    14We manually evaluated all the outputs and will report on the percentage of male (M), female (F) and ‘neutral’ (N) or ‘covered’ (C) (i.e. no explicit gender in the target language) variants for the single-word and sentence queries. Additionally, we report on the errors (e.g. untranslated or mistranslated words).

    15As mentioned earlier, GT is currently the only system that provides both male and female variants when given a single-word ambiguous query (ENFR, ES, IT). The alternatives are limited to adjectives and nouns6. DL and BMT provide the user with multiple alternatives underneath the primary translation for both nouns and adjectives but not in a systematic way. As such, these alternatives do not necessarily consist of morphological variants in terms of gender.

    16For our evaluation, only the main translations offered by the MT systems were considered, i.e. we evaluated both gendered forms for GT, but did not evaluate the list of alternative translations provided by BMT and DL as they can be alternatives of any kind and they differ depending on the query.

    17In the interest of clarity and order, we will separately consider the different test-sets, single words (i.e. adjectives and nouns), and sentences with bi-gender nouns. Each set has been tested in the previously stated systems and language pairs. In the tests, we were especially investigating – apart from any translation error – the occurrence of female forms, to see if there is somehow a bias towards the gender. From a practical point of view, we will consider only the first output as a valid result, since the systems also give “alternatives” for single-word translations. For Bing, it is quite straightforward: adjectives do not present alternatives, while nouns sometimes do. Google Translate produces now two different results, marked with the gender (feminine/masculine, in this sequence for alphabetical order). DeepL, in particular, provides at least three alternative translations, for both nouns and adjectives. However, even though we are not considering alternatives, we will explain or anyway mention the ones that are significative in this research. All the results have been recorded in November 2019. However, the systems continually improve, so results may vary also in a short time.

    18Table 2 presents the results for the single-word translations consisting of adjectives: for all three systems, the male variant was the most common. This was especially so for BMT, where only 1.5% of the adjectives were translated into a female variant. The ‘other’ category consists of translations: (a) that were ambiguous (e.g. mean was translated as a verb instead of as an adjective), (b) words that were not translated by the systems and (c) errors.

    Table 2

    ADJ

    GT

    BMT

    DL

    F

    37.3

    1.5

    22.8

    M

    39.2

    58.8

    45.6

    N

    20.7

    33.1

    26.5

    Other

    2.8

    6.5

    5.1

    Total

    100

    100

    100

    Results in % for male (M), female (F) and neutral (N) adjectives generated for EN  IT for GT, BMT and DL. The “Other” label includes all results obtained that do not correspond to the “adjective" category

    19We ought to note that, none of the single words were mistranslated by GT. The only single-word queries that caused a divergence between male and female forms were queries that were a compound noun in either the source or the target (e.g.good-tempered). They are not treated as a single unit by GT and thus the system fails to render both variants. From the Table 2, it is clear that GT performs best in terms of balanced single-word adjective translations. Table 3 presents a similar set of results but for the nouns indicating professions. Like Table 2 GT generated the most diverse translations, while BMT the least. As far as the set with sentences is concerned, we used bigender nouns from the Italian language. We used 30 common bigender nouns in two different contexts: (a) first, in a minimal sentence that would allow us to infer the gender based on the article in the target language “I am a(n)..” and (b) with a referring adjective. We used beautiful, efficient, intelligent, sad and famous. In Table 4, our results are presented for the bigender nouns on minimal sentences (“I am a(n)...”) and in combination with the aforementioned adjectives (“I am a(n) + adj...”). In the results, we oppose the translation where we added beautiful as an adjective as they differed considerably from the others. Table 4 presents the results for the translations generated by BMT for bigender nouns in sentences for Italian, French and Spanish. It can be noted that the male translation is the most common in the simple sentences that do not contain an adjective in all three languages. However, when adding the adjective beautiful to the phrase, the female forms are the most common for all three languages. An example of such sentences is given below:

    (a)

    EN:

    “I am a pianist”

    (N)

    IT:

    “Sono un pianista.”

    (M)

    FR:

    “Je suis pianiste.”

    (N)

    ES:

    “Soy pianista.”

    (N)

    (b)

    EN

    “I am a beautiful pianist.”

    (N)

    IT

    “Sono una bellissima pianista.”

    (F)

    FR

    “Je suis une belle pianiste.”

    (F)

    ES

    “Soy una hermosa pianista.”

    (F)

    (c)

    EN

    ‘I am a famous pianist.’’

    (N)

    IT

    “Sono un famoso pianista.”

    (M)

    FR

    “Je suis un pianiste célèbre.”

    (M)

    ES

    “Soy un pianista famoso.”

    (M)

    20The results obtained for DL are very similar to the ones obtained with BMT except for the fact that DL generates overall more female forms than BMT. Interestingly, among all systems, GT is the most biased towards male forms when evaluating entire sentences for all three language pairs, with the male forms being the dominant ones for all categories and for several set-ups we observe more than 90% male variants.

    Table 3

    NOUN

    GT

    BMT

    DL

    F

    35.8

    0.9

    7.5

    M

    46.1

    60.4

    60.4

    N

    17.6

    28.3

    28.3

    Other

    0.6

    10.5

    3.7

    Total

    100

    100

    100

    Results in % for male (M), female (F) and neutral (N) nouns generated for EN  IT for GT, BMT and DL. The “Other" label includes all results obtained that do not correspond to the “noun" category

    Table 4

    BMT

    IT

    FR

    ES

    F

    M

    N

    F

    M

    N

    F

    M

    N

    no adj.

    10.0

    86.7

    Q*

    10.0

    63.3

    26.7

    3.3

    66.7

    30.0

    beautiful

    63.3

    36.7

    0.0

    43.3

    56.7

    0.0

    66.7

    33.3

    0.0

    other adj.

    13.3

    83.3

    Q*

    3.3

    96.7

    0.0

    6.7

    93.3

    0.0

    DL

    IT

    FR

    ES

    F

    M

    N

    F

    M

    N

    F

    M

    N

    no adj

    30.0

    70.0

    0.0

    20.0

    63.3

    16.7

    3.3

    76.6

    20.0

    beautiful

    83.3

    16.7

    0.0

    73.3

    26.7

    0.0

    96.7

    3.3

    0.0

    other adj.

    53.3

    43.3

    Q*

    13.3

    83.3

    3.3

    6.7

    93.3

    0.0

    GT

    IT

    FR

    ES

    F

    M

    N

    F

    M

    N

    F

    M

    N

    no adj.

    6.7

    93.3

    0.0

    6.7

    90.0

    3.3

    3.3

    66.7

    30.0

    beautiful

    43.3

    56.7

    0.0

    80.

    20.0

    0.0

    80.0

    20.0

    0.0

    other adj.

    3.3

    96.7

    0.0

    3.3

    96.7

    0.0

    3.3

    96.7

    0.0

    4.1 Analysis

    21In the analysis we compare the results of the three systems, comparing the occurrences of the female-gendered translated forms in terms of the different systems and the different languages.

    GT

    22For the single nouns and adjectives, GT provides both male and female forms. The system, however, produces more male outputs as sometimes the alternative is not provided (e.g. for compound nouns). One of the provided nouns was ambiguous (printer) in English. The system translated this as the object instead of the profession. Whenever an ambiguous word was translated accurately, yet not in the way we intended it to be translated, we included it into the ‘other’ category. Considering the adjectives, we observed one incorrect translation where the adjective supportive was translated into an Italian noun (‘supporto’ meaning support). Two other adjectives were ambiguous (mean and kind) and were translated into a verb and a noun respectively by GT. For the sentence-evaluation, GT has the strongest preference for translations using male-endings.

    BMT

    23For the nouns, BMT has a strong tendency to output male variants. The only two exceptions are nurse for IT, FR and ES and makeup artist for FR and ES. Besides, words such as newsreader, translator, warder were not translated by BMT and others were mistranslated, e.g. garbage man and window cleaner, for which the translations provided were too literal in IT (uomo spazzatura) and pulizia finestre where “pulizia” is the equivalent of “cleaning”). Concerning the adjectives, unlike DL and GT, BMT rarely offers alternatives and the majority of the translations generated are in the male form. Exceptional female variants were found in: (a) Italian for: devious/subdola and joyful/gioiosa; (b) Spanish for: artistic, bossy, calm, diplomatic, dynamic, extrovert, humorous, industrious, placid. We ought to note that a considerable amount of the adjectives (33.1% for Italian and 29.4% for Spanish) have a translation with a bigender adjective. These words have the same form for both genders and are included in the ’N’ (neutral) group. A small number of adjectives were translated with an expression, such as good-tempered  IT di buon umore, FR de bonne humeur, SP de buen humor. These expressions can be assigned to both male/female referents and are thus considered covered/neutral. We did not observe any errors except for the adjective frank (without a capital letter), which was left untranslated by DL (as if it were the first-name “Frank”). However, the most appropriate translation was among the alternatives suggested. Moreover, sometimes the adjectives are ambiguous, therefore the system has opted for a “non-gendered” alternative (e.g. mean was translated as a verb instead of an adjective).

    DL

    24DL provides multiple options, for both nouns and adjectives, but for only 7.5% of nouns the female form is the first result, as, for example, assistant and nurse for French and Italian, doctor, secretary and shop assistant for Spanish and Italian, soldier and teacher for Italian. For the adjectives, instead, the number of female forms increases to 22.8%. Similarly to some of the observations for BMT and GT, some of our intended nouns were ambiguous (‘model’ can be a noun or a verb) and the system opted for the verb translation. The only error we observed is the translation of tailor which was incorrectly translated into the adjective sartoriale.

    5. Conclusions and Future Work

    25In future work, we would like to conduct a larger evaluation comprising of more language pairs and a more diverse set of words. Furthermore, we aim to compile a challenge set focusing specifically on gender phenomena in language that can be used and automatically evaluated. We also envisage training our own state-of-the-art MT system to verify how and whether machine bias indeed influences the output of the translations generated.

    Bibliographie

    Zakaryia Mustafa Almahasees. 2018. “Assessment of Google and Microsoft Bing Translation of Journalistic Texts.”

    Cristina Cacciari, Manuel Carreiras, and Cristina Barbolini Cionini. 1997. “When Words Have Two Genders: Anaphor Resolution for Italian Functionally Ambiguous Words.” Journal of Memory and Language 37 (4): 517–32.

    Cristina Cacciari, Paola Corradini, Roberto Padovani, and Manuel Carreiras. 2011. “Pronoun Resolution in Italian: The Role of Grammatical Gender and Context.” Journal of Cognitive Psychology 23 (4): 416–34.

    Mattia A. Di Gangi, Roldano Cattoni, Luisa Bentivogli, Matteo Negri, and Marco Turchi. 2019. “MuST-c: A Multilingual Speech Translation Corpus.” In 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2012–7. Association for Computational Linguistics.

    Joel Escudé Font and Marta R Costa-Jussa. 2019. “Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques.” arXiv Preprint arXiv:1901.03116.

    Marlis Hellinger and Heiko Motschenbacher. 2015. “Gender Across Languages. The Linguistic Representation of Women and Men, Volume 4. Amsterdam & Philadelphia.” John Benjamins Publishing Company. http://reader. eblib. com/(S ….

    Adjectives Sources I. 2019. “Personality Adjectives Source I.” Https://Www.esolcourses.com/Content/Exercises/Grammar/Adjectives/Personality/Words-for-Describing-Personality.html.

    Professions Source I. 2019. “Professions Source I.” Https://Www.scribd.com/Doc/82021393/List-of-Common-Jobs.

    Adjectives Source II. 2019. “Personality Adjectives Source Ii.” Https://Www.esolcourses.com/Content/Exercises/Grammar/Adjectives/Personality/More-Words-for-Describing-Personality.html.

    Professions Source II. 2019. “Professions Source Ii.” Https://Www.vocabulary.cl/Basic/Professions.htm.

    Adjectives Sources III. 2019. “Personality Adjectives Source Iii.” Https://7esl.com/Adjectives-That-Describe-Personality/.

    Johanna Monti. 2017. “Questioni Di Genere in Traduzione Automatica.” In Al femminile. Scritti linguistici in onore di Cristina Vallini, 411–31. Cesati.

    Alberto Morán Vallejo and others. 2019. “The Translation of Spanish Agri-Food Texts into English and Italian Using Machine Translation Engines: A Contrastive Study.”

    Marcelo OR. Prates, Pedro H. Avelar, and Luı́s C Lamb. 2018. “Assessing Gender Bias in Machine Translation: A Case Study with Google Translate.” Neural Computing and Applications, 1–19.

    ANNA Thornton and M Anna. 2004. “Mozione.” La Formazione Delle Parole in Italiano, 218–25.

    Eva Vanmassenhove and Christian Hardmeier. 2018. “Europarl Datasets with Demographic Speaker Information.”

    Eva Vanmassenhove, Dimitar Shterionov, and Andy Way. 2019. “Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translation.” In Proceedings of Machine Translation Summit Xvii Volume 1: Research Track, 222–32. Dublin, Ireland. https://www.aclweb.org/anthology/W19-6622.

    Notes de bas de page

    1 Aside from pronouns such as ’she’ and ’he’ or some exceptions such as ‘actress’ vs ‘actor’.

    2 Bigender nouns do not have a fixed grammatical gender; their gender is determined by the context and without any further context, they are valid for both male and female referents.

    3 https://www.blog.google/products/translate/reducing-gender-bias-google-translate/

    4 available at https://github.com/argentina-res/gender_project.git

    5 The translations were evaluated by a native Italian speaker$\backslash$linguist for Italian, and by a professional linguist for French and Spanish.

    6 In the target languages certain verbs are also sometimes marked for gender, e.g. reciprocal verbs, passive constructions, past participles...

    Auteurs

    • Argentina Anna Rescigno

      UNIOR NLP Research Group, University of Naples L’Orientale – a.rescigno1@studenti.unior.it

    • Eva Vanmassenhove

      Department of CSAI, Tilburg University – e.o.j.vanmassenhove@tilburguniversity.edu

    • Johanna Monti

      UNIOR NLP Research Group, University of Naples L’Orientale – jmonti@unior.it

    • Andy Way

      ADAPT Centre Dublin City University – andy.way@adaptcentre.ie

    Précédent Suivant
    Table des matières

    Le texte seul est utilisable sous licence Licence OpenEdition Books. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    “Spotto la quarantena": per una analisi dell’italiano scritto degli studenti universitari via social network in tempo di COVID-19

    Francesca Chiusaroli, Johanna Monti, Maria Laura Pierucci et al.

    “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence

    Federico Sangati, Antonio Pascucci et Johanna Monti

    Ghigliottin-AI @ EVALITA2020: Evaluating Artificial Players for the Language Game “La Ghigliottina”

    Pierpaolo Basile, Marco Lovetere, Johanna Monti et al.

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    ItaGLAM: A corpus of Cultural Communication on Twitter during the Pandemic

    Gennaro Nolano, Carola Carlino, Maria Pia di Buono et al.

    Voir plus de chapitres
    1 / 12

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    “Spotto la quarantena": per una analisi dell’italiano scritto degli studenti universitari via social network in tempo di COVID-19

    Francesca Chiusaroli, Johanna Monti, Maria Laura Pierucci et al.

    “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence

    Federico Sangati, Antonio Pascucci et Johanna Monti

    Ghigliottin-AI @ EVALITA2020: Evaluating Artificial Players for the Language Game “La Ghigliottina”

    Pierpaolo Basile, Marco Lovetere, Johanna Monti et al.

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    ItaGLAM: A corpus of Cultural Communication on Twitter during the Pandemic

    Gennaro Nolano, Carola Carlino, Maria Pia di Buono et al.

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 Aside from pronouns such as ’she’ and ’he’ or some exceptions such as ‘actress’ vs ‘actor’.

    2 Bigender nouns do not have a fixed grammatical gender; their gender is determined by the context and without any further context, they are valid for both male and female referents.

    3 https://www.blog.google/products/translate/reducing-gender-bias-google-translate/

    4 available at https://github.com/argentina-res/gender_project.git

    5 The translations were evaluated by a native Italian speaker$\backslash$linguist for Italian, and by a professional linguist for French and Spanish.

    6 In the target languages certain verbs are also sometimes marked for gender, e.g. reciprocal verbs, passive constructions, past participles...

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    X Facebook Email

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est cité par

    • Miaschi, Alessio. Alzetta, Chiara. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2023) Testing the Effectiveness of the Diagnostic Probing Paradigm on Italian Treebanks. Information, 14. DOI: 10.3390/info14030144
    • Miaschi, Alessio. Sarti, Gabriele. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2022) Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties. Italian Journal of Computational Linguistics, 8. DOI: 10.4000/ijcol.965
    • Saga, Satoshi. Shirakawa, Kanta. (2025) Investigating the Effect of Pseudo-Haptics on Perceptions Toward Onomatopoeia Text During Finger-Point Tracing. Multimodal Technologies and Interaction, 9. DOI: 10.3390/mti9100100
    • (2025) Book reviews. Yearbook of Phraseology, 16. DOI: 10.1515/phras-2025-0012

    Ce chapitre est cité par

    • de Lima, Tiago B.. Nascimento, André C. A.. Valença, George. Miranda, Pericles. Mello, Rafael Ferreira. Si, Tapas. (2021) Lecture Notes in Computer Science Intelligent Systems. DOI: 10.1007/978-3-030-91699-2_37
    • Bianchi, Federico. Fornaciari, Tommaso. Hovy, Dirk. Nozza, Debora. (2023) Machine Translation: Technologies and Applications Towards Responsible Machine Translation. DOI: 10.1007/978-3-031-14689-3_9
    • Heim, Lars. Gerth, Sebastian. (2023) Entrepreneurship der Zukunft. DOI: 10.1007/978-3-658-42060-4_1
    • Černý, Michal. (2025) AI literacy: concepts, approaches and open questions. e-Pedagogium, 24. DOI: 10.5507/epd.2024.009
    • Aleedy, Moneerh. Atwell, Eric. Meshoul, Souham. (2025) A Multi-Agent Chatbot Architecture for AI-Driven Language Learning. Applied Sciences, 15. DOI: 10.3390/app151910634
    • Mondal, Subrota Kumar. Zhang, Haoxi. Kabir, H. M. Dipu. Ni, Kan. Dai, Hong-Ning. (2023) Machine translation and its evaluation: a study. Artificial Intelligence Review, 56. DOI: 10.1007/s10462-023-10423-5
    • All Translation Tools Are Not Equal: Investigating the Quality of Language Translation for Forced Migration(2023) . DOI: 10.1109/DSAA60987.2023.10302481
    • Italian-Chinese Neural Machine Translation: results and lessons learnt(2023) . DOI: 10.1145/3582515.3609567
    • De Cesare, Anna-Maria. Giusti, Giuliana. (2024) Lingua inclusiva: forme, funzioni, atteggiamenti e percezioni . DOI: 10.30687/978-88-6969-866-8/001

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Rescigno, A., Vanmassenhove, E., Monti, J., & Way, A. (2020). A Case Study of Natural Gender Phenomena in Translation. A Comparison of Google Translate, Bing Microsoft Translator and DeepL for English to Italian, French and Spanish. In F. Dell’Orletta, J. Monti, & F. Tamburini (éds.), Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8844
    Rescigno, Argentina Anna, Eva Vanmassenhove, Johanna Monti, et Andy Way. « A Case Study of Natural Gender Phenomena in Translation. A Comparison of Google Translate, Bing Microsoft Translator and DeepL for English to Italian, French and Spanish ». In Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta, Johanna Monti, et Fabio Tamburini. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8844.
    Rescigno, Argentina Anna, et al. « A Case Study of Natural Gender Phenomena in Translation. A Comparison of Google Translate, Bing Microsoft Translator and DeepL for English to Italian, French and Spanish ». Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8844.

    Référence numérique du livre

    Format

    Dell’Orletta, F., Monti, J., & Tamburini, F. (éds.). (2020). Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8203
    Dell’Orletta, Felice, Johanna Monti, et Fabio Tamburini, éd. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8203.
    Dell’Orletta, Felice, et al., éditeurs. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8203.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement