• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16041 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16041 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • EVALITA Evaluation of NLP and Speech Too...
  • ›
  • Track “Semantics and Multimodality”
  • ›
  • Ghigliottin-AI: Evaluating Artificial Pl...
  • ›
  • “Il Mago della Ghigliottina” @ Ghigliott...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction2. Related work3. The Ghigliottin-AI task4. System description5. Results6. Error analysis7. Conclusions and future work Bibliographie Notes de bas de page Auteurs

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence

    Federico Sangati, Antonio Pascucci et Johanna Monti

    p. 349-355

    Résumés

    This paper describes Il mago della Ghigliottina, a bot which took part in the Ghigliottin-AI task of the Evalita 2020 evaluation campaign. The aim is to build a system able to solve the TV game “La Ghigliottina”. Our system has already participated in the Evalita 2018 task NLP4FUN. Compared to that occasion, it improved its accuracy from 61% to 68.6%.

    Questo contributo descrive Il mago della Ghigliottina, un bot che ha partecipato a Ghigliottin-AI, uno dei task di Evalita 2020. Scopo del task è mettere in piedi un sistema automatico capace di risolvere il gioco televisivo “La Ghigliottina”. Il nostro sistema ha già partecipato all’edizione del 2018 di Evalita al task NLP4FUN. Rispetto all’edizione del 2018 di NLP4FUN, l’accuratezza è salita dal 61% al 68.6%.

    Remerciements

    This research has been partly supported by the PON Ricerca e Innovazione 2014/20 fund. Authorship contribution is as follows: Federico Sangati is author of Sections 4 and 5, Antonio Pascucci is author of Sections 3 and 6, Johanna Monti is author of Sections 1 and 2, Abstract, Conclusions and future work are in common.

    Texte intégral Bibliographie Notes de bas de page Auteurs

    Texte intégral

    1. Introduction

    1In this paper we describe Il mago della ghigliottina (Sangati, Pascucci, and Monti 2020), a bot which participated in Ghigliottin-AI, one of the Evalita 2020 tasks (P. Basile et al. 2020). Evalita1 (V. Basile et al. 2020) is an initiative of AILC (Associazione Italiana di Linguistica Computazionale) and is a periodic evaluation campaign of Natural Language Processing (NLP) and speech tools for the Italian language, which takes place every two years in conjunction with CLiC-IT2, the Italian Conference on Computational Linguistics. Ghigliottin-AI takes its cue from the Evalita 2018 NLP4FUN (Basile et al. 2018) task. Participants are asked to build an artificial player able to solve “La Ghigliottina”, the final game of the popular Italian TV quiz show “L’Eredità”. The game involves a single player, who is given a set of five words (clues), unrelated one to each other, but related with a sixth word that represents the solution to the game. Our system took already part in the 2018 Evalita task NLP4FUN as UNIOR4NLP (Sangati, Pascucci, and Monti 2018). Il mago della Ghigliottina is identical to UNIOR4NLP, being based on the same principles and methodologies: analyzing real game instances we found out that in most cases clues and solution are connected because they form a Multiword Expression (MWE). A MWE can be defined as a sequence of words that presents some characteristic behaviour (at the lexical, syntactic, semantic, pragmatic or statistical level) and whose interpretation crosses the boundaries between words (Sag et al. 2002). MWEs are lexical items which convey a single meaning different from the meanings of the constituents of the MWE, such as in the idiomatic expression kick the bucket where the simple addition of the meanings of kick and bucket does not convey the meaning of to die. We have decided to participate as Il mago della ghigliottina instead of UNIOR4NLP because after participating in the NLP4FUN task in 2018 we developed three different versions of the solver Il mago della ghigliottina available as i) a Telegram Bot (@Unior4NLPbot)3, ii) a Twitter bot (@UNIOR4NLP) and finally iii) an Amazon Alexa skill (Mago della Ghigliottina). This paper is organized as follows: in Section 2 we present related work and in Section 3 we provide an overview of the task. In Section 4 we describe our system. Results are shown in Section 5 while in Section 6 we focus on the error anaysis. Conclusions are in Section 7 along with future work.

    2. Related work

    2Languages have always been a source of inspiration to create games. As the years passed, the possibility to rely on large linguistic resources and artificial intelligence has allowed scholars to build systems able to solve games, which represent an interesting playground to test the results of research (Yannakakis and Togelius 2018). When we think about linguistics and artificial intelligence it is almost obvious to think to the IBM Watson system, which successfully challenged human champions of Jeopardy!TM, a game where contestants are presented with clues in the form of answers, and must phrase their responses in the form of a question (Ferrucci et al. 2013). Another interesting example is represented by solvers of Italian crosswords (Ernandes, Angelini, and Gori 2008; Littman, Keim, and Shazeer 2002). The scientific community periodically organizes i) shared tasks to evaluate Natural Language Processing (NLP) applications in the solution of linguistic games (Ghigliottin-AI is an example) and ii) workshops focused on games and gamification for NLP tasks. The Games and NLP (Lukin 2020) workshop, for instance, was organized this year in the context of the LREC 2020 conference. Fourteen teams presented their research in occasion of this workshop, and according to the submitted papers, we can state that the research moves in two directions: i) the exploitation of NLP techniques to solve linguistic games on the basis of semantic relations between words and ii) the development of Games With A Purpose (GWAPs) in order to crowdsource linguistic data from engaged players.
    TV games, such as “
    Wheel of Fortune”, “Who wants to be a Millionaire?” and, indeed, “La Ghigliottina” represent an interesting test bench for linguistic knowledge-based systems. (Molino et al. 2015) exploit question answering techniques to build an artificial player for Who wants to be a Millionaire?. With regard to our specific case study, other systems were built to solve “La Ghigliottina”. OTTHO (Semeraro et al. 2009; Basile et al. 2016), the first artificial player of “La Ghigliottina”, is a system based on i) web resources (e.g. Wikipedia) in order to build a lexicon and a knowledge repository and ii) a knowledge base modeling represented by an association matrix which stores the degree of correlation between any two terms in the lexicon. Word correlations are detected by connecting i) lemmas to the terms in its dictionary definition, pair of words occurring in a proverb, movie or song title, and ii) pair of similar words by exploiting Vector Space Models (Salton, Wong, and Yang 1975). During the NLP4FUN Task in 2018 two systems took part in the competition: our system (which is presented in Section 4) and (Squadrone 2018), that proposed an algorithm based on two steps: i) for each clue of a game, a list of relevant keywords is retrieved from linguistic corpora, so that each clue is associated with keywords representing the concepts having a relation with that clue. Then, words at the intersection of the retrieved sets are considered as candidate solutions; ii) another knowledge source made of proverbs, book and movie titles, word definitions, is exploited to count co-occurrences of clues and candidate solutions. A further system developed to solve “La Ghigliottina” game is Robospierre (Cirillo, Pericolo, and Tufano 2019), a system which relies on MWEs automatically extracted through a lexicalized association rules algorithm, on a list of proverbs and on some lists of titles.

    3. The Ghigliottin-AI task

    3Ghigliottin-AI is one of the Evalita 2020 tasks. The aim of Evalita (which in 2020 reached its seventh edition) is to promote the development of language and speech technologies for Italian, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. Ghigliottin-AI participants are asked to build an artificial player able to solve “La Ghigliottina”, the final game of the Italian TV show “L’Eredità”. Given a set of five words (clues) the player has to find the solution to the game which is a sixth word related with each one of the five clues. The five clues are unrelated one to each other. For example, given the set of clues conoscere (to know), grado (degree), modello (model), ideale (ideal) and divina (divine) the solution is perfezione (perfection) because: conoscere alla perfezione (to perfectly know), grado di perfezione (degree of perfection), modello di perfezione (model of perfection), ideale di perfezione (ideal of perfection) and perfezione divina (divine perfection). In order to train participants’ systems, the task organizers provided a set of 300 games with their five clues and their solution in a JSON format. This training set is taken from the last editions of the TV game. The systems have been then evaluated using an API based methodology, namely the Remote Evaluation Server (RES) Ghigliottiniamo4 which currently enables both humans and artificial systems (bots) to submit solutions to the TV game in real-time. The test set consists in 350 games instances, provided by Ghigliottiniamo at random intervals of time as a request with a single game challenge to registered systems. The RES allowed systems to reply with a single solution to the game. Similar to the original TV game, where players have 60 seconds to provide the solution, the RES discards solutions received after 60 seconds from the submitted challenge. The same happened in evaluating systems participating in Ghigliottin-AI.

    4. System description

    4This section describes Il mago della Ghigliottina, which, as already mentioned, is the system submitted in 2018 without any changes. The system is based on the analysis of real game instances: in most cases clues and solution are connected because they form a MWE. A further observation is that clues are always nouns, verbs or adjectives, while solutions are nouns or adjectives. On this basis, we have detected six patterns that identify MWEs connecting clue/solution pairs:

    • A B pattern: diario segreto (‘diary secret’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpgsecret diary), brutta caduta (‘ugly fall’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpgbad fall), permesso premio (‘permit price’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpggood behaviour license), dare gas (‘give gas’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpgaccelerate).

    • A det B pattern: dare il permesso (‘give the permit’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpgauthorize).

    • A prep B pattern: colpo di coda (‘flick of tail’ Image 10000000000000110000000B019D36C8E5DBEB8E.jpglast ditch effort).

    • A conj B pattern: stima e affetto (esteem and affection).

    • A prepart B or A prep det B pattern: e.g. virtù dei forti, part of the famous Italian proverb La calma è la virtù dei forti (patience is the virtue of the strong).

    • A+B pattern: compounds such as radio + attività = radioattività (radio + activity = radioactivity).

    5The system is based on a number of freely available corpora:

    • Paisà : 225 M words corpus automatically annotated (Lyding et al. 2014).

    • itWaC : 1.5 B words corpus automatically annotated (Baroni et al. 2009)

    • Wiki-IT-Titles: Wikipedia-IT titles downloaded via WikiExtractor5.

    • Proverbs : 1955 proverbs from Wikiquote6 and 371 from an online collection7.
      In addition, we have developed the following lexical resources:

    • DeMauro-Ext: words extracted from “Il Nuovo vocabolario di base della lingua italiana”(De Mauro 2016b), extended with morphological variations obtained by changing last vowel of the word and checking if the resulting word has frequency Image 100000000000000C0000000F9A797CEB0EDF6CC1.jpg1000 in Paisà.

    • DeMauro-MWEs: MWEs extracted from the “De Mauro online dictionary” (De Mauro 2016a) composed of 30,633 entries.

    6More technical details about our system are available in (Sangati, Pascucci, and Monti 2018), submitted for the NLP4FUN task.

    5. Results

    7In this section, we discuss results and we also compare the performances achieved by our system in Ghigliottina-AI with those achieved in the Evalita NLP4FUN task. Compared to our participation in NLP4FUN, when our system proved to be the best performing one (Basile et al. 2018), the accuracy has increased from 61.0% to 68.6%. This is probably due to the fact that while the 2020 edition only used games from the TV game, in the 2018 edition 39 out of the 105 games in the test set were taken from the board game. This supports what already reported in (Sangati, Pascucci, and Monti 2018), that is, the board game edition presents different types of word-association as compared to the TV game. The Table 1 provides the performances of our system in both editions of the task.

    Table 1: Results on the Ghigliottin-AI and the NLP4FUN TEST sets. In the column “Total” we show the number of game instances in the test set. Accuracy is computed as the number of correct games divided the total

    Task

    Correct

    Total

    Accuracy

    Ghigliottin-AI (2020)

    240

    350

    68.6%

    NLP4FUN (2018)

    64

    105

    61.0%

    6. Error analysis

    8In the attempt of providing the correct solution to the 350 game instances that compose the Ghigliottin-AI test set, 110 errors have been made, which represent 32.4% of the whole test set. In this section we discuss the errors, trying to analyze and justify them. In particular, we try to detect the motivation behind errors, in order to categorize them. The following list presents examples of different categories of errors we detected.

    6.1 High correlation between clue(s) and our solution

    9One or more clues have a high correlation with the wrong solution provided by the system.

    A clues: fare (to do), saldo (two different meanings sale and balance), interessato (interested), grande (several meanings, such as big and great) and attenzione (attention). Our system provided the solution shopping (the same in English) instead of the right one richiesta (request). In this case the system didn’t disambiguate correctly the meaning of saldo (richiesta di saldo, namely balance request). The system chose the solution shopping instead of richiesta due to the high correlation between shopping and saldo (sale). One possible explanation is that shopping and saldo almost always occur in the same sentence. For this reason the solution shopping achieved a higher weight compared to that of other solutions;

     

    B clues: brutto (ugly), fare (to do), morto (dead), cavaliere (kinght) and diavolo (devil). The solution is paura (fear), while our system provided the solution povero (poor). Considering that our system is also trained with a list of proverbs, in this case the error is due to the high correlation between povero and diavolo (povero diavolo) is a famous way of saying;

     

    C clues: perdere (to lose), amicizia (frienship), bottiglia (bottle), acqua (water) and quattro (four). The right solution is segno (sign), but our system provided the solution bicchiere (glass) due to the high correlation with bottiglia and acqua.

    6.2 Right kind of reasoning, wrong solution

    10Wrong solutions such as singular instead of plural (and vice-versa), or trivial mistakes in the face of a right kind of reasoning.

    11D clues: questione (question), indagine (investigation), disegno (design), pagamento (payment) and lavorare (to work). Instead of metodo (method), our system provided its plural metodi;

    12E clues: copertina (cover), dimensione (dimension), persona (person), seno (sinus) and età (age). The solution is terza (third), but our system provided the wrong solution quarta (fourth) which has correlation with all the five clues.

    6.3 Clue(s) and solution are synonyms

    13The solution provided by our system is a synonym of one or more clue(s).

    F clues: essere (to be), prezzo (price), fermo (stop), capitale (capital) and regolare (regular). The solution is partenza (departure), but our system provided the solution fisso (fixed) which can be intended as a synonym of fermo.

    6.4 Unclear solutions

    14This subsection discusses some strange solutions provided by the system. The solutions that our system detects are listed from the best to the worst one. Then, it chooses the best one. Thanks to a debug function it is possible to analyze the solutions provided by the system in order to understand what is their correlation with one or more clues. The examples provided below concern solutions apparently strange which we analyzed thanks to this function.

    G clues: vecchio (old), cavallo (horse), end (the same in English), soda (the same in English) and conquista (conquest). The solution is west (the same in English). Our system provided the solution polenta (the same in English), which is a dish as well as the surname of a famous Italian commander lived in the 13th century (Guido da Polenta), also knows as “il Vecchio” (the Elder);

    H clues: gioco (game), trovare (to find), fuori (out), dollaro (dollar) and quadrato (square). The solurion is area (the same in English), but our system provided the solution straccio (shred), due to the high correlation with trovare because of the way of saying non trovare uno straccio di prova (do not have a shred of evidence);

    I clues: erba (grass), sangue (blood), indagine (investigation), prova (evidence) and miss (Miss). The solution is campione (champion), but our system provided the solution pazienza (patience), because of the high correlation with erba: Erba pazienza (Patience Dock) is the common name for the Rumex patientia plant.

    15Debugging the system also allows us to observe if the right solution is in the list of best solutions provided by the system and how it is ranked. Statistics based on the 110 errors recorded during the test phase are reported in Table 2, where “best of 5” means: best solutions detected when there is correlation between each one of the solutions and all the five clues. The same reasoning applies to “best of 4” and “best of 3”.

    Table 2: Correct solutions in our system list when error solutions are provided as best solution

    Correct solution is

    Occurrences

    the 2nd best solution

    22

    in the Best of 5 list

    30

    in the Best of 4 list

    13

    in the Best of 3 list

    6

    not in the list

    61

    16As we can see, in 22 cases the correct solution is the second best solution detected by our system. In 61 cases the correct one is not in the whole list of possible solutions detected by the system.

    6.5 Part-of-speech errors

    17We also noticed that some errors are due to the selection of solutions with a wrong part-of-speech (POS). In Table 3 we report the occurrences of POS errors.

    Table 3: Occurrences of error POS provided by our system instead of correct POS

    Error POS

    Correct POS

    Occurrences

    Noun

    Noun

    80

    Adjective

    Noun

    26

    Noun

    Adjective

    2

    Verb

    Noun

    2

    Noun

    Adjective

    -

    18In particular, in 26 cases the system selected an adjective as solution instead of a noun, for example:

    J - clues: scrivere (to write), rosso (red), luce (light), colori (colors) and inchiesta (inquiry). The solution is film (movie), namely a Noun. In this case while our system provided the solution giallo (yellow) (an Adjective). We can also note that the error solution has been provided because two of the five clues (rosso and colori) are related to the same conceptual group of giallo, namely colors.

    7. Conclusions and future work

    19In this paper we described Il mago della ghigliottina, a system which took part in the Evalita 2020 Ghigliottin-AI task. Our system achieved an accuracy of 0.6857, with 240 correct solutions given on a test set composed of 350 game instances. As already mentioned, our system is the same system which took part in the Evalita 2018 NLP4FUN task and is designed on a key observation: clues are connected to the solution because they form a multiword expression (MWE). In order to build our system, we collected linguistic and lexical resources described in Section 4. Since future work will focus on improving the performances of the system, a special focus has been dedicated to error analysis. Section 6, in fact, presents different categories of errors we detected (with examples and clarification of errors) as well as statistics about correct solutions presence in our system list of solutions.

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    Basile, P., de Gemmis, M., Lops, P., & Semeraro, G. (2016). Solving a Complex Language Game by Using Knowledge-Based Word Associations Discovery. Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/tciaig.2014.2355859
    Caselli, T., Novielli, N., Patti, V., & Rosso, P. (Eds.). (2018). EVALITA Evaluation of NLP and Speech Tools for Italian. Accademia University Press. https://doi.org/10.4000/books.aaccademia.4421
    Littman, M. L., Keim, G. A., & Shazeer, N. (2002). A probabilistic approach to solving crossword puzzles. Elsevier BV. https://doi.org/10.1016/s0004-3702(01)00114-x
    Caselli, T., Novielli, N., Patti, V., & Rosso, P. (Eds.). (2018). EVALITA Evaluation of NLP and Speech Tools for Italian. Accademia University Press. https://doi.org/10.4000/books.aaccademia.4421
    Basile, Pierpaolo, Marco de Gemmis, Pasquale Lops, and Giovanni Semeraro. “Solving a Complex Language Game by Using Knowledge-Based Word Associations Discovery”. IEEE Transactions on Computational Intelligence and AI in Games. Institute of Electrical and Electronics Engineers (IEEE), March 2016. doi:10.1109/tciaig.2014.2355859.
    Caselli, Tommaso, Nicole Novielli, Viviana Patti, and Paolo Rosso, eds. EVALITA Evaluation of NLP and Speech Tools for Italian. []. Accademia University Press, 2018. doi:10.4000/books.aaccademia.4421.
    Littman, Michael L., Greg A. Keim, and Noam Shazeer. “A Probabilistic Approach to Solving Crossword Puzzles”. Artificial Intelligence. Elsevier BV, January 2002. doi:10.1016/s0004-3702(01)00114-x.
    Caselli, Tommaso, Nicole Novielli, Viviana Patti, and Paolo Rosso, eds. EVALITA Evaluation of NLP and Speech Tools for Italian. []. Accademia University Press, 2018. doi:10.4000/books.aaccademia.4421.
    Basile, Pierpaolo, et al. “Solving a Complex Language Game by Using Knowledge-Based Word Associations Discovery”. IEEE Transactions on Computational Intelligence and AI in Games, vols. 8, no. 1, Institute of Electrical and Electronics Engineers (IEEE), Mar. 2016, pp. 13-26. Crossref, https://doi.org/10.1109/tciaig.2014.2355859.
    Caselli, Tommaso, et al., editors. EVALITA Evaluation of NLP and Speech Tools for Italian. [], Accademia University Press, 2018. Crossref, https://doi.org/10.4000/books.aaccademia.4421.
    Littman, Michael L., et al. “A Probabilistic Approach to Solving Crossword Puzzles”. Artificial Intelligence, vols. 134, no. 1-2, Elsevier BV, Jan. 2002, pp. 23-55. Crossref, https://doi.org/10.1016/s0004-3702(01)00114-x.
    Caselli, Tommaso, et al., editors. EVALITA Evaluation of NLP and Speech Tools for Italian. [], Accademia University Press, 2018. Crossref, https://doi.org/10.4000/books.aaccademia.4421.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    Marco Baroni, Silvia Bernardini, Adriano Ferraresi, and Eros Zanchetta. 2009. “The Wacky Wide Web: A Collection of Very Large Linguistically Processed Web-Crawled Corpora.” Lang. Resources and Evaluation 43 (3): 209–26.

    Pierpaolo Basile, Marco de Gemmis, Pasquale Lops, and Giovanni Semeraro. 2016. “Solving a Complex Language Game by Using Knowledge-Based Word Associations Discovery.” IEEE Transactions on Computational Intelligence and AI in Games 8 (1): 13–26.

    10.1109/TCIAIG.2014.2355859 :

    Pierpaolo Basile, Marco de Gemmis, Lucia Siciliani, and Giovanni Semeraro. 2018. “Overview of the Evalita 2018 Solving Language Games (Nlp4fun) Task.” In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), edited by Tommaso Caselli, Nicole Novielli, Viviana Patti, and Paolo Rosso. Turin, Italy: CEUR.org.

    10.4000/books.aaccademia.4421 :

    Pierpaolo Basile, Marco Lovetere, Johanna Monti, Antonio Pascucci, Federico Sangati, and Lucia Siciliani. 2020. “Ghigliottin-Ai@EVALITA2020 Evaluating Artificial Playersfor the Language Game ‘La Ghigliottina’.” In Proceedings of Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (Evalita 2020).

    Valerio Basile, Danilo Croce, Maria Di Maro, and Lucia C. Passaro. 2020. “EVALITA 2020: Overview of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian.” In Proceedings of Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (Evalita 2020), edited by Valerio Basile, Danilo Croce, Maria Di Maro, and Lucia C. Passaro. Online: CEUR.org.

    Nicola Cirillo, Chiara Pericolo, and Pasquale Tufano. 2019. “Robospierre, an Artificial Intelligence to Solve" La Ghigliottina".” In CLiC-It.

    Tullio De Mauro. 2016a. “Il Nuovo de Mauro (Online).” https://dizionario.internazionale.it.

    Tullio De Mauro. 2016b. “Il Nuovo vocabolario di base della lingua italiana (pdf version).” https://www.internazionale.it/opinione/tullio-de-mauro/2016/12/23/il-nuovo-vocabolario-di-base-della-lingua-italiana.

    Marco Ernandes, Giovanni Angelini, and Marco Gori. 2008. “A Web-Based Agent Challenges Human Experts on Crosswords.” AI Magazine 29 (1): 77–77.

    David A. Ferrucci, Anthony Levas, Sugato Bagchi, David Gondek, and Erik T. Mueller. 2013. “Watson: Beyond Jeopardy!” Artif. Intell. 199: 93–105.

    Michael L. Littman, Greg A Keim, and Noam Shazeer. 2002. “A Probabilistic Approach to Solving Crossword Puzzles.” Artificial Intelligence 134 (1-2): 23–55.

    10.1016/S0004-3702(01)00114-X :

    Stephanie M. Lukin, ed. 2020. Workshop on Games and Natural Language Processing. Marseille, France: European Language Resources Association.

    Verena Lyding, Egon Stemle, Claudia Borghetti, Marco Brunello, Sara Castagnoli, Felice Dell’Orletta, Henrik Dittmann, Alessandro Lenci, and Vito Pirrelli. 2014. “The PAISÀ Corpus of Italian Web Texts.” In Proceedings of the 9th Web as Corpus Workshop (Wac-9), 36–43. Gothenburg, Sweden: Association for Computational Linguistics.

    Piero Molino, Pasquale Lops, Giovanni Semeraro, Marco de Gemmis, and Pierpaolo Basile. 2015. “Playing with Knowledge: A Virtual Player for ‘Who Wants to Be a Millionaire?’ That Leverages Question Answering Techniques.” Artificial Intelligence 222: 157–81.

    Ivan A. Sag, Timothy Baldwin, Francis Bond, Ann Copestake, and Dan Flickinger. 2002. “Multiword Expressions: A Pain in the Neck for Nlp.” In International Conference on Intelligent Text Processing and Computational Linguistics, 1–15. Springer.

    Gerard Salton, Anita Wong, and Chung-Shu Yang. 1975. “A Vector Space Model for Automatic Indexing.” Commun. ACM 18 (11): 613–20.

    Federico Sangati, Antonio Pascucci, and Johanna Monti. 2018. “Exploiting Multiword Expressions to Solve ‘La Ghigliottina’.” In Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (Evalita 2018), 2263:258–63. Accademia University Press.

    Federico Sangati, Antonio Pascucci, and Johanna Monti. 2020. “The Challenge of the Tv Game La Ghigliottina to Nlp.” In Workshop on Games and Natural Language Processing, 34–38.

    Giovanni Semeraro, Pasquale Lops, Pierpaolo Basile, and Marco De Gemmis. 2009. “On the Tip of My Thought: Playing the Guillotine Game.” In Proceedings of the 21st International Jont Conference on Artifical Intelligence, 1543–8. IJCAI’09. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.

    Luca Squadrone. 2018. “Computer Challenges Guillotine: How an Artificial Player Can Solve a Complex Language Tv Game with Web Data Analysis.” EVALITA Evaluation of NLP and Speech Tools for Italian 12: 262.

    10.4000/books.aaccademia.4421 :

    Georgios N. Yannakakis, and Julian Togelius. 2018. Artificial Intelligence and Games. Springer.

    Notes de bas de page

    1 http://www.evalita.it

    2 http://clic2020.ilc.cnr.it/it/home

    3 A short video showing how the bot works is available at https://youtu.be/3fggGlJaSII

    4 https://quiztime.net

    5 http://attardi.github.io/wikiextractor. Last accessed on the 1st October 2018

    6 https://it.wikiquote.org/wiki/Proverbi_italiani. Downloaded on the 24th April 2018

    7 http://web.tiscali.it/proverbiitaliani. Downloaded on the 24th April 2018

    Auteurs

    • Federico Sangati

      L’Orientale University of Naples - UNIOR NLP Research Group, Italy - Okinawa Institute of Science and Technology Graduate University, Japan – federico.sangati@gmail.com

    • Antonio Pascucci

      L’Orientale University of Naples - UNIOR NLP Research Group, Italy – apascucci@unior.it

    • Johanna Monti

      L’Orientale University of Naples - UNIOR NLP Research Group, Italy – jmonti@unior.it

    Précédent Suivant
    Table des matières

    Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0

    Le texte seul est utilisable sous licence Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study

    Raffaele Manna, Antonio Pascucci, Wanda Punzi Zarino et al.

    Voir plus de chapitres
    1 / 9

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study

    Raffaele Manna, Antonio Pascucci, Wanda Punzi Zarino et al.

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 http://www.evalita.it

    2 http://clic2020.ilc.cnr.it/it/home

    3 A short video showing how the bot works is available at https://youtu.be/3fggGlJaSII

    4 https://quiztime.net

    5 http://attardi.github.io/wikiextractor. Last accessed on the 1st October 2018

    6 https://it.wikiquote.org/wiki/Proverbi_italiani. Downloaded on the 24th April 2018

    7 http://web.tiscali.it/proverbiitaliani. Downloaded on the 24th April 2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    X Facebook Email

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Sangati, F., Pascucci, A., & Monti, J. (2020). “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence. In V. Basile, D. Croce, M. Maro, & L. C. Passaro (éds.), EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.7498
    Sangati, Federico, Antonio Pascucci, et Johanna Monti. « “Il Mago Della Ghigliottina” @ Ghigliottin-AI: When Linguistics Meets Artificial Intelligence ». In EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020, édité par Valerio Basile, Danilo Croce, Maria Maro, et Lucia C. Passaro. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.7498.
    Sangati, Federico, et al. « “Il Mago Della Ghigliottina” @ Ghigliottin-AI: When Linguistics Meets Artificial Intelligence ». EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020, édité par Valerio Basile et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.7498.

    Référence numérique du livre

    Format

    Basile, V., Croce, D., Maro, M., & Passaro, L. C. (éds.). (2020). EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.6732
    Basile, Valerio, Danilo Croce, Maria Maro, et Lucia C. Passaro, éd. EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.6732.
    Basile, Valerio, et al., éditeurs. EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.6732.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement