• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16095 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16095 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • Proceedings of the Seventh Italian Confe...
  • ›
  • Contributed Papers
  • ›
  • Simple Data Augmentation for Multilingua...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 3.1 Slot Filling and Intent Classification Data Augmentation (DA) Methods 4. Experiments 5. Results 6. Related Work 7. Conclusion Bibliographie Annexe Notes de bas de page Auteurs

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    Simple Data Augmentation for Multilingual NLU in Task Oriented Dialogue Systems

    Samuel Louvan et Bernardo Magnini

    p. 250-256

    Résumé

    Data augmentation has shown potential in alleviating data scarcity for Natural Language Understanding (e.g. slot filling and intent classification) in task-oriented dialogue systems. As prior work has been mostly experimented on English datasets, we focus on five different languages, and consider a setting where limited data are available. We investigate the effectiveness of non-gradient based augmentation methods, involving simple text span substitutions and syntactic manipulations. Our experiments show that (i) augmentation is effective in all cases, particularly for slot filling; and (ii) it is beneficial for a joint intent-slot model based on multilingual BERT, both for limited data settings and when full training data is used.

    Remerciements

    We thank Valentina Bellomaria for providing the Italian SNIPS dataset. We thank Clara Vania for the feedback on the early draft of the paper.

    Texte intégral Bibliographie Annexe Appendix A. Hyperparameters Appendix B. Statistical Significance Notes de bas de page Auteurs

    Texte intégral

    1. Introduction

    1Natural Language Understanding (NLU) in task-oriented dialogue systems is responsible for parsing user utterances to extract the intent of the user and the arguments of the intent (i.e. slots) into a semantic representation, typically a semantic frame (Tur and De Mori 2011). For example, the utterance “Play Jeff Pilson on Youtube" has the intent PlayMusic and “Youtube" as value for the slot Service. As more skills are added to the dialogue system, the NLU model frequently needs to be updated to scale to new domains and languages, a situation which typically becomes problematic when labeled data are limited (data scarcity).

    2One way to combat data scarcity is through data augmentation (DA) techniques performing label preserving operations to produce auxiliary training data. Recently, DA has shown potential in tasks such as machine translation (Fadaee, Bisazza, and Monz 2017), constituency and dependency parsing (Şahin and Steedman 2018; Vania et al. 2019), and text classification (Wei and Zou 2019; Kumar, Choudhary, and Cho 2020). As for slot filling (SF) and intent classification (IC), a number of DA methods have been proposed to generate synthetic utterances using sequence to sequence models (Hou et al. 2018; Zhao, Zhu, and Yu 2019), Conditional Variational Auto Encoder (Yoo, Shin, and Lee 2019), or pre-trained NLG models (Peng et al. 2020). To date, most of the DA methods are evaluated on English and it is not clear whether the same finding apply to other languages.1

    3In this paper, we study the effectiveness of DA on several non-English datasets for NLU in task-oriented dialogue systems. We experiment with existing lightweight, non-gradient based, DA methods from that produces varying slot values through substitution and sentence structure manipulation by leveraging syntactic information from a dependency parser. We evaluate the DA methods on NLU datasets from five languages: Italian, Hindi, Turkish, Spanish, and Thai. The contributions of our paper are as follows:

    1. We assess the applicability of DA methods for NLU in task-oriented dialogue systems in five languages.

    2. We demonstrate that simple DA can improve performance on all languages despite different characteristic of the languages.

    3. We show that a large pre-trained multilingual BERT (M-Bert) (Devlin et al. 2019) can still benefit from DA, in particular for slot filling.

    Figure 1

    Image 10000000000003B00000018D8053750D4857B103.jpg

    Augmentation operations performed on an utterance, “Quali film animati stanno proiettando al cinema piu vicino” (“Which animated films are showing at the nearest cinema”). The utterance is taken from the Italian SNIPS dataset.

    3.1 Slot Filling and Intent Classification

    4The NLU component of a task-oriented dialogue system is responsible in a parsing user utterance into a semantic representation, such as semantic frame. The semantic frame conveys information, namely the user intent and the corresponding arguments of the intent. Extracting such information involves slot filling (SF) and intent classification (IC) tasks.

    5Given an input utterance of n tokens, x = (x1, x2,.., xn), the system needs to assign a particular intent yintent for the whole utterance x and the corresponding slots that are mentioned in the utterance Image 10000000000000C30000001554E06C2F914AB664.jpg. In practice, IC is typically modeled as text classification and SF as a sequence tagging problem. As an example, for the utterance “Play Jeff Pilson on Youtube", yintent is PlayMusic, as the intent of the user is to ask the system to play a song from a musician and yslot = (O, B-ARTIST, I-ARTIST, O, B-SERVICE) in which the artist is “Jeff Pilson" and the service is “Youtube"". Slot labels are in BIO format: B indicates the start of a slot span, I the inside of a span while O denotes that the word does not belong to any slot. Recent approaches for SF and IC are based on neural network methods that models SF and IC jointly (Goo et al. 2018; Chen, Zhuo, and Wang 2019) by sharing model parameter among both tasks.

    Data Augmentation (DA) Methods

    6DA aims to perform semantically preserving transformations on the training data Image 100000000000000E0000000DC1930BBBC8FA4911.jpgto produce auxiliary data Image 10000000000000130000000E83B09F3EF2332B72.jpg. The union of Image 100000000000000E0000000DC1930BBBC8FA4911.jpgand Image 10000000000000130000000E83B09F3EF2332B72.jpgis then used to train a particular NLU model. For each utterance in Image 100000000000000E0000000DC1930BBBC8FA4911.jpg, we produce N augmented utterances by applying a specific augmentation operation. We adopt a subset of existing augmentation methods from , that has shown promising results on English datasets. We describe the augmentation operations in the following sections.

    3.1 Slot Substitution (Slot-Sub)

    7Slot-Sub (Figure 1 left) performs augmentation by substituting a particular text span (slot-value pair) in an utterance with a different text span that is semantically consistent i.e., the slot label is the same. For example, in the utterance “Quali film animati stanno proiettando al cinema più vicino”, one of the spans that can be substituted is the slot value pair (più vicino, spatial relation). Then, we collect other spans in Image 100000000000000E0000000DC1930BBBC8FA4911.jpg in which the slot values are different, but the slot label is the same. For instance, we found the substitute candidates SP'= {(“distanza a piedi”, spatial relation), (“lontano”, spatial relation), (“nel quartiere”, spatial relation), …}, and then we sample one span to replace the original span in the utterance.

    Table 1

    #Label

    #Utterance (Image 100000000000000E0000000DC1930BBBC8FA4911.jpg)

    #Augmented Utterances (Image 10000000000000130000000E83B09F3EF2332B72.jpg)

    Dataset

    Language

    #slot

    #intent

    #train

    #dev

    #test

    #Slot-Sub

    #Crop

    #Rotate

    SNIPS-IT

    Italian

    39

    7

    574

    700

    698

    5,404

    1,431

    1,889

    ATIS-HI

    Hindi

    73

    17

    176

    440

    893

    1,286

    460

    472

    ATIS-TR

    Turkish

    70

    17

    99

    248

    715

    144

    161

    194

    FB-ES

    Spanish

    11

    12

    361

    1,983

    3,043

    1,455

    769

    1,028

    FB-T

    Thai

    8

    10

    215

    1,235

    1,692

    781

    -

    -

    Statistics on the datasets. #train indicates our limited training data setup (10% of full training data). Image 10000000000000130000000E83B09F3EF2332B72.jpgis produced by tuning the number of augmentations per utterance (N) on the dev set.

    Table 2

    Model

    DA

    SNIPS-IT

    ATIS-HI

    ATIS-TR

    FB-ES

    FB-TH

    Slot

    Intent

    Slot

    Intent

    Slot

    Intent

    Slot

    Intent

    Slot

    Intent

    M-Bert

    None

    78.25

    94.99

    69.57

    86.57

    64.36

    78.98

    84.13

    97.68

    56.06

    89.80

    Slot-Sub

    81.97†

    94.93

    72.44†

    87.29

    66.60

    79.85

    84.27

    97.72

    59.68†

    91.42†

    Crop

    80.12†

    94.60

    70.04

    86.92

    65.11

    79.48

    83.85

    98.08‡

    -

    -

    Rotate

    79.24†

    95.37

    70.69

    87.60†

    65.20

    80.06

    83.28

    98.20†

    -

    -

    Combine

    81.27†

    95.00

    72.13†

    86.93

    66.68†

    81.12†

    83.67

    97.94

    -

    -

    Performance comparison of the baseline and augmentation methods on the test set. F1 score is used for slot filling and accuracy for intent classification. Scores are the average of 10 different runs. † indicates statistically significant improvement over the baseline (p-value < 0.05 according to Wilcoxon signed rank test).

    3.2 Crop and Rotate

    8In order to produce sentence variations, we apply the crop and rotate operations proposed in , which manipulate the sentence structure through its dependency parse tree. The goal of Crop (Figure 1 middle) is to simplify the sentence so that it focuses on a particular fragment (e.g. subject/object) by removing other fragments in the sentence. Crop uses the dependency tree to identify the fragment and then remove it and its children from the dependency tree.

    9The Rotate (Figure 1 right) operation is performed by moving a particular fragment (including subject/object) around the root of the tree, typically the verb in the sentence. For each operation, all possible combinations are generated, and one of them is picked randomly as the augmented sentence. Both Crop and Rotate rely on the universal dependency labels (Nivre et al. 2017) to identify relevant fragments, such as NSUBJ (nominal subject), DOBJ (direct object), OBJ (object), IOBJ (indirect object).

    4. Experiments

    10Our primary goal is to verify the effectiveness of data augmentation on Italian, Hindi, Turkish, Spanish and Thai NLU datasets with limited labeled data. To this end, we compare the performance of a baseline NLU model trained on the original training data (Image 100000000000000E0000000DC1930BBBC8FA4911.jpg) with a NLU model that incorporates the augmented data as additional training instances (Image 100000000000000E0000000DC1930BBBC8FA4911.jpg+ Image 10000000000000130000000E83B09F3EF2332B72.jpg). To simulate the limited labeled data situation we randomly sample 10% of the training data for each dataset.

    Baseline and Data Augmentation (DA) Methods

    11We use the state of the art BERT-based joint intent slot filling model (Chen, Zhuo, and Wang 2019) as the baseline model. We leverage the pre-trained multilingual BERT (M-Bert), which is trained on 104 languages. During training, M-Bert is fine tuned on the slot filling and intent classification tasks. Given a sentence representation Image 10000000000000AF000000132AB555DEC6746E8A.jpg, we use the hidden state h[CLS] to predict the intent, and Image 1000000000000012000000128F2F8DF36D0A0688.jpgto predict the slot label. As for DA methods, in addition to the methods described in Section 2, we add one configuration Combine, which combines the result of Slot-Sub and Rotate, as Rotate obtains better results than Crop on the development set.

    Settings

    12The model is trained with the BertAdam optimizer for 30 epochs with early stopping. The learning rate is set to 10-5 and batch size is 16. All the hyperparameters are listed in Appendix A. For Slot-Sub the number of augmentation per sentence N is tuned on the development set. To produce the dependency tree, we parse the sentence using Stanza (Qi et al. 2020). For both Crop and Rotate we follow the default hyperparameters from . We did not experiment with Thai for Crop and Rotate as Thai is not supported by Stanza. The number of augmented sentences (Image 10000000000000130000000E83B09F3EF2332B72.jpg) for each method is listed in Table 1. For evaluation metric, we use the standard CoNLL script to compute F1 score for slot filling and accuracy for intent classification.

    Datasets

    13For the Italian language, we use the data from , translated from the English SNIPS dataset (Coucke et al. 2018). SNIPS has been widely used for evaluating NLU models and consists of utterances in multiple domains. As for Hindi and Turkish, we use the ATIS dataset from , derived from . ATIS is a well known NLU dataset on flight domain. As for Spanish and Thai we use the FB dataset from that contains utterances in alarm, weather, and reminder domains. The overall statistics of the datasets are shown in Table 1.

    5. Results

    14The overall results reported in Table 2 show that applying DA improves performance on slot filling and intent classification across all languages. In particular, for SF, the Slot-Sub method yields the best result, while for IC, Rotate obtains better performance compared to Crop in most cases. These results are consistent with the finding from on the English dataset, where Slot-Sub improves SF and Crop or Rotate improve IC. In general, Rotate is better than Crop for most cases on IC, and we think this is because Crop may change the intent of the original sentence. Intents typically depend on the occurrence of specific slots, so when the cropped part is a slot-value, it may change the sentence’s overall semantics.

    15We can see that languages with different typological features (e.g. subject/verb/object ordering)2 benefit from Rotate operation for IC. This result suggests that augmentation can produce useful noise (regularization) for the model to alleviate overfitting when labeled data is limited. When we use Combine, it still helps the performance of both SF and IC, although the improvements are not as high as when only one of the augmentation method is applied. The only language that gets the benefits the most from Combine is Turkish. We hypothesize that as Turkish has a more flexible word order than the other languages it benefits the most when Rotate is performed.

    Figure 2

    Image 100000000000039100000261B8ED4946515805D2.jpg

    Improvement (ΔF1) obtained by Slot-Sub (SS) on different training data size. Positive numbers mean that the model with SS yields gain.

    Performance on varying data size

    16To better understand the effectiveness of Slot-Sub, we perform further analysis on different training data size (see Figure 2). Overall, we observe that as we increase the training size, the benefit of Slot-Sub is decreasing for all datasets. For some datasets, namely ATIS-HI and FB-ES, Slot-Sub can cause performance drop for larger data size, although it is reasonably small (less than 1 F1 point). FB-TH consistently benefits from Slot-Sub even when full training data is used. Until which training data size the improvement is significant vary across datasets3. For SNIPS-IT, improvement is clear for all training data size and they are statistically significant up until the training data size is 80%. For ATIS-HI improvements are significant until data size of 40%. As for FB datasets, improvements are significant only until the training data size is 10%. Overall, we can see that Slot-Sub is effective for cases where data is scarce (5%, 10%), while it is still relatively robust for larger data size on all datasets.

    Performance on different numbers of augmentation per utterance (N).

    17We examine the effect of a larger number of augmentations per utterance (N) to the model performance, specifically for SF (see Figure 3). For FB-ES, similarly to the results in Table 2, increasing N does not affect the performance. For the other datasets, increasing N brings performance improvement. For ATIS-HI, SNIPS-IT, and FB-TH the trend is that, as we increase N, performance goes up and plateau. For ATIS-TR, changing N does not really affect the gain of the performance as the performance trend is quite steady across number of augmentations. For most combinations of N in each dataset (except FB-ES), the difference between the performance of model that using Slot-Sub and the model that does not use Slot-Sub is significant.4

    Figure 3

    Image 10000000000003B0000002090F255540D0600C8B.jpg

    Gain (ΔF1) obtained by Slot-Sub (SS) on various number of augmented sentence (N). Positive numbers mean that the model with SS yields gain.

    6. Related Work

    18Data augmentation methods that has been proposed in NLP aims to automatically produce additional training data through different kinds of methods ranging from simple word substitution (Wei and Zou 2019) to more complex methods that aims to produce semantically preserving sentence generation (Hou et al. 2018; Gao et al. 2020). In the context of slot filling and intent classification, recent augmentation methods typically apply deep learning models to produce augmented utterances.

    19proposes a two-stages methods to produce the delexicalized utterances generation and slot values realization. Their method is based on a sequence to sequence based model (Sutskever, Vinyals, and Le 2014) to produce a paraphrase of an utterance with its slot values placeholder (delexicalized) for a given intent. For the slot values lexicalization, they use the slot values in the training data that occur in similar contexts. trains a sequence to sequence model with training instances that consist of a pair of atomic templates of dialogue acts and its sentence realization. proposes a solution by extending Variational Auto Encoder (VAE) (Kingma and Welling 2014) into a Conditional VAE (CVAE) to generate synthetic utterances. The CVAE controls the utterance generation by conditioning on the intent and slot labels during model training. Recent work from make use of Transformer (Vaswani et al. 2017) based pre-trained NLG namely GPT-2 (Radford et al. 2019), and fine-tune it to slot filling dataset to produce synthetic utterances. We consider these deep learning based approaches as heavyweight as they often require several stages in the augmentation process namely generating augmentation candidates, ranking and filtering the candidates before producing the final augmented data. Consequently, the computation time of these approaches is generally more expensive as separate training is required to train the augmentation and joint SF-IC models. Recent work from apply a set of lightweight methods in which most of the augmentation methods do not require model training. The augmentation methods focus on varying the slot values through substitution mechanisms and varying sentence structure through dependency tree manipulation. While the methods are relatively simple it obtains competitive results with deep learning based approaches on the standard English slot filling benchmark datasets namely ATIS (Hemphill, Godfrey, and Doddington 1990), SNIPS (Coucke et al. 2018), and FB (Schuster et al. 2019) datasets.

    20Existing methods mostly evaluate their approaches on English datasets, and little work has been done on other languages. Our work focuses on investigating the effect of data augmentation on five non-English languages. We apply a subset of lightweight augmentation methods from that do not require separate model training to produce augmentation data.

    7. Conclusion

    21We evaluate the effectiveness of data augmentation for slot filling and intent classification tasks in five typologically diverse languages. Our results show that by applying simple augmentation, namely slot values substitutions and dependency tree manipulations, we can obtain substantial improvement in most cases when only small amount of training data is available. We also show that a large pre-trained multilingual BERT benefits from data augmentation.

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). Presented at the Proceedings of the 2019 Conference of the North. https://doi.org/10.18653/v1/n19-1423
    Fadaee, M., Bisazza, A., & Monz, C. (2017). Data Augmentation for Low-Resource Neural Machine Translation. Presented at the Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). https://doi.org/10.18653/v1/p17-2090
    Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020). Stanza: A Python Natural Language Processing Toolkit for Many Human Languages. Presented at the Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. https://doi.org/10.18653/v1/2020.acl-demos.14
    Schuster, S., Gupta, S., Shah, R., & Lewis, M. (2019). Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog. Presented at the Proceedings of the 2019 Conference of the North. https://doi.org/10.18653/v1/n19-1380
    Şahin, G. G., & Steedman, M. (2018). Data Augmentation via Dependency Tree Morphing for Low-Resource Languages. Presented at the Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/d18-1545
    Vania, C., Kementchedjhieva, Y., Søgaard, A., & Lopez, A. (2019). A systematic comparison of methods for low-resource dependency parsing on genuinely low-resource languages. Presented at the Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://doi.org/10.18653/v1/d19-1102
    Wei, J., & Zou, K. (2019). EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. Presented at the Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://doi.org/10.18653/v1/d19-1670
    Yoo, K. M., Shin, Y., & Lee, S.- goo. (2019). Data Augmentation for Spoken Language Understanding via Joint Variational Generation. Association for the Advancement of Artificial Intelligence (AAAI). https://doi.org/10.1609/aaai.v33i01.33017402
    Zhao, Z., Zhu, S., & Yu, K. (2019). Data Augmentation with Atomic Templates for Spoken Language Understanding. Presented at the Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://doi.org/10.18653/v1/d19-1375
    Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Proceedings of the 2019 Conference of the North. Association for Computational Linguistics, 2019. doi:10.18653/v1/n19-1423.
    Fadaee, Marzieh, Arianna Bisazza, and Christof Monz. “Data Augmentation for Low-Resource Neural Machine Translation”. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, 2017. doi:10.18653/v1/p17-2090.
    Qi, Peng, Yuhao Zhang, Yuhui Zhang, Jason Bolton, and Christopher D. Manning. “Stanza: A Python Natural Language Processing Toolkit for Many Human Languages”. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics, 2020. doi:10.18653/v1/2020.acl-demos.14.
    Schuster, Sebastian, Sonal Gupta, Rushin Shah, and Mike Lewis. “Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog”. Proceedings of the 2019 Conference of the North. Association for Computational Linguistics, 2019. doi:10.18653/v1/n19-1380.
    Şahin, Gözde Gül, and Mark Steedman. “Data Augmentation via Dependency Tree Morphing for Low-Resource Languages”. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2018. doi:10.18653/v1/d18-1545.
    Vania, Clara, Yova Kementchedjhieva, Anders Søgaard, and Adam Lopez. “A Systematic Comparison of Methods for Low-Resource Dependency Parsing on Genuinely Low-Resource Languages”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2019. doi:10.18653/v1/d19-1102.
    Wei, Jason, and Kai Zou. “EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2019. doi:10.18653/v1/d19-1670.
    Yoo, Kang Min, Youhyun Shin, and Sang-goo Lee. “Data Augmentation for Spoken Language Understanding via Joint Variational Generation”. Proceedings of the AAAI Conference on Artificial Intelligence. Association for the Advancement of Artificial Intelligence (AAAI), July 17, 2019. doi:10.1609/aaai.v33i01.33017402.
    Zhao, Zijian, Su Zhu, and Kai Yu. “Data Augmentation With Atomic Templates for Spoken Language Understanding”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2019. doi:10.18653/v1/d19-1375.
    Devlin, Jacob, et al. Proceedings of the 2019 Conference of the North, Association for Computational Linguistics, 2019. Crossref, https://doi.org/10.18653/v1/n19-1423.
    Fadaee, Marzieh, et al. “Data Augmentation for Low-Resource Neural Machine Translation”. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Association for Computational Linguistics, 2017. Crossref, https://doi.org/10.18653/v1/p17-2090.
    Qi, Peng, et al. “Stanza: A Python Natural Language Processing Toolkit for Many Human Languages”. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Association for Computational Linguistics, 2020. Crossref, https://doi.org/10.18653/v1/2020.acl-demos.14.
    Schuster, Sebastian, et al. “Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog”. Proceedings of the 2019 Conference of the North, Association for Computational Linguistics, 2019. Crossref, https://doi.org/10.18653/v1/n19-1380.
    Şahin, Gözde Gül, and Mark Steedman. “Data Augmentation via Dependency Tree Morphing for Low-Resource Languages”. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, 2018. Crossref, https://doi.org/10.18653/v1/d18-1545.
    Vania, Clara, et al. “A Systematic Comparison of Methods for Low-Resource Dependency Parsing on Genuinely Low-Resource Languages”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics, 2019. Crossref, https://doi.org/10.18653/v1/d19-1102.
    Wei, Jason, and Kai Zou. “EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics, 2019. Crossref, https://doi.org/10.18653/v1/d19-1670.
    Yoo, Kang Min, et al. “Data Augmentation for Spoken Language Understanding via Joint Variational Generation”. Proceedings of the AAAI Conference on Artificial Intelligence, vols. 33, no. 01, Association for the Advancement of Artificial Intelligence (AAAI), 17 July 2019, pp. 7402-9. Crossref, https://doi.org/10.1609/aaai.v33i01.33017402.
    Zhao, Zijian, et al. “Data Augmentation With Atomic Templates for Spoken Language Understanding”. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics, 2019. Crossref, https://doi.org/10.18653/v1/d19-1375.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    Valentina Bellomaria, Giuseppe Castellucci, Andrea Favalli, and Raniero Romagnoli. 2019. Almawaveslu: A new dataset for SLU in italian. In Raffaella Bernardi, Roberto Navigli, and Giovanni Semeraro, editors, Proceedings of the Sixth Italian Conference on Computational Linguistics, Bari, Italy, November 13-15, 2019, volume 2481 of CEUR Workshop Proceedings. CEUR-WS.org.

    Qian Chen, Zhu Zhuo, and Wen Wang. 2019. “Bert for Joint Intent Classification and Slot Filling.” arXiv Preprint arXiv:1902.10909.

    Alice Coucke, Alaa Saade, Adrien Ball, Théodore Bluche, Alexandre Caulier, David Leroy, Clément Doumouro, et al. 2018. “Snips Voice Platform: An Embedded Spoken Language Understanding System for Private-by-Design Voice Interfaces.” ArXiv abs/1805.10190.

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. “BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171–86. Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423.

    10.18653/v1/N19-1423 :

    Marzieh Fadaee, Arianna Bisazza, and Christof Monz. 2017. “Data Augmentation for Low-Resource Neural Machine Translation.” In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 2: Short Papers, edited by Regina Barzilay and Min-Yen Kan, 567–73. Association for Computational Linguistics. https://doi.org/10.18653/v1/P17-2090.

    10.18653/v1/P17-2090 :

    Silin Gao, Yichi Zhang, Zhijian Ou, and Zhou Yu. 2020. “Paraphrase Augmented Task-Oriented Dialog Generation.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020, edited by Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault, 639–49. Association for Computational Linguistics. https://www.aclweb.org/anthology/2020.acl-main.60/.

    Chih-Wen Goo, Guang Gao, Yun-Kai Hsu, Chih-Li Huo, Tsung-Chieh Chen, Keng-Wei Hsu, and Yun-Nung Chen. 2018. “Slot-Gated Modeling for Joint Slot Filling and Intent Prediction.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), 753–57.

    Charles T. Hemphill, John J. Godfrey, and George R. Doddington. 1990. “The ATIS Spoken Language Systems Pilot Corpus.” In Speech and Natural Language: Proceedings of a Workshop Held at Hidden Valley, Pennsylvania, Usa, June 24-27, 1990. Morgan Kaufmann. https://www.aclweb.org/anthology/H90-1021/.

    Yutai Hou, Yijia Liu, Wanxiang Che, and Ting Liu. 2018. “Sequence-to-Sequence Data Augmentation for Dialogue Language Understanding.” In Proceedings of the 27th International Conference on Computational Linguistics, 1234–45. Santa Fe, New Mexico, USA: Association for Computational Linguistics. https://www.aclweb.org/anthology/C18-1105.

    Diederik P.Kingma, and Max Welling. 2014. “Auto-Encoding Variational Bayes.” In 2nd International Conference on Learning Representations, ICLR 2014, Banff, Ab, Canada, April 14-16, 2014, Conference Track Proceedings, edited by Yoshua Bengio and Yann LeCun. http://arxiv.org/abs/1312.6114.

    Varun Kumar, Ashutosh Choudhary, and Eunah Cho. 2020. “Data Augmentation Using Pre-Trained Transformer Models.” arXiv Preprint arXiv:2003.02245.

    Joakim Nivre, Željko Agić, Lars Ahrenberg, Lene Antonsen, Maria Jesus Aranzabe, Masayuki Asahara, Luma Ateyah, et al. 2017. “Universal Dependencies 2.1.”

    Baolin Peng, Chenguang Zhu, Michael Zeng, and Jianfeng Gao. 2020. “Data Augmentation for Spoken Language Understanding via Pretrained Models.” CoRR abs/2004.13952. https://arxiv.org/abs/2004.13952.

    Peng Qi, Yuhao Zhang, Yuhui Zhang, Jason Bolton, and Christopher D. Manning. 2020. “Stanza: A Python Natural Language Processing Toolkit for Many Human Languages.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 101–8. Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-demos.14.

    10.18653/v1/2020.acl-demos.14 :

    Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. “Language Models Are Unsupervised Multitask Learners.” In.

    Sebastian Schuster, Sonal Gupta, Rushin Shah, and Mike Lewis. 2019. “Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialog.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 3795–3805. Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1380.

    10.18653/v1/N19-1380 :

    Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. “Sequence to Sequence Learning with Neural Networks.” In Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, edited by Zoubin Ghahramani, Max Welling, Corinna Cortes, Neil D. Lawrence, and Kilian Q. Weinberger, 3104–12. http://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.

    Gözde Gül Şahin, and Mark Steedman. 2018. “Data Augmentation via Dependency Tree Morphing for Low-Resource Languages.” In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 5004–9. Brussels, Belgium: Association for Computational Linguistics. https://doi.org/10.18653/v1/D18-1545.

    10.18653/v1/D18-1545 :

    Gokhan Tur, and Renato De Mori. 2011. Spoken Language Understanding: Systems for Extracting Semantic Information from Speech. John Wiley & Sons.

    Clara Vania, Yova Kementchedjhieva, Anders Søgaard, and Adam Lopez. 2019. “A Systematic Comparison of Methods for Low-Resource Dependency Parsing on Genuinely Low-Resource Languages.” In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, edited by Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan, 1105–16. Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1102.

    10.18653/v1/D19-1102 :

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. “Attention Is All You Need.” In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, ca, USA, edited by Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, 5998–6008. http://papers.nips.cc/paper/7181-attention-is-all-you-need.

    Jason W. Wei and Kai Zou. 2019. “EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks.” In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, edited by Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan, 6381–7. Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1670.

    10.18653/v1/D19-1670 :

    Kang Min Yoo, Youhyun Shin, and Sang-goo Lee. 2019. “Data Augmentation for Spoken Language Understanding via Joint Variational Generation.” In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, the Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, the Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, Usa, January 27 - February 1, 2019, 7402–9. AAAI Press. https://doi.org/10.1609/aaai.v33i01.33017402.

    10.1609/aaai.v33i01.33017402 :

    Zijian Zhao, Su Zhu, and Kai Yu. 2019. “Data Augmentation with Atomic Templates for Spoken Language Understanding.” In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, edited by Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan, 3635–41. Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1375.

    10.18653/v1/D19-1375 :

    Annexe

     

    Appendix A. Hyperparameters

    Table 3: List of hyperparameters used for the BERT model and data augmentation methods

    Hyperparameter

    Value

    Learning rate

    10-5

    Dropout

    0.1

    Mini-batch size

    16

    Optimizer

    BertAdam

    Number of epoch

    30

    Early stopping

    10

    N

    Tuned on {2, 5, 10}

    Max rotation

    3

    Max crop

    3

    Appendix B. Statistical Significance

    Table 4: The p-values of statistical tests on the experiments on Figure 2

    Dataset

    Training Size (%)

    p-value

    ATIS-HI

    5

    0.04311444678

    10

    0.005062032126

    20

    0.04311444678

    40

    0.04311444678

    80

    0.1380107376

    100

    0.2733216783

    ATIS-TR

    5

    0.224915884

    10

    0.005062032126

    20

    0.7150006547

    40

    0.1797124949

    80

    0.1797124949

    100

    0.1797124949

    SNIPS-IT

    5

    0.04311444678

    10

    0.005062032126

    20

    0.04311444678

    40

    0.04311444678

    80

    0.04311444678

    100

    0.04311444678

    FB-ES

    5

    0.04311444678

    10

    0.02831405495

    20

    0.1797124949

    40

    0.1755543028

    80

    0.1380107376

    100

    0.1797124949

    FB-TH

    5

    0.04311444678

    10

    0.005062032126

    20

    0.1797124949

    40

    0.1797124949

    80

    0.1797124949

    100

    0.10880943

    Table 5: The p-values of statistical tests on the experiments on Figure 3

    Dataset

    Nb Aug

    p-value

    ATIS-TR

    2

    0.005062032126

    5

    0.01251531869

    10

    0.006910429808

    20

    0.5001842571

    25

    0.07961580146

    ATIS-HI

    2

    0.1097446387

    5

    0.005062032126

    10

    0.005062032126

    20

    0.04311444678

    25

    0.04311444678

    SNIPS-IT

    2

    0.005062032126

    5

    0.005062032126

    10

    0.005062032126

    20

    0.04311444678

    25

    0.04311444678

    FB-ES

    2

    0.0663160313

    5

    0.02831405495

    10

    0.09260069782

    20

    0.3452310718

    25

    0.07961580146

    FB-TH

    2

    0.03665792867

    5

    0.005062032126

    10

    0.005062032126

    20

    0.04311444678

    25

    0.04311444678

     

    Notes de bas de page

    1 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)

    2 Italian, Spanish, and Thai are SVO languages while Hindi and Turkish are SOV languages.

    3 For more details of the p-value of the statistical tests please refer to Appendix B

    4 For more details of the p-value of the statistical tests please refer to Appendix B

    Auteurs

    • Samuel Louvan

      University of Trento - Fondazione Bruno Kessler – slouvan@fbk.eu

    • Bernardo Magnini

      Fondazione Bruno Kessler – magnini@fbk.eu

    Précédent Suivant
    Table des matières

    Le texte seul est utilisable sous licence Licence OpenEdition Books. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    Investigating Continued Pretraining for Zero-Shot Cross-Lingual Spoken Language Understanding

    Samuel Louvan, Silvia Casola et Bernardo Magnini

    From General to Specific: Leveraging Named Entity Recognition for Slot Filling in Conversational Language Understanding

    Samuel Louvan et Bernardo Magnini

    The E3C Project: Collection and Annotation of a Multilingual Corpus of Clinical Cases

    Bernardo Magnini, Begoña Altuna, Alberto Lavelli et al.

    What’s in a Food Name: Knowledge Induction from Gazetteers of Food Main Ingredient

    Bernardo Magnini, Vevake Balaraman, Simone Magnolini et al.

    From Cambridge to Pisa: A Journey into Cross-Lingual Dialogue Domain Adaptation for Conversational Agents

    Tiziano Labruna et Bernardo Magnini

    Investigating Proactivity in Task-Oriented Dialogues

    Vevake Balaraman et Bernardo Magnini

    Lexical Opposition in Discourse Contrast

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Lexical Opposition in Discourse Contrast

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Contrast-Ita Bank: A corpus for Italian Annotated with Discourse Contrast Relations

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Effective Communication without Verbs? Sure!

    Identification of Nominal Utterances in Italian Social Media Texts

    Gloria Comandini, Manuela Speranza et Bernardo Magnini

    Semantic Interpretation of Events in Live Soccer Commentaries

    Anne-Lyse Minard, Manuela Speranza, Bernardo Magnini et al.

    Voir plus de chapitres
    1 / 11

    Investigating Continued Pretraining for Zero-Shot Cross-Lingual Spoken Language Understanding

    Samuel Louvan, Silvia Casola et Bernardo Magnini

    From General to Specific: Leveraging Named Entity Recognition for Slot Filling in Conversational Language Understanding

    Samuel Louvan et Bernardo Magnini

    The E3C Project: Collection and Annotation of a Multilingual Corpus of Clinical Cases

    Bernardo Magnini, Begoña Altuna, Alberto Lavelli et al.

    What’s in a Food Name: Knowledge Induction from Gazetteers of Food Main Ingredient

    Bernardo Magnini, Vevake Balaraman, Simone Magnolini et al.

    From Cambridge to Pisa: A Journey into Cross-Lingual Dialogue Domain Adaptation for Conversational Agents

    Tiziano Labruna et Bernardo Magnini

    Investigating Proactivity in Task-Oriented Dialogues

    Vevake Balaraman et Bernardo Magnini

    Lexical Opposition in Discourse Contrast

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Lexical Opposition in Discourse Contrast

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Contrast-Ita Bank: A corpus for Italian Annotated with Discourse Contrast Relations

    Anna Feltracco, Bernardo Magnini et Elisabetta Jezek

    Effective Communication without Verbs? Sure!

    Identification of Nominal Utterances in Italian Social Media Texts

    Gloria Comandini, Manuela Speranza et Bernardo Magnini

    Semantic Interpretation of Events in Live Soccer Commentaries

    Anne-Lyse Minard, Manuela Speranza, Bernardo Magnini et al.

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0)

    2 Italian, Spanish, and Thai are SVO languages while Hindi and Turkish are SOV languages.

    3 For more details of the p-value of the statistical tests please refer to Appendix B

    4 For more details of the p-value of the statistical tests please refer to Appendix B

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    X Facebook Email

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est cité par

    • Miaschi, Alessio. Alzetta, Chiara. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2023) Testing the Effectiveness of the Diagnostic Probing Paradigm on Italian Treebanks. Information, 14. DOI: 10.3390/info14030144
    • Miaschi, Alessio. Sarti, Gabriele. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2022) Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties. Italian Journal of Computational Linguistics, 8. DOI: 10.4000/ijcol.965
    • Saga, Satoshi. Shirakawa, Kanta. (2025) Investigating the Effect of Pseudo-Haptics on Perceptions Toward Onomatopoeia Text During Finger-Point Tracing. Multimodal Technologies and Interaction, 9. DOI: 10.3390/mti9100100
    • (2025) Book reviews. Yearbook of Phraseology, 16. DOI: 10.1515/phras-2025-0012

    Ce chapitre est cité par

    • Fuad, Ahlam. Al-Yahya, Maha. (2022) Cross-Lingual Transfer Learning for Arabic Task-Oriented Dialogue Systems Using Multilingual Transformer Model mT5. Mathematics, 10. DOI: 10.3390/math10050746
    • Distill-Quantize-Tune - Leveraging Large Teachers for Low-Footprint Efficient Multilingual NLU on Edge(2023) . DOI: 10.1109/ICASSP49357.2023.10095536
    • Multilingual Intent Recognition: A Study of Crosslingual Transfer Learning(2023) . DOI: 10.1109/CiSt56084.2023.10409959

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Louvan, S., & Magnini, B. (2020). Simple Data Augmentation for Multilingual NLU in Task Oriented Dialogue Systems. In F. Dell’Orletta, J. Monti, & F. Tamburini (éds.), Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8648
    Louvan, Samuel, et Bernardo Magnini. « Simple Data Augmentation for Multilingual NLU in Task Oriented Dialogue Systems ». In Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta, Johanna Monti, et Fabio Tamburini. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8648.
    Louvan, Samuel, et Bernardo Magnini. « Simple Data Augmentation for Multilingual NLU in Task Oriented Dialogue Systems ». Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8648.

    Référence numérique du livre

    Format

    Dell’Orletta, F., Monti, J., & Tamburini, F. (éds.). (2020). Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8203
    Dell’Orletta, Felice, Johanna Monti, et Fabio Tamburini, éd. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8203.
    Dell’Orletta, Felice, et al., éditeurs. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8203.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement