• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16030 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16030 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • EVALITA Evaluation of NLP and Speech Too...
  • ›
  • Track “Affect, Hate, and Stance”
  • ›
  • ATE_ABSITA: Aspect Term Extraction and A...
  • ›
  • ghostwriter19 @ ATE_ABSITA: Zero-Shot an...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 2. Description of the system 3. Results 4. Conclusion Bibliographie Notes de bas de page Auteur

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to speed up BERT on sentiment analysis tasks at EVALITA 2020

    Mauro Bennici

    p. 80-84

    Résumés

    With the arrival of BERT1 in 2018, NLP research has taken a significant step forward. However, the necessary computing power has grown accordingly. Various distillation and optimization systems have been adopted but are costly in terms of cost-benefit ratio. The most important improvements are obtained by creating increasingly complex models with more layers and parameters.
    In this research, we will see how, by mixing transfer learning, zero-shot learning, and ONNX runtime2, we can access the power of BERT right now, optimizing time and resources, achieving noticeable results on day one.

    Con l'arrivo di BERT nel 2018, la ricerca nel campo dell'NLP ha fatto un notevole passo in avanti. La potenza di calcolo necessaria però è cresciuta di conseguenza. Diversi sistemi di distillazione e di ottimizzazione sono stati adottati ma risultano onerosi in termini di rapporto costo benefici. I vantaggi di maggior rilievo si ottengono creando modelli sempre più complessi con un maggior numero di layers e di parametri.
    In questa ricerca vedremo come mixando transfer learning, zero-shot learning e ONNX runtime si può accedere alla potenza di BERT da subito, ottimizzando tempo e risorse, raggiungendo risultati apprezzabili al day one.

    Note de l’éditeur

    Copyright©2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    Texte intégral 1. Introduction 2. Description of the system 2.1 Task 1 – ATE: Aspect Term Extraction 2.2 Task 2 – ABSA: Aspect-based Sentiment Analysis 2.3 Task 3 – SA: Sentiment Analysis 3. Results 3.1 Results for Task 1 3.2 Results for Task 2 3.3 Results for Task 3 4. Conclusion Bibliographie Notes de bas de page Auteur

    Texte intégral

    1. Introduction

    1In a process with data that change very quickly and the need to resort to complete training in the shortest possible time, transfer learning techniques have made possible a fast fine-tuning of BERT models. The distillation of a model made it possible to decrease the load and the times without significantly losing accuracy. These models, therefore, require, at least, constant fine-tuning training. In addition, a BERT model specially designed for the Italian language and with a vocabulary containing technical terms increases its effectiveness.

    2Constant and multi-disciplinary training requires specific skills and tailor-made services. In this research, we will see an effective way to make both things possible. The idea is to use a way to exchange AI models between library and frameworks, the ONNX project, and a runtime, the ONNX runtime project, to optimize inference for many platforms, languages and hardware. The ONNX runtime is still working to optimize the training directly in the ONNX format.

    3The second goal is to find a viable alternative with acceptable performance at the start of a new project while waiting for a trained BERT model.

    4The research was carried out for the ATE ABSITA (de Mattei et al., 2020) task in the EVALITA 2020 (Basile et al., 2020), using all 3 available sub-tasks.

    2. Description of the system

    5To start using a sentiment analysis system, we need several elements. Certainly, a starting dataset with the related labels. In the tasks of the challenge, we have the reviews of 23 different products. Each review has a corresponding rating assigned by the end-user. For each review, it was required to extract the aspects contained in it. By aspect, we mean every opinion word that expresses a sentiment polarity. Finally, each aspect was classified as a pair of values: positive or negative, for 4 possible states.

    6Imagine a system that receives an unspecified number of reviews in real-time with new products and different categories. We find ourselves in the situation of always having to fine-tune our models.

    7The complexity of BERT makes training time difficult for constant alignment. Being able to reduce the training time, or being able to put in place an alternative in the meantime, new perspectives open up, such as:

    • Made inference calls before a full trained model is completed.

    • Training of the new model.

    • Running the BERT model.

    • (optional) reclassify recent product reviews after the model update.

    8In this perspective, in order to validate my hypotheses, I used the AlBERTo (Polignano at al., 2019) model, used in the baseline, and Ktrain3, a wrapper for TensorFlow4, with the autofit option.

    9The first submission, called ghostwriter19_a, was obtained training all the models with the Ktrain framework.

    10The results for the three tasks for the second submission, called ghostwriter19_b, were obtained in two different way:

    • for the first two tasks, I used the model of the first submission but exported on ONNX and ran with the ONNX runtime.

    • for the third task, I trained the model with TensorFlow using a Zero-Shot learner [ZSL] (Brown et al, 2020).

    11To test the models, I used two different machines with Ubuntu 20.04 LTS:

    • 6 vCPU on Intel Xeon E5-2690 v4 - 112GB with P100 (GPU)

    • 14 cores on Intel Xeon E5-2690 v4 - 32GB (CPU)

    2.1 Task 1 – ATE: Aspect Term Extraction

    12To identify an aspect, the dataset contains a label for every single word with three possible values:

    • B for Begin of an aspect.

    • I for Inside an aspect.

    • Or for Outside, not in an aspect.

    13For example, the review “La borraccia termica svolge egregiamente il proprio compito di mantenere la temperatura, calda o fretta che sia. La costruzione è ottimale e ben rifinita. Acquisto straconsigliato!” is labeled as:

    Figure 1

    Image 10000000000003880000018D4C4E8D736A5F9D7B.jpg

    14The model will be evaluated with the F1-score. The score results from the full matched aspects, the partial matched ones, and the missed ones.

    15The preliminary results with the Ktrain model were encouraging (table 1).

    Table 1: Task 1 DEV results

    Model

    F1-Score

    ghostwriter19_a

    0.6152

    Baseline

    0.2556

    16At this point, the model has been exported with ONNX in maximum compatibility mode. The model ran with the ONNX runtime optimized for CPU.

    17The performances have remained unchanged, but the speed of inference has significantly improved (table 2).

    Table 2: Performance comparison on Task 1

    Model

    Query per second

    ghostwriter19_a CPU

    4

    ghostwriter19_b CPU with ONNX runtime

    68

    ghostwriter19_a GPU

    124

    ghostwriter19_b GPU with ONNX runtime

    217

    18The improvement is 17x for the CPU version and 1.75x for the GPU version.

    2.2 Task 2 – ABSA: Aspect-based Sentiment Analysis

    19For this task, the aspects identified in Task 1 have been used. This implies that an error in Task 1 will have a decisive impact on Task number 2.

    20The aspect can be classified as:

    • positive (POS:true,NEG:false)

    • negative (POS:false,NEG:true)

    • mixed polarity(POS:true, NEG:true)

    • neutral polarity (POS:false, NEG:false)

    21As showed to the image from the challenge website5:

    Figure 1

    Image 10000000000003200000015327FBF01DD2997DAC.jpg

    22The results on the DEV test outperform the baseline (table 3).

    Table 3: Task 2 DEV results

    Model

    F1-Score

    ghostwriter19_a

    0.6019

    Baseline

    0.2

    23Also, for this task, the performance is improved with the use of ONNX runtime (table 4).

    Table 4: Performance comparison on Task 2

    Model

    Query per second

    ghostwriter19_a CPU

    3

    ghostwriter19_b CPU with ONNX runtime

    56

    ghostwriter19_a GPU

    97

    ghostwriter19_b GPU with ONNX runtime

    154

    24The improvement is 9.5x for the CPU version and 1.59x for the GPU version.

    2.3 Task 3 – SA: Sentiment Analysis

    25Task 3 is a classification problem. However, fully understanding the score is not easy. The evaluation operation is carried out by different people and with different styles. A product with a similar review is rated according to the expectations and judgment of other users differently.

    26Furthermore, in order to obviate the long training time that a constant updating requires, compared with systems used by the previous version of EVALITA, such as an ensemble system with Tree Random Forest and Bi-LSTM (Bennici and Portocarrero, 2018) or with an SVM system (Barbieri et al., 2016), I used a Zero-Shot Learner [ZSL] (Pushp & Srivastava, 2017). A ZSL is a way to make predictions without prior training (Petroni, 2019). ZSL will refer to the embedding of a previous matrix, AlBERTo in this case, and of the proposed labels as a possible result (Schick and Schütze, 2020).

    27The proposed labels were the possible numbers for evaluation, then the numbers from 1 to 5.

    28The proposed prediction value is a weighted average of the two values with the highest probability, if and only if the gap between the two values is less than $10^{- 3}$. Otherwise, only the value with the highest probability will be considered valid.

    29For this task, I omitted the ONNX runtime test because a stable converter for the ZSL version is not available.

    30The score for this task is the Root Mean Squared Error between the polarity predicted and the polarity assigned by the user.

    Table 5: Task 3 DEV results

    Model

    RMSE score

    ghostwriter19_a

    0.6997

    ghostwriter19_b

    0.8526

    Baseline AlBERTo

    1.0806

    31The loss in performance is 18%, but the entire previous training phase is skipped (table 5).

    3. Results

    32The results obtained with the DEV dataset are very positive both in terms of accuracy and performance. ZSL has proven to be an incredible technology to invest in. The Ktrain seems to suffer a heavy overfit.

    33The research aims not to have a relevant model but to prove that a model could be production-ready with fewer resources and time.

    34However, in all three tasks, the models outperformed the baseline with a significant gap in terms of accuracy/RMSE.

    3.1 Results for Task 1

    35The final results with the TEST dataset are:

    Table 6: TEST dataset results for Task 1

    Model

    F1 score

    ghostwriter19_a_D

    0.6152

    ghostwriter19_a_T

    0.5399

    Baseline AlBERTo

    0.2556

    36The results are about 12% lower than those obtained in the research phase (table 6).

    37It will be interesting to continue experimenting with different ONNX options to find a better combination of compatibility and performance.

    3.2 Results for Task 2

    38The final results with the TEST dataset are:

    Table 7: TEST dataset results for Task 2

    Model

    F1 score

    ghostwriter19_a_D

    0.6019

    ghostwriter19_b_T

    0.4994

    Baseline AlBERTo

    0.2

    39The loss from DEV to TEST is about 17% (table 7). However, the percentage of the difference between the results of Tasks 1 and 2 have been maintained with the DEV and TEST datasets.

    40This is in line with expectations, worse model performance in Task 1 impacted Task 2 proportionally. In return, working on a better model will improve both tasks.

    3.3 Results for Task 3

    41For Task 3 we have:

    Table 8: TEST dataset results for Task 3

    Model

    RMSE score

    ghostwriter19_a_D

    0.6997

    ghostwriter19_b_D

    0.8526

    ghostwriter19_a_T

    0.81394

    ghostwriter19_b_T

    0.83479

    Baseline AlBERTo

    1.0806

    42The difference between the DEV and TEST datasets is marked here only for trained model, 14% (table 8). The untrained one performed slightly better, 2%, with the TEST dataset.

    43This result confirms that an underperforming model has the same performance of a model that use ZSL, as assumed.

    44The price to pay, however, is that the average inference time for the ZSL is 157x higher than the pure TensorFlow model obtained with Ktrain.

    4. Conclusion

    45The results demonstrated that it is possible to create hybrid systems for training and inference to make the power of BERT more accessible.

    46In the time it takes to train a new and optimized model, an untrained ZSL model can make up for it in the meantime.

    47Optimizing, and in future training, our models to be intrinsically optimized for the platform and framework we have chosen to use does not affect performance and future use.

    48The improvements obtained in the use of ONNX runtime for these Italian tasks are in line with what Microsoft demonstrated, for the English language, at the beginning of 2020 (Ning at al., 2020).

    49The next step is to make the ONNX export work with a Zero-Shot learner [ZSL] in order to compensate, at least in part, for the more significant resources that this inevitably introduces.

    Bibliographie

    Barbieri, F., Basile, V., Croce, D., Nissim, M., Novielli, N., & Patti, V. (2016). Overview of the Evalita 2016 SENTIment POLarity Classification Task. In Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) & Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016). CEUR-WS.org.

    Basile, V., Croce, D., Di Maro, M., & Passaro, L. (2020). EVALITA 2020: Overview of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. In Proceedings of Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020), CEUR-WS.org.

    Bennici, M., & Portocarrero, X. S. (2018). Ensemble for aspect-based sentiment analysis. In Tommaso Caselli, Nicole Novielli, Viviana Patti, and Paolo Rosso, editors, Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18). CEUR-WS.org.

    Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., . . . Amodei, D. (2020, July 22). Language Models are Few-Shot Learners. https://arxiv.org/abs/2005.14165

    de Mattei, L., de Martino, G., Iovine, A., Miaschi, A., Polignano, M., & Rambelli, G. (2020). Overview of the EVALITA 2020 Aspect Term Extraction and Aspect-based Sentiment Analysis (ATE_ABSITA) Task. In Proceedings of the 7th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA 2020), CEUR-WS.org.

    Ning, E., Yan, N., Zhu, J., & Li, J. (2020, January 31). Microsoft open sources breakthrough optimizations for transformer inference on GPU and CPU. https://cloudblogs.microsoft.com/opensource/2020/01/21/microsoft-onnx-open-source-optimizations-transformer-inference-gpu-cpu/

    Polignano, M., Basile, P., de Gemmis, M., Semeraro, G., & Basile, V. (2019). Alberto: Italian bert language understanding model for nlp challenging tasks based on tweets. In Proceedings of the Sixth Italian Conference on Computational Linguistics (CLiC-it 2019). CEUR-WS.org.

    Petroni, F., Rocktäschel, T., Lewis, P., Bakhtin, A., Wu, Y., Miller, A. H., & Riedel, S. (2019, September 04). Language Models as Knowledge Bases? https://arxiv.org/abs/1909.01066

    Pushp, P. K., & Srivastava, M. M. (2017, December 23). Train Once, Test Anywhere: Zero-Shot Learning for Text Classification. https://arxiv.org/abs/1712.05972

    Schick, T., & Schütze, H. (2020, April 27). Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference. https://arxiv.org/abs/2001.07676

    Notes de bas de page

    1 https://github.com/google-research/bert

    2 https://microsoft.github.io/onnxruntime/

    3 https://github.com/amaiya/ktrain

    4 http://www.tensorflow.org/

    5 http://www.di.uniba.it/~swap/ate_absita/task.html

    Auteur

    • Mauro Bennici

      You Are My Guide, Torino – mauro@youaremyguide.com

    Précédent Suivant
    Table des matières

    Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0

    Le texte seul est utilisable sous licence Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    Ensemble of LSTMs for EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)

    Mauro Bennici et Xileny Seijas Portocarrero

    The validity of word vectors over the time for the EVALITA 2018 Emoji prediction task (ITAmoji)

    Mauro Bennici et Xileny Seijas Portocarrero

    ghostwriter19 @ SardiStance: Generating new tweets to classify SardiStance EVALITA 2020 political tweets

    Mauro Bennici

    Voir plus de chapitres
    1 / 3

    Ensemble of LSTMs for EVALITA 2018 Aspect-based Sentiment Analysis task (ABSITA)

    Mauro Bennici et Xileny Seijas Portocarrero

    The validity of word vectors over the time for the EVALITA 2018 Emoji prediction task (ITAmoji)

    Mauro Bennici et Xileny Seijas Portocarrero

    ghostwriter19 @ SardiStance: Generating new tweets to classify SardiStance EVALITA 2020 political tweets

    Mauro Bennici

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 https://github.com/google-research/bert

    2 https://microsoft.github.io/onnxruntime/

    3 https://github.com/amaiya/ktrain

    4 http://www.tensorflow.org/

    5 http://www.di.uniba.it/~swap/ate_absita/task.html

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    X Facebook Email

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Bennici, M. (2020). ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to speed up BERT on sentiment analysis tasks at EVALITA 2020. In V. Basile, D. Croce, M. Maro, & L. C. Passaro (éds.), EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.6889
    Bennici, Mauro. « ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to Speed up BERT on Sentiment Analysis Tasks at EVALITA 2020 ». In EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020, édité par Valerio Basile, Danilo Croce, Maria Maro, et Lucia C. Passaro. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.6889.
    Bennici, Mauro. « ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to Speed up BERT on Sentiment Analysis Tasks at EVALITA 2020 ». EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020, édité par Valerio Basile et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.6889.

    Référence numérique du livre

    Format

    Basile, V., Croce, D., Maro, M., & Passaro, L. C. (éds.). (2020). EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.6732
    Basile, Valerio, Danilo Croce, Maria Maro, et Lucia C. Passaro, éd. EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.6732.
    Basile, Valerio, et al., éditeurs. EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.6732.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement