• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16263 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16263 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • Proceedings of the Eighth Italian Confer...
  • ›
  • Contributed Papers: Long Papers
  • ›
  • Playing with NeMo for Building an Automa...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 2. Italian Spoken Corpora for ASR 3. State of the Art for Italian ASR 4. NVIDIA NeMo ASR 5. Model Setup and Results 6. Conclusions Bibliographie Notes de bas de page Auteur

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    Playing with NeMo for Building an Automatic Speech Recogniser for Italian

    Fabio Tamburini

    p. 321-327

    Résumé

    This paper presents work in progress for the creation of a Large Vocabulary Automatic Speech Recogniser for Italian using NVIDIA NeMo. Thanks to this package, we were able to build a reliable recogniser for adults’ speech by fine tuning the English model provided by NVIDIA and rescoring it with powerful neural language models, obtaining very good performances. The lack of a standard, reliable and publicy available baseline for Italian motivated this work.

    Remerciements

    We acknowledge the CINECA1 award no. HP10C7XVUO (project QT4CLML) under the ISCRA initiative, for the availability of HPC resources and support.

    Texte intégral Bibliographie Notes de bas de page Auteur

    Texte intégral

    1. Introduction

    1The advent of the “Deep Learning Revolution” introduced astonishing changes also in the field of speech processing allowing for the development of brand new tools and devices able to recognise and synthesise speech exhibiting performances never seen before. It is sufficient to think to the new virtual assistants that populates our houses and mobile phones for getting an immediate idea about the improvements in this research field.

    2Most big IT companies developed, in the past 3/4 years, solutions well integrated with various devices that include high performance tools for speech processing. However, these solutions very often are not released freely, sometimes they require registrations and fees and, in the best situations, codes are free, but the models for a specific language are not available. A notable exception regards NVIDIA NeMo2, a conversational AI toolkit built for researchers working on Automatic Speech Recognition (ASR), Natural Language Processing (NLP), and Text-To-Speech synthesis (TTS). The primary objective of NeMo is to help researchers from industry and academia to reuse prior work, namely code and pretrained models for various languages, and make it easier to create new conversational AI models, maybe adapting tools and models to specific languages or particular domains.

    3This paper reports an attempt to build a high performance Large Vocabulary ASR system for Italian adults’ speech by exploiting all the features available in NeMo and most of the largest Italian spoken corpora available to the community.

    4Section 2 describes the various speech datasets used for developing the model, followed by Section 3 that describes the state of the art; in Section 4 we will describe the NeMo ASR model used in the experiments and Section 5 will discuss the experiments and the obtained results. Section 6 draws some provisional conclusions about our work.

    2. Italian Spoken Corpora for ASR

    5This section describes the datasets we used for the creation of the Italian ASR model. We have to say that, of course, these are not the only spoken corpora available, but they are the biggest corpora commonly used for setting up an ASR system for Italian. They are typically very big, already organised and structured exactly for training ASR systems or specifically designed to maximise their impact and usefulness for ASR. We have also to say that, as far as we know, this is the first attempt to use all of them for ASR training in a single project.

    2.1 Mozilla Common Voice (v7.0)

    6Common Voice (Ardila et al. 2020) is a crowdsourcing project started by Mozilla to create a free database for setting up speech recognition software. The project is supported by volunteers who record sample sentences with a microphone and review recordings of other users. The transcribed utterances will be collected in a voice database available under the public domain license CC0. This license ensures that developers can use the database for voice-to-text applications without restrictions or costs.

    7With regard to the Italian subcorpus, they currently3 released version 7.0 (MCV7), containing 6,407 speakers for a total of 160,570 utterances with the correct transcriptions. In the standard splitting provided with the dataset the training set contains 131,041 utterances corresponding to 189.50 hours of speech, the validation set 14,764 utterances for 24.41 hours and the test set 14,765 utterances corresponding to 25.74 hours.

    8These splitting are very important for our experiments, as discussed in Section 5.

    2.2 Multilingual LibriSpeech

    9Multilingual LibriSpeech4 (MLS) dataset (Pratap et al. 2020) is a large multilingual corpus suitable for speech research. The dataset is derived from read audiobooks from LibriVox and consists of 8 languages - English, German, Dutch, Spanish, French, Italian, Portuguese and Polish. The Italian section contains 42,935 utterances for a total of 160.06 hours of transcribed speech.

    2.3 VoxForge

    10VoxForge5 is an open speech dataset that was set up to collect transcribed speech for use with Free and Open Source Speech Recognition Engines. The Italian portion of VoxForge contains 10,633 utterances totalling 20.16 hours of transcribed speech.

    2.4 APASCI

    11APASCI (Angelini et al. 1994) is an Italian speech database recorded in an insulated room with a Sennheiser MKH 416 T microphone. The speech material, consisting of 2,170 utterances with a wide phonetic/diphonic coverage and totalling 2.91 hours of speech, was read by 100 Italian speakers (50 male and 50 female). The database includes the transcription of each utterance both at phonemic and at orthographic levels. This database in the past allowed to design, train and evaluate continuous speech recognition systems (speaker independent, speaker adaptive, speaker dependent, multispeakers). It was also designed for research on acoustic modelling as well as on acoustic parameters for speech recognition and for research on speaker recognition.

    3. State of the Art for Italian ASR

    12In order to properly describe the state of the art, we should first define the typical metrics used for evaluating ASR systems. Given the system transcription for an utterance and the correct transcription extracted from the gold standard, the most important metric is certainly the Word Error Rate (WER) defined as

    Image 10000000000001980000002B191C8F62FE2E4B66.jpg

    typically expressed in percentage. It compares the two transcriptions counting all the differences at word level using the edit distance between them. We can also define the Phone Error Rate (PER) and the Character Error Rate (CER) that use the same principle but applied, respectively, at phone or character level.

    13Examining the literature for the construction of ASR models for Italian we immediately recognise a lack of works devoted to the building of a general Large Vocabulary ASR for adults’ speech. The only work we found on that was presented by Cosi and Hosom (2000), used a rather old approach to the problem (a hybrid HMM/ANN architecture) and measures the performance only on phones and not on words. Using PER instead the most common WER is a common trait of all the subsequent works we found in literature (Cosi and Pellom 2005; Cosi 2008, 2015; Cosi et al. 2014) that applied a lot of different system architectures only on child speech. This large bundle of works represent the main line of research for building Italian ASR systems, but the aim of these studies is completely different from ours and, moreover, their results are not directly comparable with ours.

    14An exception to what we said before is represented by the work of Gretter (2014): he first built a large multilingual benchmark corpus, extracting data from the portal Euronews, consisting of about 100 hours of adults’ speech for each language and, second, he developed also some ASR baselines, based on triphone Hidden Markov Models and n-gram Language models, obtaining on Italian a word recognition accuracy of 83.5% leading to a WER=16.5%, a quite remarkable result obtained using non-neural stochastic systems.

    15More recent studies employing neural models were able to build other quite reliable systems. Weibin (2019) trained a system based on DeepSpeech (Hannun et al. 2014) using VoxForge, CLIPS6, SI-CALLIOPE (Tedesco, Cenceschi, and Sbattella 2018), LibriVox Audiobooks7 and Mozilla Common Voice corpora for a total of 438 hours of speech, obtaining a WER=13.8% on a mixed test set. Pratap et al. (2020) made some experiments using wav2letter++8 followed by a 5gram rescoring obtaining a test WER=28.19%. They used different test sets w.r.t. the one used in this work, thus they can only provide some general indications about WER, but they are not directly comparable to our work.

    4. NVIDIA NeMo ASR

    16Traditional speech recognition takes a generative approach, modelling the recognition process of speech sounds acoustics (O) as Image 10000000000000DA0000001EA8B4CFE1F9A72E1B.jpg where W is a possible transcription as sequence of words. The actors of the game include a language model P(W) that allows to estimate the most likely orderings of words in a given language (e.g. an n-gram model), a pronunciation model for each word in that sequence (e.g. a lexicon of phonetically transcribed words) and an acoustic model P(O|W) that allows to estimate the probability of an input sequence of acoustic observations given each possible words sequence W. When we receive some spoken input, our goal would be to find the most likely sequence of text that maximises the words probability given a speech-acoustic input.

    17Over time, neural nets advanced to the point where each component of the traditional speech recognition model could be replaced by a neural model that had better performance and that had a greater potential for generalisation. For example, we could replace an n-gram model with a neural language model, and replace a pronunciation table with a neural pronunciation model, and so on. However, each of these neural models need to be trained individually on different tasks, and errors in any model in the pipeline could throw off the whole prediction.

    18Nowadays, end-to-end ASR discriminative architectures models that simply take a sequence of audio inputs and give a sequence of textual outputs, and in which all components of the architecture are trained jointly towards the same goal, largely dominate the field. The model’s encoder would be akin to an acoustic model for extracting speech features, which can then be directly piped to a decoder which directly outputs text, as a sequence of characters, in a given language. If desired, we could still integrate a language model that would improve our predictions, piping it after the decoder9.

    19Grasping information from NeMo github site10, we learn that the base ASR model provided by NVIDIA is Jasper ("Just Another Speech Recognizer") (Li et al. 2019) a deep Time Delay Neural Network comprising of blocks of 1D-convolutional layers. The Jasper family of models are denoted as “Jasper_[BxR]” where B is the number of blocks and R is the number of convolutional sub-blocks within a block. Each sub-block contains a 1-D convolution, batch normalisation, ReLU, and dropout.

    20Most state-of-the-art ASR models are extremely large; they tend to have on the order of a few hundred million parameters. This makes them hard to deploy on a large scale given current limitations of devices on the edge. Another model is included into NeMo, QuartzNet (Kriman et al. 2020), a version of Jasper with separable convolutions and larger filters. It can achieve performance similar to Jasper but with an order of magnitude fewer parameters. Similarly to Jasper, the QuartzNet family of models are denoted as “QuartzNet_[BxR]”, where B is the number of blocks and R is the number of convolutional sub-blocks within a block, and do not use the computationally costly recurrent layers in favour of more efficient convolutional layers. Each sub-block contains a 1-D separable convolution, batch normalisation, ReLU, and dropout (see Figure 1 for a complete diagram describing the QuartzNet internal structure). Both models described before optimise the Connectionist Temporal Classification (CTC) loss.

    Figure 1: NVIDIA NeMo QuartzNet model

    Image 10000201000005D70000071E246041E63699623E.png

    21NVIDIA provided also a large number of pretrained models11 for various languages. The two models for English “STT_en_Quartznet15x5” and Italian “STT_it_Quartznet15x5” (both at version 1.0.0rc1 published the 30th June 2021) are relevant for our work. The Quartznet 15x5 model family consists of 79 layers and has a total of 18.9 million parameters, with five blocks that repeat fifteen times plus four additional convolutional layers.

    22QuartzNet15x5 Encoder and Decoder English neural module’s checkpoints from NVIDIA were trained using Multilingual LibriSpeech and Mozilla’s English Common Voice 6.1 "validated" set (a huge amount of data containing more than 3,300 hours of speech) with two types of data augmentation techniques: speed perturbation and Cutout. Speed perturbation means that additional training samples were created by slowing down or speeding up the original audio data by 10%. Cutout refers to randomly masking out small rectangles out of the spectrogram input as a regularization technique. NVIDIA’s Apex/Amp O1 optimization level was used for training achieveing 4.19% WER on LibriSpeech test-clean.

    23NeMo documentation also describes a procedure for fine-tuning the English model to adapt it to other languages, keeping the acoustic encoder frozen and fine-tuning the decoder for producing transcriptions for a different language (Huang et al. 2020). In the cited paper they also get the relevant conclusion that it is much better, in terms of performance, to fine-tune the English model than to retrain from scratch a new model for a specific language. The Italian model provided by NVIDIA has been produced following the suggested procedure, in particular by retraining the QuartzNet decoder using the training portion of MCV version 6.1. We will consider this Italian model as a baseline for our experiments.

    5. Model Setup and Results

    24The STT_it QuartzNet model provided by NVIDIA was trained using a reduced set of data and applying an output dictionary that includes some characters that do not belong to the Italian alphabet. For these reasons we preferred to restart the fine-tuning process directly from the original STT_en_Quartznet15x5 English model.

    25The training set we used to fine tune the NVIDIA STT_en model to Italian is composed by joining the training portion of MCV7 and all files from MLS, VoxForge and APASCI, and contains 186,778 utterances/speech files totalling 372.62 hours of transcribed speech. 19,199 utterance/files were filtered out from the training set totalling 97.77 hours of removed speech. This is due to the fact that in some dataset, mainly in MLS and VoxForge, there were some utterances longer than 16.7 seconds, a time limit hard coded into NeMo in order to keep the model computationally tractable. We checked also that transcriptions contain only the 34 standard characters from the Italian alphabet (26 lowercase letters plus six accented characters, the apostrophe and the space) as it is a standard practice in ASR to lowercase transcriptions and to remove any punctuation mark not strictly useful or relevant to help the recognition.

    26With regard to decoding and rescoring, NeMo offers various possibilities:

    • Greedy Decoding. This method simply computes the most likely sequence of characters, also called as the “best-path decoder”, given the audio input.

    • Beam Search Decoding. Beam Search Decoding (BSD) is another way of decoding model prediction that leads to better results than the greedy search. BSD, instead of choosing always the best prediction at each step, considers the top-K hypothesis having the highest probabilities, where K is the so called beam size. For all the subsequent experiments we used beam_size=1024, beam_alpha=1.0 and beam_beta=0.5 (see NeMo documentation).

    27Language Models (LM) have shown to help the accuracy of ASR models when combined to BSD. NeMo currently supports the following two approaches to incorporate language models into the ASR models through BSD:

    • N-gram Rescoring. In this approach, an N-gram Language Model is trained on text data, then it is used in fusion with beam search decoding to find the best candidates. The beam search decoders in NeMo support language models trained with the KenLM library (Heafield et al. 2013). We used this library code for building a 3-gram and a 6-gram LM using the 165-million-token-version of the CORIS corpus12 (Rossini Favretti, Tamburini, and De Santis 2002) specially cleaned and prepared for this task.

    • Neural Rescoring. In the neural rescoring approach a neural network is used to give scores to a candidate text transcript predicted by the decoder of the ASR model. The top K candidates produced by the beam search decoding are given to a neural language model to rank them. This score is usually combined with the scores from the beam search decoding to produce the final scores and rankings. NeMo neural LMs are based on the Transformer sequence-to-sequence architecture like those described in (Vaswani et al. 2017). Again, we used the CORIS corpus described above to train an Italian neural LM from scratch and, after a month of training, we reached a perplexity of 29.30.

    28Given such possibilities, we fine tuned the STT_en model on a single V100 GPU using our joined dataset described above and the MCV7 validation and test set respectively for early stopping the training process and to evaluate all models. The hyperparameters we modified w.r.t. the original English model, and contained in the model itself, are listed in Table 1.

    Table 1: Hyperparametrs modified during the fine-tuning process w.r.t. the STT_en_Quartznet15x5 model.

    Par.

    Value

    train_ds.batch_size

    96

    validation_ds.batch_size

    4

    optim.lr

    0.0012

    optim.betas

    [0.8,0.5]

    optim.weight_decay

    0.001

    optim.warmup_steps

    500

    optim.sched.min_lr

    1e-10

    trainer.precision

    16

    trainer.amp_level

    O1

    29As notable exception to the NVIDIA suggested procedure for fine tuning a model, we have to report that we obtained the best results by unfreezing the encoder and letting it to slightly adapt the extracted speech features to the new language, namely Italian, that certainly share most of the sounds with the starting English model STT_en, but contains also specific sounds (e.g. and ) that may require small adaptations.

    30Table 2 outlines our results after a complete fine tuning of the end-to-end ASR model using the Italian dataset described before and applying different decoding and rescoring schemas. The improvement obtained with the fine-tuning process, when compared to the original model delivered by NVIDIA is relevant, but not so big, while when applying the BSD with the two rescoring algorithms the WER metric improve of 40% w.r.t. the greedy decoding schema.

    Table 2: WER/CER results (in percentage) on Mozilla Common Voice v7.0 (MCV7) validation and test sets.

    System

    Valid.

    Test

    Baseline (NVIDIA STT_it)

    Greedy Decoding

    15.64/4.00

    16.90/4.46

    BSD & 3-gram Resc.

    10.79/3.18

    11.59/3.54

    BSD & 6-gram Resc.

    10.77/3.17

    11.57/3.53

    BSD & Neural Resc.

    9.54/  -   

    10.51/  -     

    NVIDIA STT_en + Our Retraining

    Greedy Decoding

    14.86/3.78

    15.82/4.14

    BSD & 3-gram Resc.

    10.41/2.97

    10.96/3.27

    BSD & 6-gram Resc.

    10.36/2.95

    10.94/3.26

    BSD & Neural Resc.

    9.04/  -   

    9.67/  -   

    6. Conclusions

    31This paper presented work in progress for the construction of a reliable and performing ASR system for Italian adults’ speech. Thanks to the NVIDIA NeMo package, we were able to produce a very strong baseline reaching a WER = 9.67% over the MCV7 test set.

    32This is only the beginning of our work, as any change in the kind of speech used to train the system could degrade the whole performance, but, having used a collection of four different datasets containing thousands of different speakers and speech utterances for setting up such ASR system, we believe that the result should be robust enough. Unfortunately, the lack of a standardised benchmark for Italian does not allow for a quantitative and objective evaluation of this statement.

    33End-to-end character ASR model, and its improvement on WER, is only part of the game: the work on decoding and rescoring procedures produced much more improvements. Thus, the most important “take home lesson” is certainly to focus on the development of high performance LM specifically tuned for ASR.

    34All the models presented in this paper as well as the scripts and additional codes for using NeMo and generating the results will be made available13.

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    3rd International Conference on Spoken Language Processing (ICSLP 1994). (1994). Presented at the 3rd International Conference on Spoken Language Processing (ICSLP 1994). https://doi.org/10.21437/icslp.1994
    Cosi, P. (2015). A KALDI-DNN-based ASR system for Italian. Presented at the 2015 International Joint Conference on Neural Networks (IJCNN). https://doi.org/10.1109/ijcnn.2015.7280336
    6th International Conference on Spoken Language Processing (ICSLP 2000). (2000). Presented at the 6th International Conference on Spoken Language Processing (ICSLP 2000). https://doi.org/10.21437/icslp.2000
    Interspeech 2005. (2005). Presented at the Interspeech 2005. https://doi.org/10.21437/interspeech.2005
    Interspeech 2014. (2014). Presented at the Interspeech 2014. https://doi.org/10.21437/interspeech.2014
    ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). (2020). Presented at the ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp40776.2020
    Interspeech 2019. (2019). Presented at the Interspeech 2019. https://doi.org/10.21437/interspeech.2019
    Interspeech 2020. (2020). Presented at the Interspeech 2020. https://doi.org/10.21437/interspeech.2020
    “3rd International Conference on Spoken Language Processing (ICSLP 1994)”. []. ISCA, 1994. doi:10.21437/icslp.1994.
    Cosi, Piero. “A KALDI-DNN-Based ASR System for Italian”. 2015 International Joint Conference on Neural Networks (IJCNN). IEEE, July 2015. doi:10.1109/ijcnn.2015.7280336.
    “6th International Conference on Spoken Language Processing (ICSLP 2000)”. []. ISCA, 2000. doi:10.21437/icslp.2000.
    “Interspeech 2005”. []. ISCA, 2005. doi:10.21437/interspeech.2005.
    “Interspeech 2014”. []. ISCA, 2014. doi:10.21437/interspeech.2014.
    “ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)”. []. IEEE, 2020. doi:10.1109/icassp40776.2020.
    “Interspeech 2019”. []. ISCA, 2019. doi:10.21437/interspeech.2019.
    “Interspeech 2020”. []. ISCA, 2020. doi:10.21437/interspeech.2020.
    3rd International Conference on Spoken Language Processing (ICSLP 1994). [], ISCA, 1994. Crossref, https://doi.org/10.21437/icslp.1994.
    Cosi, Piero. “A KALDI-DNN-Based ASR System for Italian”. 2015 International Joint Conference on Neural Networks (IJCNN), IEEE, July 2015. Crossref, https://doi.org/10.1109/ijcnn.2015.7280336.
    6th International Conference on Spoken Language Processing (ICSLP 2000). [], ISCA, 2000. Crossref, https://doi.org/10.21437/icslp.2000.
    Interspeech 2005. [], ISCA, 2005. Crossref, https://doi.org/10.21437/interspeech.2005.
    Interspeech 2014. [], ISCA, 2014. Crossref, https://doi.org/10.21437/interspeech.2014.
    ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). [], IEEE, 2020. Crossref, https://doi.org/10.1109/icassp40776.2020.
    Interspeech 2019. [], ISCA, 2019. Crossref, https://doi.org/10.21437/interspeech.2019.
    Interspeech 2020. [], ISCA, 2020. Crossref, https://doi.org/10.21437/interspeech.2020.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    B. Angelini, F. Brugnara, D. Falavigna, D. Giuliani, R. Gretter, and M. Omologo. 1994. “Speaker Independent Continuous Speech Recognition Using an Acoustic-Phonetic Italian Corpus.” In Proc. of the 3rd International Conference on Spoken Language Processing - ICSLP ’94, 1391–4. Yokohama, Japan.

    10.21437/ICSLP.1994 :

    R. Ardila, M. Branson, K. Davis, M. Kohler, J. Meyer, M. Henretty, R. Morais, L. Saunders, F. Tyers, and G. Weber. 2020. “Common Voice: A Massively-Multilingual Speech Corpus.” In Proc. Of the 12th Language Resources and Evaluation Conference, 4218–22. Marseille, France: European Language Resources Association.

    P. Cosi. 2008. “Recent Advances in Sonic Italian Children’s Speech Recognition for Interactive Literacy Tutors.” In Proc. 1st Workshop on Child, Computer and Interaction (Wocci ’08). Chania, Crete, Greece.

    P. Cosi. 2015. “A Kaldi-Dnn-Based Asr System for Italian.” In Proc. 2015 International Joint Conference on Neural Networks (Ijcnn), 1–5.

    10.1109/IJCNN.2015.7280336 :

    P. Cosi, and J. P. Hosom. 2000. “High Performance ‘General Purpose’ Phonetic Recognition for Italian.” In Sixth International Conference on Spoken Language Processing, ICSLP 2000/Interspeech 2000, Beijing, China, October 16-20, 2000, 527–30. ISCA.

    10.21437/ICSLP.2000 :

    P. Cosi, M. Nicolao, G. Paci, G. Sommavilla, and T. Tesser. 2014. “Comparing open source ASR toolkits on Italian children speech.” In Proc. 4th Workshop on Child Computer Interaction (Wocci 2014).

    P. Cosi, and B. L. Pellom. 2005. “Italian children’s speech recognition for advanced interactive literacy tutors.” In Proc. Interspeech 2005, 2201–4.

    10.21437/Interspeech.2005 :

    R. Gretter. 2014. “Euronews: A Multilingual Benchmark for ASR and LID.” In Proc. Of the 15th Annual Conference of the International Speech Communication Association - INTERSPEECH 2014, 1603–7. Singapore: ISCA.

    10.21437/Interspeech.2014 :

    A. Y. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger, et al. 2014. “Deep Speech: Scaling up End-to-End Speech Recognition.” CoRR abs/1412.5567.

    K. Heafield, I. Pouzyrevsky, J. H. Clark, and P. Koehn. 2013. “Scalable Modified Kneser-Ney Language Model Estimation.” In Proc. Of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 690–96. Sofia, Bulgaria: Association for Computational Linguistics.

    J. Huang, O. Kuchaiev, P. O’Neill, V. Lavrukhin, J. Li, A. Flores, G. Kucsko, and B. Ginsburg. 2020. “Cross-Language Transfer Learning, Continuous Learning, and Domain Adaptation for End-to-End Automatic Speech Recognition.” CoRR abs/2005.04290.

    S. Kriman, S. Beliaev, B. Ginsburg, J. Huang, O. Kuchaiev, V. Lavrukhin, R. Leary, J. Li, and Y. Zhang. 2020. “Quartznet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions.” In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (Icassp 2020), 6124–8.

    10.1109/ICASSP40776.2020 :

    J. Li, V. Lavrukhin, B. Ginsburg, R. Leary, O. Kuchaiev, J. M. M. Cohen, H. Nguyen, and R. T. Gadde. 2019. “Jasper: An End-to-End Convolutional Neural Acoustic Model.” In Proc. Interspeech 2019, 71–75.

    10.21437/Interspeech.2019 :

    V. Pratap, Q. Xu, A. Sriram, G. Synnaeve, and R. Collobert. 2020. “MLS: A Large-Scale Multilingual Dataset for Speech Research.” In Proc. Of , 21st Annual Conference of the International Speech Communication Association (Interspeech 2020), 2757–61. Shanghai, China.

    10.21437/Interspeech.2020 :

    R. Rossini Favretti, F. Tamburini, and C. De Santis. 2002. “CORIS/CODIS: A corpus of written Italian based on a defined and a dynamic model.” In A Rainbow of Corpora: Corpus Linguistics and the Languages of the World, edited by A. Wilson, P. Rayson, and T. McEnery, 27–38. Lincom-Europa, Munich.

    R. Tedesco, S. Cenceschi, and L. Sbattella. 2018. “Verso Il Riconoscimento Automatico Della Prosodia.” In Proc. AISV 2018, 433–39.

    A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L Kaiser, and I. Polosukhin. 2017. “Attention Is All You Need.” In Proceedings of the 31st International Conference on Neural Information Processing Systems - Nips’17, 6000–6010. Red Hook, NY, USA: Curran Associates Inc.

    C. Weibin. 2019. Phoenix: Deep Speech Based Automatic Speech Recognition System for Italian Language. Master Thesis, Politecnico di Milano.

    Notes de bas de page

    1 https://www.cineca.it/en

    2 Other exceptions providing also multilingual models including Italian are Facebook Wav2Vec and SpeechBrain.

    3 July 2021.

    4 http://www.openslr.org/94/

    5 http://www.voxforge.org/

    6 http://www.clips.unina.it

    7 https://librivox.org/

    8 https://github.com/flashlight/wav2letter

    9 Partially taken from, https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/main/asr/intro.html

    10 https://github.com/NVIDIA/NeMo

    11 https://ngc.nvidia.com/catalog/collections/nvidia:nemo_asr

    12 Corresponding to the 2021 brand new update.

    13 https://github.com/ftamburin/ItaNeMoASR

    Auteur

    • Fabio Tamburini

      FICLIT - University of Bologna, Italy – fabio.tamburini@unibo.it

    Précédent Suivant
    Table des matières

    Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0

    Le texte seul est utilisable sous licence Creative Commons - Attribution - Pas d'Utilisation Commerciale - Pas de Modification 4.0 International - CC BY-NC-ND 4.0. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    (Better than) State-of-the-Art PoS-tagging for Italian Texts

    Fabio Tamburini

    How “BERTology" Changed the State-of-the-Art also for Italian NLP

    Fabio Tamburini

    A BiLSTM-CRF PoS-tagger for Italian tweets using morphological information

    Fabio Tamburini

    UniBO @ KIPoS: Fine-tuning the Italian “BERTology" for PoS-tagging Spoken Data

    Fabio Tamburini

    (Almost) Automatic Conversion of the Venice Italian Treebank into the Merged Italian Dependency Treebank Format

    Linda Alfieri et Fabio Tamburini

    A new Pitch Tracking Smoother based on Deep Neural Networks

    Michele Ferro et Fabio Tamburini

    Parsing Italian texts together is better than parsing them alone!

    Oronzo Antonelli et Fabio Tamburini

    Overview of the EVALITA 2016

    Part Of Speech on TWitter for ITAlian Task

    Cristina Bosco, Fabio Tamburini, Andrea Bolioli et al.

    Implementing a Pragmatically Adequate Chatbot in DialogFlow CX

    Anna Dall’Acqua et Fabio Tamburini

    Preface

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini

    Automatic Induction of FrameNet Lexical Units in Italian

    Silvia Brambilla, Danilo Croce, Fabio Tamburini et al.

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    Voir plus de chapitres
    1 / 12

    (Better than) State-of-the-Art PoS-tagging for Italian Texts

    Fabio Tamburini

    How “BERTology" Changed the State-of-the-Art also for Italian NLP

    Fabio Tamburini

    A BiLSTM-CRF PoS-tagger for Italian tweets using morphological information

    Fabio Tamburini

    UniBO @ KIPoS: Fine-tuning the Italian “BERTology" for PoS-tagging Spoken Data

    Fabio Tamburini

    (Almost) Automatic Conversion of the Venice Italian Treebank into the Merged Italian Dependency Treebank Format

    Linda Alfieri et Fabio Tamburini

    A new Pitch Tracking Smoother based on Deep Neural Networks

    Michele Ferro et Fabio Tamburini

    Parsing Italian texts together is better than parsing them alone!

    Oronzo Antonelli et Fabio Tamburini

    Overview of the EVALITA 2016

    Part Of Speech on TWitter for ITAlian Task

    Cristina Bosco, Fabio Tamburini, Andrea Bolioli et al.

    Implementing a Pragmatically Adequate Chatbot in DialogFlow CX

    Anna Dall’Acqua et Fabio Tamburini

    Preface

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini

    Automatic Induction of FrameNet Lexical Units in Italian

    Silvia Brambilla, Danilo Croce, Fabio Tamburini et al.

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 https://www.cineca.it/en

    2 Other exceptions providing also multilingual models including Italian are Facebook Wav2Vec and SpeechBrain.

    3 July 2021.

    4 http://www.openslr.org/94/

    5 http://www.voxforge.org/

    6 http://www.clips.unina.it

    7 https://librivox.org/

    8 https://github.com/flashlight/wav2letter

    9 Partially taken from, https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/main/asr/intro.html

    10 https://github.com/NVIDIA/NeMo

    11 https://ngc.nvidia.com/catalog/collections/nvidia:nemo_asr

    12 Corresponding to the 2021 brand new update.

    13 https://github.com/ftamburin/ItaNeMoASR

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    X Facebook Email

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Tamburini, F. (2022). Playing with NeMo for Building an Automatic Speech Recogniser for Italian. In E. Fersini, M. Passarotti, & V. Patti (éds.), Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.10859
    Tamburini, Fabio. « Playing With NeMo for Building an Automatic Speech Recogniser for Italian ». In Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-It 2021, édité par Elisabetta Fersini, Marco Passarotti, et Viviana Patti. Torino: Accademia University Press, 2022. doi:10.4000/books.aaccademia.10859.
    Tamburini, Fabio. « Playing With NeMo for Building an Automatic Speech Recogniser for Italian ». Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-It 2021, édité par Elisabetta Fersini et al., Accademia University Press, 2022, https://doi.org/10.4000/books.aaccademia.10859.

    Référence numérique du livre

    Format

    Fersini, E., Passarotti, M., & Patti, V. (éds.). (2022). Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.10417
    Fersini, Elisabetta, Marco Passarotti, et Viviana Patti, éd. Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-It 2021. Torino: Accademia University Press, 2022. doi:10.4000/books.aaccademia.10417.
    Fersini, Elisabetta, et al., éditeurs. Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-It 2021. Accademia University Press, 2022, https://doi.org/10.4000/books.aaccademia.10417.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement