• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16095 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16095 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • Proceedings of the Seventh Italian Confe...
  • ›
  • Contributed Papers
  • ›
  • Monitoring Social Media to Identify Envi...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 2. Related Work 3. The UNIOR Eye Corpus 4. Case Study 5. Results 6. Conclusions and Future Work Bibliographie Notes de bas de page Auteurs

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study

    Raffaele Manna, Antonio Pascucci, Wanda Punzi Zarino, Vincenzo Simoniello et Johanna Monti

    p. 265-271

    Résumé

    This paper presents the results of research carried out on the UNIOR Eye corpus, a corpus which has been built by downloading tweets related to environmental crimes. The corpus is made up of 228,412 tweets organized into four different subsections, each one concerning a specific environmental crime. For the current study we focused on the subsection of waste crimes, composed of 86,206 tweets which were tagged according to the two labels alert and no alert. The aim is to build a model able to detect which class a tweet belongs to.1

    Remerciements

    This research has been carried out within the framework of two Innovative Industrial PhD projects supported by the PON Ricerca e Innovazione 2014/20 and the POR Campania FSE 2014/2020 funds and two research grants supported by the PON Ricerca e Innovazione 2014/20 in the context of the C4E project.
    Authorship contribution is as follows: Raffaele Manna is author of section 4. Section 2 is by Antonio Pascucci. Section 5 is by Raffaele Manna and Antonio Pascucci. Sections 1, 3 and 6 are by Wanda Punzi Zarino and Vincenzo Simoniello. We are grateful to Prof. Johanna Monti for supervising the research.

    Texte intégral Bibliographie Notes de bas de page Auteurs

    Texte intégral

    1. Introduction

    1In the current era, social media represent the most common means of communication, especially thanks to the speed with which a post can go viral and reach in no time every corner of the globe. The speed with which information is produced creates an abundance of (linguistic) data, which can be monitored and handled with the use of hashtags (#). Hashtags are user-generated labels, which allow other users to track posts with a specific theme on Twitter. Moreover, social media such as Twitter can be powerful tools for identifying a variety of information sources related to people’s actions, decisions and opinions before, during and after broad scope events, such as environmental disasters like earthquakes, typhoons, volcanic eruptions, floods, droughts, forest fires, landslides (Imran et al. 2015; Maldonado et al. 2016; Corvey et al. 2010). In light of the above, our aim is to monitor social media in order to detect environmental crimes.

    2Our research is guided by the following question: can Natural Language Processing (NLP) represent a valuable ally to identify these kinds of crimes through the monitoring of social media? For this purpose, we compiled a corpus of tweets starting from a list of 41 terms related to environmental crimes, e.g. combustione illecita (illicit combustion), rifiuti radioattivi (radioactive waste), discarica abusiva (illegal dumping), and we used the Twitter API to download all the tweets (specifically 228,412) related to these terms introduced by hashtag. In this research, a special focus is dedicated to the tweets related to La terra dei fuochi (literally the Land of Fires) (Peluso 2015), a large area located between Naples and Caserta (in the South of Italy) victim of illegal toxic wastes dumped by organized crime for about fifty years and routinely burned to make space for new toxic wastes.

    3In order to achieve our purpose, we trained different machine learning algorithms to classify report emergency text and user-generated reports. The paper is organized as follows: in Section 2 we discuss Related Work, in Section 3 we present the UNIOR Earth your Estate (UNIOR Eye) corpus. The case study is described in Section 4 and Results are discussed in Section 5. Conclusions are in Section 6 along with directions for Future Work.

    2. Related Work

    4As previously mentioned, hashtags are one of the most important resources - if not the most important - in text data such as those of Twitter. The possibility to aggregate data according to their content allows users to monitor all the discussion about a specific subject in real-time (an emblematic case is the hashtag #Covid_19).

    5Concerning the topic of our research, namely environmental issues, the most representative and productive hashtags have proved to be #terradeifuochi and #rifiuti (respectively with a frequency of 92,322 and 62,750 occurrences), that directly refer to circumstances that have a strong impact on the environment and people’s health. The use of hashtags proved to be useful in monitoring natural disasters, such as earthquakes, flood and hurricane.
    For a survey on information processing and management of social media contents to study natural disasters, see (Imran, Mitra, and Castillo 2016). (Neubig et al. 2011) focused on the 2011 East Japan earthquake. The scholars built a system able to extract the status of people involved in the disaster (e.g. if they declared to be alive, they request for help, their information requests, information about missing people). About one hundred scholars participated spontaneously in the project ANPI_NLP (ANPI means Safety in Japanese) and the results show convincing performances by the classifier they built. (Maldonado et al. 2016) investigated natural disasters in Ecuador, monitoring Twitter to filter contents according to four different categories: volcanic, telluric, fires and climatological. The filtering process is based on keywords related to the four categories. The scholars released a web application that graphically shows the database evolution. The efficiency of the tweet filtering algorithm that they developed is expressed in terms of precision (%93.55). (Tarasconi et al. 2017) investigated tweets related to eight different event types (floods, wildfires, storms, extreme weather conditions, earthquakes, landslides, drought and snow) in Italian, English and Spanish. The corpus is composed of 9,695 tweets and can be extremely useful to perform information extraction in the aforementioned three languages. (Sit, Koylu, and Demir 2019) used the Hurricane Irma, which devastated Caribbean Islands and Florida in September 2017, as a case-study: the scholars demonstrate that by monitoring tweets it is possible to detect potential areas with high density of affected individuals and infrastructure damage throughout the temporal progression of the disaster. By focusing on tweets generated before, during, and after Hurricane Sandy, a superstorm which severely impacted New York in 2012, (Stowe et al. 2016) proposed an annotation schema to identify relevant Twitter data (within a corpus of 22.2M unique tweets from 8M unique Twitter users), categorizing these tweets into fine-grained categories, such as preparation and evacuation.(Imran, Mitra, and Castillo 2016) presented Twitter corpora composed of over 52 million crisis-related tweets, collected during 19 different crises that took place from 2013 to 2015. These corpora were manually-annotated by volunteers and crowd-sourced workers providing two types of annotations, the first one related to a set of categories, the second one concerning out-of-vocabulary words (e.g. slangs, places names, abbreviations, misspellings). The scholars then built machine-learning classifiers in order to demonstrate the effectiveness of the annotated datasets, also publishing word2vec word embeddings trained on more than 52 million messages. The preliminary results of this study posit that a classification with a high precision of tweets relevant to the disaster is possible to assist crisis managers and first responders. Our study is not devoted to monitor natural disasters but to monitor natural human-caused disasters. More specifically, the aim is to exploit NLP techniques to contribute to the identification of intentional environmental crimes through social media analysis. To the best of our knowledge, this perspective of investigation is rather novel in the field.

    3. The UNIOR Eye Corpus

    6This section outlines the way the UNIOR Eye corpus was created and how it is internally structured. The research has been carried out in the framework of the C4E - Crowd for the Environment (Progetto PON Ricerca e Innovazione 2014-2020) project2.

    7The UNIOR Eye corpus is made up of 228,412 tweets related to environmental crimes downloaded through Twitter API, covering the period from 01 January 2013 to 06 August 2020. The compilation phase of the corpus was divided into two steps: the creation of a vocabulary containing keywords related to environmental crimes and the creation of the corpus. During this work phase, the data was structured and organized according to the different keywords, obtained from glossaries and documents specific to the topic.

    8Precisely, the following resources

    • Glossario di termini sull’ambiente (FIMP 2017) (a guide from A to Z concerning the complex issue of environmental pollution);

    • Glossario dinamico per l’Ambiente ed il Paesaggio (ISPRA 2012) (a glossary supplied by the Italian Institute for Environmental Protection and Research);

    • Glossario ambientale3 (a glossary supplied by the national agency for the environmental protection of Tuscany);

    • BeSafeNet4 (a glossary based on the Glossary on Emergency Management, which has been developed in 2001 by European Centre of Technological Safety (TESEC) of Euro-Mediterranean network of Centres EUR-OPA Major Hazard Agreement of Council of Europe in collaboration with other centres of network);

    • HERAmbiente5 (a glossary provided by Herambiente, the largest company in the waste management sector);

    • Enciclopediambiente6 (the first freely available online Encyclopedia on the Environment, designed by a group of four engineers with the aim of spreading “environmental knowledge")

    and the following two web sources

    • a dossier containing important provisions aimed at dealing with environmental and industrial emergencies and encouraging the development of the affected areas7;

    • a document on environmental crimes and environmental protection8.

    were consulted. All of these language resources contain information and definitions of the basic terms related to environmental disasters and crimes, e.g. Rifiuti pericolosi (hazardous waste): waste products which can generate potential/substantial risk to human health/the environment if handled improperly. Hazardous waste contains at least one of these characteristics: flammability, corrosivity, or toxicity,9 and is included in special lists. Here are some examples.

    • HASHTAG HASHTAG Fiumicino: eternit e rifiuti pericolosi al Passo della Sentinella URL HASHTAG (HASHTAG HASHTAG Fiumicino: eternit and hazardous waste in Passo della Sentinella URL HASHTAG);

    • Cani in gabbia in discarica abusiva: Due animali tra rifiuti pericolosi, amianto e bombole gas URL (Caged dogs in illegal dump: two pets among hazardous waste, asbestos and gas cylinders URL)

    9After this phase it was possible to create the corpus by downloading from Twitter all the tweets containing these keywords preceded by the hashtag. These hashtags helped us to gather the information needed to detect crimes against the environment. More specifically, the corpus is internally divided into semantic areas, each one concerning a specific environmental crime: rifiuti e terra dei fuochi (waste and Terra dei fuochi); reati contro le acque (water-related crimes); materiali e sostanze pericolose (hazardous substances and materials); incendi e roghi ambientali (environmental fires). These sets are further divided into more specific subsets, e.g. the folder reati contro le acque (water-related crimes) contains the subsets acque di scarico, acque reflue, fiumi inquinati, liquami (sewage, wastewater, polluted rivers, slurry). The resulting corpus contains, therefore, a total of 228,412 tweets, 22,780,746 tokens, 569,905 types with a type/token ratio (TTR) of 0.025.

    4. Case Study

    10This section describes the steps taken to perform the preliminary experiments on a selected part of the UNIOR Eye corpus. First, the dataset on which the experiments and data preparation operations were carried out is presented, then the pre-processing steps are listed and, finally, the different machine learning approach used are described.

    4.1 Dataset

    11As described in Section 3, the UNIOR Eye corpus is divided into four semantic areas related to the most common crimes against the environment. Among the four semantic areas, we decided to use the waste crimes subsection to test a specific use case: whether an NLP system can understand and report emergency text and user-generated reports.
    Therefore, for the experiments described in this paper, we focus our investigation on a sub-section of the UNIOR Eye corpus, namely tweets about waste related crimes and tweets with the hashtag #terradeifuochi contained in the corresponding semantic area: waste and Terra dei fuochi. This subsection of the corpus contains 86,206 tweets. First, for the total number of tweets, hashtags, mentions and URLs are replaced with placeholder words. Then tweets were annotated by the paper authors on the basis of two labels: i) alert and ii) no alert, i.e. if the tweet contains or not a message aimed at reporting and locating a waste related crime.
    Below, we provide a sample of annotated tweets following our two labels, alert - no alert:

    • Ore 11:40 autostrada A1 altezza Afragola Acerra direzione Roma. Roghi Tossici indisturbati, la HASHTAG... URL HASHTAG HASHTAG (11:40 am A1 motorway near Afragola Acerra towards Rome. Undisturbed toxic fires, the HASHTAG ... URL HASHTAG HASHTAG) — ALERT

    • MENTION ministro, piuttosto che pensare alla HASHTAG pensi ai continui roghi MENTION (MENTION Minister, rather than thinking about the HASHTAG think about the continuous fires MENTION) — NO ALERT

    12During the annotation phase, we noted that the no alert class is the one which contains the majority of tweets and includes examples of hate speech, satirical texts, news about emergency actions as well as politically oriented texts. Consequently, our dataset built in this way is unbalanced for the two classes, counting 81,235 tweets for the no alert class and 4,970 alert tweets. In order to visualize alert tweets, we exploit Carto10, a cloud computing platform that provides a geographic information system, web mapping, and spatial data science tools11.

    4.2 Inter-annotator Agreement

    13When different annotators label a corpus, it is important to calculate the inter-annotator agreement (IAA) with a twofold objective: i) make sure that annotators agree and ii) test the clarity of guidelines. As previously mentioned, the dataset (composed of 86,206 tweets) has been annotated by four of the paper authors on the basis of two labels: i) alert and ii) no alert. This implies that each author annotated about 21,000 tweets. Then, to calculate inter-annotator agreement we randomly selected 10% of the tweets (i.e. 8,620) which were tagged by all annotators.

    14The agreement among the four annotators is measured using Krippendorff’s α coefficient; instead, to estimate the agreement between pairs of annotators, we use Cohen’s κ coefficient (Artstein and Poesio 2008). Taking into account the recommendations set out in (Artstein and Poesio 2008; Krippendorff 2004), we interpret the κ values obtained in IAA according to the strength of agreement criteria described in (Landis and Koch 1977) for each pair of annotators; whereas, for agreement among four annotators, we follow the suggested standard in (Krippendorff 2004). The calculated value of Krippendorff’s α is 0.706. Considering the standard value in (Krippendorff 2004), our value of α=0.706 is considered as acceptable and expressing a good data reliability. In Table 1 we show the results for pairs of annotators.

    Table 1: Cohen’s κ values for pairs of annotators

    Pair of annotators

    Value of κ

    a1 - a2

    0.691

    a1 - a3

    0.742

    a1 - a4

    0.841

    a2 - a3

    0.676

    a2 - a4

    0.644

    a3 - a4

    0.641

    15According to (Landis and Koch 1977), five out of six Cohen’s κ values show a “substantial" strength of agreement for each pair; while a pair (a1-a4) show a κ value considered “almost perfect" in the research cited.

    4.3 Preprocessing

    16Before feeding the machine learning algorithms, some pre-processing steps are performed. Since the majority of mentions and hashtags are shared by both alert and no-alert samples, we focus on the tweet itself, by removing any reference to people, entities and organizations conveyed through hashtags and mentions. Therefore, the placeholder words related to hashtags, URLs and mentions are removed. Then, punctuation is removed from the tweets along with a custom list of function words such as determiners, prepositions and conjunctions. Finally, the tweets are lower-cased and the tokenization is performed.

    4.4 Machine Learning Approaches

    17We set the problem of tweets related to waste crimes as a supervised binary classification problem between different textual content.

    18To tackle the problem as first task within the C4E Project, we select a machine learning approach using Support Vector Machines (SVM) with linear kernel and C=1 and Multinomial Naive Bayes (MNB) as classification algorithms (Imran et al. 2015). Since the task concerns the classification of tweets belonging to the alert class, to deal with the unbalanced dataset, we use the undersampling technique by automatically reducing the number of samples for the majority class (no alert) (Li, Bontcheva, and Cunningham 2009), until they were balanced with the samples of the alert class. We used the tf-idf technique to extract the features used by both algorithms. To build algorithms and extract features, we used the Python scikit-learn library.

    19In addition to the MNB and SVM with tf-idf technique, we built two models with sentence embeddings as features and SVM with the tuning of C parameter as a classification algorithm. In the first model (FT-SVM), we used the Italian pre-trained word vectors from fastText12(Bojanowski et al. 2017) to build our sentence embeddings by averaging word embeddings for all tokens for each tweet; then, C=10 is found as the best C parameter value using GridSearchCV13 instance. In the second model (mDB-SVM), we generated sentence embeddings using the pretrained multilingual DistilBERT (Sanh et al. 2019) model from Transformers14. To accomplish this, each tweet is represented as a list of tokens and, then, each list is padded to the same size (max_len = 94). The attention mask is used. Before fitting the sentence embeddings thus constructed in the SVM classifier, it is searched for the best value of the C parameter set to C=0.1. For both models (FT-SVM and mDB-SVM) the pre-processing steps described above are performed.

    5. Results

    20In this section, we show the results obtained by our models in terms of Precision, Recall, F-Measure and Accuracy. For all models, the results are obtained on 30% of the dataset set aside as a test set, keeping the samples balanced between the two classes. Furthermore our models were evaluated using a 10-Fold Cross-Validation15.

    21As a baseline to compare with, we used Dummy classifier which achieves an accuracy of 0.501. On the test set, the SVM classifier achieves an accuracy of 0.870, while for the MNB classifier it is 0.839. Regarding the evaluation by 10-fold cross validation, our SVM reaches an accuracy of 0.868 with the mean and standard deviation of 0.008, instead the accuracy of the MNB is 0.841 with the mean and standard deviation of 0.010. In Table 2 we show the performances achieved by both models.

    Table 2: Results in terms of Precision, Recall and F-Measure

    MNB

    Precision

    Recall

    F-Measure

    alert

    0.871

    0.816

    0.843

    no alert

    0.807

    0.864

    0.835

    SVM

    Precision

    Recall

    F-Measure

    alert

    0.857

    0.878

    0.867

    no alert

    0.883

    0.862

    0.873

    22Both classifiers with tf-idf achieve good accuracy and seem to have a good ability to classify a considerable amount of tweets providing good results in terms of precision and recall. One of the reasons for these performances may be ascribed to a discriminating lexical composition regarding the samples belonging to the alert and no alert classes.

    23Regarding the accuracy of sentence embeddings models on the test set, FT-SVM reaches an accuracy of 0.822, while mDB 0.774. By evaluating the predictive performance of the two models with 10-fold cross-validation, FT-SVM achieves an accuracy of 0.825 with the mean and standard deviation of 0.011, while mDB-SVM reaches the accuracy of 0.773 with the mean and standard deviation of 0.013. In Table 3, the results in terms of Precision, Recall and F-Measure are shown.

    Table 3: Classification Reports for FT-SVM and mDB-SVM

    FT-SVM

    Precision

    Recall

    F-Measure

    alert

    0.826

    0.817

    0.821

    no alert

    0.818

    0.827

    0.822

    mDB-SVM

    Precision

    Recall

    F-Measure

    alert

    0.785

    0.766

    0.775

    no alert

    0.765

    0.783

    0.774

    24Both models fed with sentence embeddings constructed with different techniques, seem to perform well in this classification task. In particular, the FT-SVM model based on sentence embeddings built with FastText seems to have better scores in terms of Precision and F-measure than those achieved by the mDB-SVM model. One of the reasons could be that sentence embeddings built with FastText benefit from a resource tailored on the Italian language compared to a multilingual one used in DBert-SVM. Specifically, mDB-SVM achieved good results in terms of precision and f-measure for the alert class. Instead, in terms of Recall, both models have a high proportion of relevant instances for the no alert class.

    5.1 Confusion Matrices

    25In this section we show the four confusion matrices in order to graphically display the performances achieved by the different models. In Figure 1 we show the confusion matrix of the MNB model, while in Figure 2 that of the SVM model.

    Figure 1: MNB model confusion matrix

    Image 10000000000003B0000003230B2D434C7D6F887D.jpg

    Figure 2: SVM model confusion matrix

    Image 10000000000003B000000323E4A25CDFBD75F06C.jpg

    26The confusion matrices of the FT-SVM and the mDB-SVM model are shown respectively in Figure 3 and Figure 4.

    Figure 3: FT-SVM model confusion matrix

    Image 10000000000003B00000032302B13BB9062303FA.jpg

    Figure 4: mDB-SVM model confusion matrix

    Image 10000000000003B0000003230AEB5DB8B3F46378.jpg

    6. Conclusions and Future Work

    27We presented a case study within the C4E project aimed at monitoring social media to provide support against environmental crimes. In particular, we described the UNIOR Eye corpus, in some sections still in progress, on which we tested four models with three different features extraction and construction techniques on a part of the corpus. We proposed two classifiers, namely SVM and MNB, with tf-idf features as the first experiment; then, SVM with C parameter tuning fed with sentence embeddings. These embeddings were built both using Italian pre-trained fastText model and using pre-trained DistilBert multilingual model. Our purpose was to classify alert tweets related to waste crimes vs no alert tweets. Future research will include the enlargement of the corpus, applications of NLP in the field of environmental protection as well as the analysis of contextual features related to environmental issues used as a medium to polarize public opinion (Karol 2018).

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    Artstein, R., & Poesio, M. (2008). Inter-Coder Agreement for Computational Linguistics. MIT Press - Journals. https://doi.org/10.1162/coli.07-034-r2
    Landis, J. R., & Koch, G. G. (1977). The Measurement of Observer Agreement for Categorical Data. JSTOR. https://doi.org/10.2307/2529310
    Artstein, Ron, and Massimo Poesio. “Inter-Coder Agreement for Computational Linguistics”. Computational Linguistics. MIT Press - Journals, December 2008. doi:10.1162/coli.07-034-r2.
    Landis, J. Richard, and Gary G. Koch. “The Measurement of Observer Agreement for Categorical Data”. Biometrics. JSTOR, March 1977. doi:10.2307/2529310.
    Artstein, Ron, and Massimo Poesio. “Inter-Coder Agreement for Computational Linguistics”. Computational Linguistics, vols. 34, nos. 4, MIT Press - Journals, Dec. 2008, pp. 555-96. Crossref, https://doi.org/10.1162/coli.07-034-r2.
    Landis, J. Richard, and Gary G. Koch. “The Measurement of Observer Agreement for Categorical Data”. Biometrics, vols. 33, no. 1, JSTOR, Mar. 1977, p. 159. Crossref, https://doi.org/10.2307/2529310.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    Ron Artstein and Massimo Poesio. 2008. “Inter-Coder Agreement for Computational Linguistics.” Computational Linguistics 34 (4): 555–96.

    10.1162/coli.07-034-R2 :

    Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2017. “Enriching Word Vectors with Subword Information.” Transactions of the Association for Computational Linguistics 5: 135–46.

    William J. Corvey, Sarah Vieweg, Travis Rood, and Martha Palmer. 2010. “Twitter in Mass Emergency: What Nlp Can Contribute.” In Proceedings of the Naacl Hlt 2010 Workshop on Computational Linguistics in a World of Social Media, 23–24.

    FIMP. 2017. “FIMP Ambiente - Federazione Italiana Medici Pediatriglossario Di Termini Sull’AMBIENTE. Una Guida Dalla a Alla Z Per Orientarsi Nel Complesso Tema Dell’inquinamento Ambientale.”

    Muhammad Imran, Carlos Castillo, Fernando Diaz, and Sarah Vieweg. 2015. “Processing Social Media Messages in Mass Emergency: A Survey.” ACM Computing Surveys (CSUR) 47 (4): 1–38.

    Muhammad Imran, Prasenjit Mitra, and Carlos Castillo. 2016. “Twitter as a Lifeline: Human-Annotated Twitter Corpora for Nlp of Crisis-Related Messages.” arXiv Preprint arXiv:1605.05894.

    ISPRA. 2012. “ISPRA – L’Istituto Superiore Per La Protezione E La Ricerca Ambientale, Glossario Dinamico Per L’Ambiente Ed Il Paesaggio.”

    David Karol. 2018. “Party Polarization on Environmental Issues: Toward Prospects for Change.” Research Paper. Niskanen Center, Washington, DC.

    Klaus Krippendorff. 2004. “Reliability in Content Analysis: Some Common Misconceptions and Recommendations.” Human Communication Research 30 (3): 411–33.

    J. Richard Landis and Gary G Koch. 1977. “The Measurement of Observer Agreement for Categorical Data.” Biometrics, 159–74.

    10.2307/2529310 :

    Yaoyong Li, Kalina Bontcheva, and Hamish Cunningham. 2009. “Adapting Svm for Data Sparseness and Imbalance: A Case Study in Information Extraction.” Natural Language Engineering 15 (2): 241–71.

    Miguel Maldonado, Darwin Alulema, Derlin Morocho, and Marida Proaño. 2016. “System for Monitoring Natural Disasters Using Natural Language Processing in the Social Network Twitter.” In 2016 Ieee International Carnahan Conference on Security Technology (Iccst), 1–6. IEEE.

    Graham Neubig, Yuichiroh Matsubayashi, Masato Hagiwara, and Koji Murakami. 2011. “Safety Information Mining—What Can Nlp Do in a Disaster—.” In Proceedings of 5th International Joint Conference on Natural Language Processing, 965–73.

    Pasquale Peluso. 2015. “Dalla Terra Dei Fuochi Alle Terre Avvelenate: Lo Smaltimento Illecito Dei Rifiuti in Italia.” Rivista Di Criminologia, Vittimologia E Sicurezza 9 (2): 13–30.

    Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. “DistilBERT, a Distilled Version of Bert: Smaller, Faster, Cheaper and Lighter.” arXiv Preprint arXiv:1910.01108.

    Muhammed Ali Sit, Caglar Koylu, and Ibrahim Demir. 2019. “Identifying Disaster-Related Tweets and Their Semantic, Spatial and Temporal Context Using Deep Learning, Natural Language Processing and Spatial Analysis: A Case Study of Hurricane Irma.” International Journal of Digital Earth 12 (11): 1205–29.

    Kevin Stowe, Michael Paul, Martha Palmer, Leysia Palen, and Kenneth M Anderson. 2016. “Identifying and Categorizing Disaster-Related Tweets.” In Proceedings of the Fourth International Workshop on Natural Language Processing for Social Media, 1–6.

    Francesco Tarasconi, Michela Farina, Antonio Mazzei, and Alessio Bosca. 2017. “The Role of Unstructured Data in Real-Time Disaster-Related Social Media Monitoring.” In 2017 Ieee International Conference on Big Data (Big Data), 3769–78. IEEE.

    Notes de bas de page

    1 Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    2 http://www.unior.it/ateneo/20574/1/c4e-crowd-for-the-environment-progetto-pon-ricerca-e-innovazione-2014-2020.html

    3 http://www.arpat.toscana.it/glossario-ambientale

    4 http://www.besafenet.net/it-it/glossary

    5 http://ha.gruppohera.it/glossario_ambiente/

    6 http://www.enciclopediambiente.com

    7 https://www.senato.it/japp/bgt/showdoc/17/DOSSIER/0/740667/index.html?part=dossier_dossier1-sezione_sezione12-h2_h28

    8 https://scuola21.fermi.mn.it/documenti/reati_ambientali.pdf

    9 https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:C:2018:124:FULL&from=IT

    10 carto.com

    11 A map showing toxic fires alert tweets in the UNIOR Eye corpus is available at this link https://uniornlp.carto.com/builder/04f2cca9-08cd-4b9f-90cd-79fc0d93af42/embed

    12 https://fasttext.cc/docs/en/pretrained-vectors.html

    13 https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html#

    14 https://huggingface.co/transformers/pretrained_models.html

    15 https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.KFold.html

    Auteurs

    • Raffaele Manna

      UNIOR NLP Research Group University “L’Orientale", Naples, Italy – rmanna@unior.it

    • Antonio Pascucci

      UNIOR NLP Research Group University “L’Orientale", Naples, Italy – apascucci@unior.it

    • Wanda Punzi Zarino

      UNIOR NLP Research Group University “L’Orientale", Naples, Italy – w.zarino@gmail.com

    • Vincenzo Simoniello

      UNIOR NLP Research Group University “L’Orientale", Naples, Italy – vincenzosimoniello@gmail.com

    • Johanna Monti

      UNIOR NLP Research Group University “L’Orientale", Naples, Italy – jmonti@unior.it

    Précédent Suivant
    Table des matières

    Le texte seul est utilisable sous licence Licence OpenEdition Books. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence

    Federico Sangati, Antonio Pascucci et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    “Spotto la quarantena": per una analisi dell’italiano scritto degli studenti universitari via social network in tempo di COVID-19

    Francesca Chiusaroli, Johanna Monti, Maria Laura Pierucci et al.

    The Archaeo-Term Project: Multilingual Terminology in Archaeology

    Giulia Speranza, Raffaele Manna, Maria Pia di Buono et al.

    Ghigliottin-AI @ EVALITA2020: Evaluating Artificial Players for the Language Game “La Ghigliottina”

    Pierpaolo Basile, Marco Lovetere, Johanna Monti et al.

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Voir plus de chapitres
    1 / 12

    TED-MWE: a bilingual parallel corpus with MWE annotation

    Towards a methodology for annotating MWEs in parallel multilingual corpora

    Johanna Monti, Federico Sangati et Mihael Arcan

    Preface

    Johanna Monti, Felice Dell’Orletta et Fabio Tamburini

    PARSEME-IT

    Issues in verbal Multiword Expressions identification and classification

    Johanna Monti, Valeria Caruso et Maria Pia di Buono

    Advances in Multiword Expression Identification for the Italian language: The PARSEME shared task edition 1.1

    Johanna Monti, Silvio Ricardo Cordeiro, Carlos Ramisch et al.

    PARSEME-It Corpus

    An annotated Corpus of Verbal Multiword Expressions in Italian

    Johanna Monti, Maria Pia di Buono et Federico Sangati

    Emojitalianobot and EmojiWorldBot

    New online tools and digital environments for translation into emoji

    Johanna Monti, Federico Sangati, Francesca Chiusaroli et al.

    “Il Mago della Ghigliottina” @ Ghigliottin-AI: When Linguistics meets Artificial Intelligence

    Federico Sangati, Antonio Pascucci et Johanna Monti

    Exploiting Multiword Expressions to solve “La Ghigliottina”

    Federico Sangati, Antonio Pascucci et Johanna Monti

    “Spotto la quarantena": per una analisi dell’italiano scritto degli studenti universitari via social network in tempo di COVID-19

    Francesca Chiusaroli, Johanna Monti, Maria Laura Pierucci et al.

    The Archaeo-Term Project: Multilingual Terminology in Archaeology

    Giulia Speranza, Raffaele Manna, Maria Pia di Buono et al.

    Ghigliottin-AI @ EVALITA2020: Evaluating Artificial Players for the Language Game “La Ghigliottina”

    Pierpaolo Basile, Marco Lovetere, Johanna Monti et al.

    DialettiBot: a Telegram Bot for Crowdsourcing Recordings of Italian Dialects

    Federico Sangati, Ekaterina Abramova et Johanna Monti

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 Copyright © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    2 http://www.unior.it/ateneo/20574/1/c4e-crowd-for-the-environment-progetto-pon-ricerca-e-innovazione-2014-2020.html

    3 http://www.arpat.toscana.it/glossario-ambientale

    4 http://www.besafenet.net/it-it/glossary

    5 http://ha.gruppohera.it/glossario_ambiente/

    6 http://www.enciclopediambiente.com

    7 https://www.senato.it/japp/bgt/showdoc/17/DOSSIER/0/740667/index.html?part=dossier_dossier1-sezione_sezione12-h2_h28

    8 https://scuola21.fermi.mn.it/documenti/reati_ambientali.pdf

    9 https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:C:2018:124:FULL&from=IT

    10 carto.com

    11 A map showing toxic fires alert tweets in the UNIOR Eye corpus is available at this link https://uniornlp.carto.com/builder/04f2cca9-08cd-4b9f-90cd-79fc0d93af42/embed

    12 https://fasttext.cc/docs/en/pretrained-vectors.html

    13 https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.GridSearchCV.html#

    14 https://huggingface.co/transformers/pretrained_models.html

    15 https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.KFold.html

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    X Facebook Email

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est cité par

    • Miaschi, Alessio. Alzetta, Chiara. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2023) Testing the Effectiveness of the Diagnostic Probing Paradigm on Italian Treebanks. Information, 14. DOI: 10.3390/info14030144
    • Miaschi, Alessio. Sarti, Gabriele. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2022) Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties. Italian Journal of Computational Linguistics, 8. DOI: 10.4000/ijcol.965
    • Saga, Satoshi. Shirakawa, Kanta. (2025) Investigating the Effect of Pseudo-Haptics on Perceptions Toward Onomatopoeia Text During Finger-Point Tracing. Multimodal Technologies and Interaction, 9. DOI: 10.3390/mti9100100
    • (2025) Book reviews. Yearbook of Phraseology, 16. DOI: 10.1515/phras-2025-0012

    Ce chapitre est cité par

    • Drozda, Paweł. Sopyła, Krzysztof. (2023) Lecture Notes in Computer Science Artificial Intelligence and Soft Computing. DOI: 10.1007/978-3-031-23480-4_18

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Manna, R., Pascucci, A., Zarino, W. P., Simoniello, V., & Monti, J. (2020). Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study. In F. Dell’Orletta, J. Monti, & F. Tamburini (éds.), Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8675
    Manna, Raffaele, Antonio Pascucci, Wanda Punzi Zarino, Vincenzo Simoniello, et Johanna Monti. « Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study ». In Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta, Johanna Monti, et Fabio Tamburini. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8675.
    Manna, Raffaele, et al. « Monitoring Social Media to Identify Environmental Crimes through NLP A Preliminary Study ». Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8675.

    Référence numérique du livre

    Format

    Dell’Orletta, F., Monti, J., & Tamburini, F. (éds.). (2020). Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8203
    Dell’Orletta, Felice, Johanna Monti, et Fabio Tamburini, éd. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8203.
    Dell’Orletta, Felice, et al., éditeurs. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8203.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement