• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16075 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16075 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Accademia University Press
  • ›
  • Collana dell'Associazione Italiana di Li...
  • ›
  • Proceedings of the Seventh Italian Confe...
  • ›
  • Contributed Papers
  • ›
  • MultiEmotions-It: a New Dataset for Opin...
  • Accademia University Press
  • Accademia University Press
    Accademia University Press
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral 1. Introduction 2. Related Works 3. Dataset Development 4. Dataset Analysis 5. Baseline System 6. Conclusion and Future Work Bibliographie Notes de bas de page Auteur

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    MultiEmotions-It: a New Dataset for Opinion Polarity and Emotion Analysis for Italian

    Rachele Sprugnoli

    p. 402-408

    Résumé

    This paper1 presents a new linguistic resource for Italian, called MultiEmotions-It, containing comments to music videos and advertisements posted on YouTube and Facebook. These comments are manually annotated according to four different dimensions: i.e., relatedness, opinion polarity, emotions and sarcasm. For the annotation of emotions we adopted the Plutchik’s model taking into account both basic and complex emotions, i.e. dyads.

    Remerciements

    The author wants to thank the students of the “Sentiment Analysis” seminar held within the “Comunicazione per l’impresa, i media e le organizzazioni complesse” master’s degree at Università Cattolica del Sacro Cuore (Milan) for the annotation they performed.

    Texte intégral Bibliographie Notes de bas de page Auteur

    Texte intégral

    1. Introduction

    1Emotions play an influential role in consumer behaviour affecting the decision to purchase goods and services of different types, including music (Mizerski and White 1986; Lacher 1989). Both positive and negative emotions have an influence and this is why marketing strategies have always focused on both rational and emotional aspects (Cotte and Ritchie 2005).

    2With the advent of social media, platforms such as YouTube and Facebook have gained importance in the marketing industry because they allow to connect and engage consumers (Kujur and Singh 2018). The progressive consolidation of social media as marketing spaces has highlighted the need to monitor unstructured data written by social media users. In this context, the application of Sentiment Analysis techniques have flourished with the aim of tracking customers’ opinions and attitudes by analysing comments or reviews posted on social media channels (Micu et al. 2017).

    3In this paper we present a new linguistic resource for Italian, called MultiEmotions-It, containing comments to music videos and advertisement posted on YouTube and Facebook. Comments are manually annotated according to four different dimensions: relatedness, opinion polarity, emotions and sarcasm. Particular attention is devoted to the annotation of emotions for which we adopted the model proposed by Plutchik (Plutchik 1980). Following Plutchik, we take into consideration both the eight basic emotions (joy, sadness, fear, anger, trust, disgust, surprise, anticipation) and the dyads, that is feelings composed of two basic emotions (e.g., love is a blend of joy and Trust). At the time of writing, MultiEmotions-It is the only freely available manually annotated dataset for emotion analysis for Italian.2

    2. Related Works

    4The computational study of opinions and emotions falls within the scope of the Sentiment Analysis research field (Liu 2012). Opinion polarity identification is a task aiming at understanding whether a text is expressing positive, negative or neutral sentiment towards the subject of the text. As for emotions, their analysis follows two main approaches (Buechel and Hahn 2017): in the first one emotions are classified into discrete categories based on the theories of psychologists such as those of Ekman (Ekman 1992) and Plutchik whereas in the second approach emotions are represented in a dimensional form using continuous values such as valence, arousal and dominance (the so called VAD model).

    5Survey papers like the ones by Hakak et al. (Hakak et al. 2017), Bostan & Klinger (Bostan and Klinger 2018) and Kim & Klinger (Kim and Klinger 2019) report on studies that focus on different text genres, mainly news (Strapparava and Mihalcea 2007), social media (Mohammad 2012) and literary works (Alm, Roth, and Sproat 2005).

    6Among social media, Twitter is the most studied platform and datasets of annotated tweets are available for different Sentiment Analysis tasks. For emotion analysis see, among others, EmpaTweet (Roberts et al. 2012) and EmoTweet (Liew, Turtle, and Liddy 2016). The literature also reports works on Facebook posts and YouTube comments with corpora and systems developed for various languages such as English (Preoţiuc-Pietro et al. 2016), Thai (Sarakit et al. 2015), Bangla (Tripto and Ali 2018) and Indonesian (Savigny and Purwarianti 2017). As for Italian, there are several emotion lexicons, for example (Araque et al. 2019; Passaro and Lenci 2016; Mohammad and Turney 2013; Mohammad 2018), but, at the moment, no dataset with annotated emotions has been released yet.3
    Similarly to SenTube (Uryupina et al. 2014), MultiEmotions-It includes YouTube comments and contains the annotation of opinion polarity: however, we also include comments to Facebook posts and we pay particular attention to the categorical annotation of emotions. More specifically, our emotion annotation is inspired by that proposed by Phan et al. (Phan, Shindo, and Matsumoto 2016) that goes beyond the classification of only the basic emotions to include Plutchik’s dyads so to better capture the spectrum of human emotional experience.

    3. Dataset Development

    3.1 Data Collection

    7Comments were scraped from YouTube and Facebook around mid-April 2020 using “Web Scraper”4, an extension for browsers. We focused on two genres of media contents: music videos (MVs) on YouTube and advertisements (Ads) both in the form of short videos (on YouTube and Facebook) and pictures (only on Facebook).

    8We chose 9 music videos of the songs presented during Sanremo Music Festival 2020 selecting both songs that reached the top of the chart in the contest and those that ranked in the last positions. All those videos had thousands of comments: we downloaded the most recent ones, at least one hundred comments per video. Finding advertising videos with lots of comments on YouTube was more complicated because many brands disable the possibility of adding comments to their channel. In the end, we managed to select 20 videos of various products, mostly of food and services, such as telecommunication and banking. Similar products and services were also chosen on Facebook by downloading the comments from 13 different posts.

    Table 1

    YT - MVs

    YT - Ads

    FB - Ads

    Avg

    unrelated

    0.43

    0.43

    0.41

    0.42

    neutral

    0.30

    0.50

    0.34

    0.38

    positive

    0.59

    0.78

    0.77

    0.71

    negative

    0.49

    0.71

    0.64

    0.61

    joy

    0.50

    0.61

    0.63

    0.58

    trust

    0.33

    0.42

    0.35

    0.37

    sadness

    0.45

    0.28

    0.43

    0.39

    anger

    0.47

    0.67

    0.49

    0.54

    fear

    0.13

    0.11

    0.10

    0.11

    disgust

    0.48

    0.53

    0.27

    0.43

    surprise

    0.33

    0.12

    0.12

    0.19

    anticipation

    0.35

    0.11

    0.15

    0.20

    sarcasm

    0.49

    0.34

    0.24

    0.36

    Inter-annotator agreement in terms of Krippendorff’s Alpha for YouTube music videos (YT MVs), YouTube advertisements (YT Ads), Facebook advertisements (FB Ads). Last column reports the average across the three categories of comments.

    Table 2: Examples of annotation

    COMMENT

    UNR

    NEU

    POS

    NEG

    JOY

    TRU

    SAD

    ANG

    FEA

    DIS

    SUR

    ANT

    SAR

    EMOTIONS

    Saludos desde - Argentina!!!

    1

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    1

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    0

    Frizzante come una Coca light scaduta

    0

    0

    0

    1

    0

    0

    0

    0

    0

    1

    0

    0

    1

    disgust

    Questa canzone mi ha rovinato l’esistenza

    0

    0

    0

    1

    0

    0

    1

    0

    1

    0

    0

    0

    0

    despair

    Idea interessante! Meno l’esecuzione...

    0

    0

    1

    1

    0

    1

    1

    0

    0

    0

    1

    0

    0

    trust - disappointment

    Table 3: Dataset Statistics

    YT - MVs

    YT - Ads

    FB - Ads

    # COMMENTS

    1,080

    1,080

    1,080

    # WORDS

    17,762

    19,603

    20,844

    unrelated

    65

    59

    51

    neutral

    84

    96

    115

    positive

    896

    509

    597

    negative

    46

    434

    373

    joy

    397

    172

    149

    trust

    797

    463

    574

    sadness

    188

    213

    292

    anger

    30

    211

    117

    fear

    5

    29

    32

    disgust

    32

    155

    48

    surprise

    174

    140

    199

    anticipation

    28

    56

    42

    sarcasm

    7

    30

    8

    3.2 Data Annotation

    9The annotation was performed in the context of the “Sentiment Analysis” seminar held within the ‘Comunicazione per l’impresa, i media e le organizzazioni complesse’’5 master’s degree at Università Cattolica del Sacro Cuore in Milan. The annotation process lasted one week and involved thirty six students: each student annotated 30 comments for each category (i.e., YouTube MVs, YouTube Ads, Facebook Ads) for a total of 90 comments. Each comment was annotated by two students. It is important to note that students had no previous experience in linguistic annotation but had specific training in the strategic management of communication flows on various media platforms.

    Annotation Guidelines

    10Students were required to annotate the following four dimensions for each comment; a comment may consist of more than one sentence but was analysed as a single unit:

    1. Relatedness: does the comment refer to the media content? Is the comment written in a language other than Italian? Comments that are not related to the media content or that are not written in Italian are to be annotated as unrelated.

    2. Opinion Polarity: is the comment positive, negative or neutral with respect to the media content? Positive and negative polarities are not mutually exclusive: a comment can have a mixed polarity containing both positive and negative opinions on different aspects of the media content.

    3. Emotions: what emotions are expressed in the comment? This dimension applies only to comments with positive or negative opinion polarity. Each comment can be annotated with one or more emotions at the same time: the list of emotions to assign includes Plutchik’s basic emotions and dyads. Conflict or mixed emotions can appear in the same comment.

    4. Sarcasm: are emotions expressed using sarcasm? Following Gibbs (Gibbs 2000), we define sarcasm as a language device that conveys the opposite of its literal meaning (Cignarella et al. 2018).

    11Annotation was carried on using spreadsheets where the aforementioned dimensions were converted into 13 fields: unrelated, neutral, positive, negative, joy, trust, sadness, anger, fear, disgust, surprise, anticipation, sarcasm. Each field had to be filled in with a binary value: 0 (the dimension is absent) or 1 (the dimension is present). Spreadsheets contained 4 additional metadata fields: type, title, URL, comment. For the annotation, students were provided with the images of Plutchik’s “Wheel of Emotions”6 and of the combination of emotions in dyads.7

    Inter-Annotator Agreement

    12Table 1 reports the results of the inter-annotator agreement (IAA): we measured the Krippendorff’s Alpha for each label and for each pair of annotators and then we computed the average for each type of comment. The average across the three type of comments is reported in the table as well. For all the labels, IAA is below the 0.8 threshold usually considered as good reliability for content analysis research (Klaus 1980; Artstein and Poesio 2008), however these results are in line with the ones obtained in similar works presenting a multi-label annotation of emotions or the annotation of mixed emotions (Aman and Szpakowicz 2007; Phan, Shindo, and Matsumoto 2016).

    13The analysis of the cases of disagreement revealed several interesting issues: i) labels unrelated and neutral tended to be confused with each other. For example, the comment Qualcuno mi sa dire dove si trova il porticato della quinta immagine? (Can anyone tell me where the portico in the fifth image is located?) is related to the content of the video but it is neutral; ii) sarcasm was confused with other forms of figurative language such as metaphors, e.g. È l’Ibrahimovic dei biscotti: perfetto (EN: it is the Ibrahimovic of biscuits: perfect); iii) the assignment of positive and negative labels registered the highest scores (average Alpha across the 3 categories: 0.71 for positive and 0.61 for negative). Nevertheless, sometimes annotators failed to distinguish between the annotation of opinion polarity and the annotation of emotions by assigning a negative polarity to comments containing negative emotions. However, the two dimensions do not always match: for example, the comment sta canzone meritava molto di più (EN: this song deserved much more) expresses disappointment but also an implicit appreciation for the song and thus a positive opinion polarity. iv) the IAA on the single emotion labels varies greatly: a similar wide variability is reported also in previous works even when dealing with non multi-label annotation (Strapparava and Mihalcea 2008; Aman and Szpakowicz 2007).

    Creation of the Ground Truth

    14All comments were manually revised and disagreement were reconciled so to assign gold labels. In this way, we generated a ground truth dataset where the noise coming from the annotation of non-expert annotators was minimized. Moreover, the field emotions was added to the spreadsheets so to make explicit the name of the emotions conveyed by the comments. Table 2 shows the structure of the final dataset (metadata fields are not displayed due to space limitation) and some examples of annotation. In particular, the table reports: an unrelated comment, a neutral comment, a comment with a negative polarity, a basic emotion (i.e. disgust) and sarcasm, a comment with a negative polarity and a dyad (i.e., disgust which is made of sadness and fear), a comment with mixed polarity and mixed emotions.

    4. Dataset Analysis

    15Table 3 summarizes the statistics of our final dataset showing the distribution of labels in the three categories of media content. MultiEmotions-It contains 3,240 comments for a total of more than 58,000 tokens. Only 470 comments (14.5% of the whole dataset) have no associated emotions because annotated as unrelated or neutral. Comments with positive opinion polarity are more than those with negative polarity: this is especially evident for YouTube MVs that are mostly commented by supporters of the artists performing in the video. Sarcasm is not a pervasive phenomenon: the number of comments annotated with the corresponding label is marginal, covering 1.6% of the total number of comments with an affective content, i.e. annotated with at least one emotion. More specifically, sarcasm co-occurs with two basic emotions: that is, anger (10 comments) and disgust (9 comments).

    16As for emotions, trust is the most frequent one: indeed, many comments express admiration towards the media content in different ways, for example by thanking the brand, declaring loyalty to a product or expressing appreciation for a specific feature of the media content (e.g. the location of the video). The emotion trust does not appear in the dataset only as a basic emotion but also in several combinations: indeed, 36.5% of the comments with an affective content are annotated with a dyad and 18.3% with a mix of emotions. Table 4 reports the 3 most frequent dyads and mixes of emotions in the dataset together with an example. As shown in the table, sentimentality (that is a combination of trust and sadness) plays an important role in Ads that try to induce a deep, overwhelming emotional response. Indeed, sentimentality is an emotion that marketing research has identified as a fundamental purchase decision variable (Morton et al. 2013).

    17Optimism (anticipation + joy) and pessimism (anticipation + sadness) are not very frequent in the dataset with 65 and 16 occurrences respectively. However, it is interesting to note that they are mainly associated with comments on advertisements related to the COVID-19 pandemic, for example:

    • optimism: All’Italia che, ancora una volta, resiste! EN: To Italy that, once again, resists!

    • pessimism: mamma mia quanta retorica spicciola ....finita l’epidemia staremo tutti ad odiarci e ad insultarci come sempre ....un paese che non ha senso più di esistere EN: oh my gosh, how much rhetoric .... once the epidemic is over we will all be hating and insulting each other as always .... a country that no longer makes sense to exist

    5. Baseline System

    18To establish a baseline on our data, we developed a simple multi-label classification model using the fastText library (Joulin et al. 2016).8 The aim of the model is to assign the correct emotion labels to comments. To this end, we randomly split comments and their annotated emotion labels into train and validation following an 80:20 ratio, thus having 2,592 comments for training and the remaining 648 for testing the performance of the learned classifier on new data. Texts have been lower-cased and punctuation removed. We trained the model with the following parameters:

    • learning rate: 0.5

    • epochs: 25

    • word n-grams: 2

    • loss function: one-vs-all

    19With the previous setting, we obtained 0.57 Precision, 0.43 Recall and 0.49 F-measure. Only four labels registered a F-measure above 0.5: i.e., trust (0.68), love (0.54), delight (0.53), sentimentality (0.50).9

    6. Conclusion and Future Work

    20This paper describes MultiEmotions-It, a new manually annotated dataset for opinion polarity and emotion analysis made of more than 3,000 comments on music videos and advertisements published on YouTube and Facebook.

    21As for future work, we plan to: (i) extend the annotation guidelines to distinguish the specific object towards which the opinion is directed (e.g. the product, the actor, the location of the video) following the work by Severyn et al. (Severyn et al. 2016), (ii) extend the dataset with new comments taken also from Instagram and Twitter, (iii) extract a new word-emotion association lexicon from MultiEmotions-It using vector space models (Passaro, Pollacci, and Lenci 2015) in order to cover complex emotions.

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    Artstein, R., & Poesio, M. (2008). Inter-Coder Agreement for Computational Linguistics. MIT Press - Journals. https://doi.org/10.1162/coli.07-034-r2
    Ekman, P. (1992). An argument for basic emotions. Informa UK Limited. https://doi.org/10.1080/02699939208411068
    Kim, E., & Klinger, R. (2019). A Survey on Sentiment and Emotion Analysis for Computational Literary Studies. Zeitschrift für Digitale Geisteswissenschaften. https://doi.org/10.17175/2019_008
    Krippendorff, K. (2019). Content Analysis: An Introduction to Its Methodology. SAGE Publications, Inc. https://doi.org/10.4135/9781071878781
    Proceedings of the 2008 ACM symposium on Applied computing. (2008). Presented at the SAC ’08: The 2008 ACM Symposium on Applied Computing. https://doi.org/10.1145/1363686
    Artstein, Ron, and Massimo Poesio. “Inter-Coder Agreement for Computational Linguistics”. Computational Linguistics. MIT Press - Journals, December 2008. doi:10.1162/coli.07-034-r2.
    Ekman, Paul. “An Argument for Basic Emotions”. Cognition and Emotion. Informa UK Limited, May 1992. doi:10.1080/02699939208411068.
    Kim, Evgeny, and Roman Klinger. “A Survey on Sentiment and Emotion Analysis for Computational Literary Studies”. Zeitschrift für Digitale Geisteswissenschaften, 2019. doi:10.17175/2019_008.
    Krippendorff, Klaus. “Content Analysis: An Introduction to Its Methodology”. []. SAGE Publications, Inc, 2019. doi:10.4135/9781071878781.
    “Proceedings of the 2008 ACM Symposium on Applied Computing”. []. ACM, March 16, 2008. doi:10.1145/1363686.
    Artstein, Ron, and Massimo Poesio. “Inter-Coder Agreement for Computational Linguistics”. Computational Linguistics, vols. 34, nos. 4, MIT Press - Journals, Dec. 2008, pp. 555-96. Crossref, https://doi.org/10.1162/coli.07-034-r2.
    Ekman, Paul. “An Argument for Basic Emotions”. Cognition and Emotion, vols. 6, no. 3-4, Informa UK Limited, May 1992, pp. 169-00. Crossref, https://doi.org/10.1080/02699939208411068.
    Kim, Evgeny, and Roman Klinger. “A Survey on Sentiment and Emotion Analysis for Computational Literary Studies”. Zeitschrift für Digitale Geisteswissenschaften, Version 1.0, 2019, https://doi.org/10.17175/2019_008.
    Krippendorff, Klaus. Content Analysis: An Introduction to Its Methodology. [], SAGE Publications, Inc., 2019. Crossref, https://doi.org/10.4135/9781071878781.
    Proceedings of the 2008 ACM Symposium on Applied Computing. [], ACM, 16 Mar. 2008. Crossref, https://doi.org/10.1145/1363686.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    Cecilia Ovesdotter Alm, Dan Roth, and Richard Sproat. 2005. “Emotions from Text: Machine Learning for Text-Based Emotion Prediction.” In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, 579–86.

    Saima Aman and Stan Szpakowicz. 2007. “Identifying Expressions of Emotion in Text.” In International Conference on Text, Speech and Dialogue, 196–205. Springer.

    Oscar Araque, Lorenzo Gatti, Jacopo Staiano, and Marco Guerini. 2019. “Depechemood++: A Bilingual Emotion Lexicon Built Through Simple yet Powerful Techniques.” IEEE Transactions on Affective Computing.

    Ron Artstein and Massimo Poesio. 2008. “Inter-Coder Agreement for Computational Linguistics.” Computational Linguistics 34 (4): 555–96.

    10.1162/coli.07-034-R2 :

    Andrea Bolioli, Federica Salamino, and Veronica Porzionato. 2013. “Social Media Monitoring in Real Life with Blogmeter Platform.” ESSEM@ AI* IA 1096: 156–63.

    Laura-Ana-Maria Bostan and Roman Klinger. 2018. “An Analysis of Annotated Corpora for Emotion Classification in Text.” In Proceedings of the 27th International Conference on Computational Linguistics, 2104–19. Santa Fe, New Mexico, USA: Association for Computational Linguistics. https://www.aclweb.org/anthology/C18-1179.

    Sven Buechel and Udo Hahn. 2017. “Emobank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysis.” In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, 578–85.

    Alessandra Teresa Cignarella, Simona Frenda, Valerio Basile, Cristina Bosco, Viviana Patti, Paolo Rosso, and others. 2018. “Overview of the EVALITA 2018 task on irony detection in italian tweets (IronITA).” In Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (Evalita 2018), 2263:1–6. CEUR-WS.

    June Cotte and Robin Ritchie. 2005. “Advertisers’ Theories of Consumers: Why Use Negative Emotions to Sell?” ACR North American Advances.

    Paul Ekman. 1992. “An Argument for Basic Emotions.” Cognition & Emotion 6 (3-4): 169–200.

    10.1080/02699939208411068 :

    Raymond W. Gibbs. 2000. “Irony in Talk Among Friends.” Metaphor and Symbol 15 (1-2): 5–27.

    Nida Manzoor Hakak, Mohsin Mohd, Mahira Kirmani, and Mudasir Mohd. 2017. “Emotion Analysis: A Survey.” In 2017 International Conference on Computer, Communications and Electronics (Comptelix), 397–402. IEEE.

    Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2016. “Bag of Tricks for Efficient Text Classification.” arXiv Preprint arXiv:1607.01759.

    Evgeny Kim and Roman Klinger. 2019. “A Survey on Sentiment and Emotion Analysis for Computational Literary Studies.” Zeitschrift Fuer Digitale Geisteswissenschaften 4. https://doi.org/http://dx.doi.org/10.17175/2019_008.

    10.17175/2019_008 :

    Krippendorff Klaus. 1980. “Content Analysis: An Introduction to Its Methodology.” Sage Publications.

    10.4135/9781071878781 :

    Fedric Kujur and Saumya Singh. 2018. “Emotions as Predictor for Consumer Engagement in Youtube Advertisement.” Journal of Advances in Management Research.

    Kathleen T. Lacher. 1989. “Hedonic Consumption: Music as a Product.” ACR North American Advances.

    Jasy Suet Yan Liew, Howard R. Turtle, and Elizabeth D Liddy. 2016. “EmoTweet-28: a fine-grained emotion corpus for sentiment analysis.” In Proceedings of the Tenth International Conference on Language Resources and Evaluation (Lrec’16), 1149–56.

    Bing Liu. 2012. Sentiment Analysis and Opinion Mining. Vol. 5. Synthesis Lectures on Human Language Technologies 1. Morgan & Claypool Publishers.

    Adrian Micu, Angela Eliza Micu, Marius Geru, and Radu Constantin Lixandroiu. 2017. “Analyzing User Sentiment in Social Media: Implications for Online Marketing Strategy.” Psychology & Marketing 34 (12): 1094–1100.

    Richard W. Mizerski and J Dennis White. 1986. “Understanding and Using Emotions in Advertising.” Journal of Consumer Marketing.

    Saif Mohammad. 2012. “# Emotional Tweets.” In * SEM 2012: The First Joint Conference on Lexical and Computational Semantics–Volume 1: Proceedings of the Main Conference and the Shared Task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (Semeval 2012), 246–55.

    Saif M. Mohammad. 2018. “Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words.” In Proceedings of the Annual Conference of the Association for Computational Linguistics (Acl). Melbourne, Australia.

    Saif M. Mohammad and Peter D Turney. 2013. “Crowdsourcing a Word–Emotion Association Lexicon.” Computational Intelligence 29 (3): 436–65.

    Anne-Louise Morton, Cheryl Rivers, Stephen Charters, and Wendy Spinks. 2013. “Champagne Purchasing: The Influence of Kudos and Sentimentality.” Qualitative Market Research: An International Journal.

    Lucia C. Passaro and Alessandro Lenci. 2016. “Evaluating Context Selection Strategies to Build Emotive Vector Space Models.” In Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016. European Language Resources Association (ELRA).

    Lucia Passaro, Laura Pollacci, and Alessandro Lenci. 2015. “ItEM: A vector space model to bootstrap an Italian emotive lexicon.” In Second Italian Conference on Computational Linguistics Clic-It 2015, 215–20. Academia University Press.

    Duc-Anh Phan, Hiroyuki Shindo, and Yuji Matsumoto. 2016. “Multiple Emotions Detection in Conversation Transcripts.” In Proceedings of the 30th Pacific Asia Conference on Language, Information and Computation: Oral Papers, 85–94.

    Robert Plutchik. 1980. “A General Psychoevolutionary Theory of Emotion.” In Theories of Emotion, 3–33. Elsevier.

    Daniel Preoţiuc-Pietro, H Andrew Schwartz, Gregory Park, Johannes Eichstaedt, Margaret Kern, Lyle Ungar, and Elisabeth Shulman. 2016. “Modelling Valence and Arousal in Facebook Posts.” In Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, 9–15.

    Kirk Roberts, Michael A. Roach, Joseph Johnson, Josh Guthrie, and Sanda M Harabagiu. 2012. “EmpaTweet: Annotating and Detecting Emotions on Twitter.” In Proceedings of the Eighth International Conference on Language Resources and Evaluation (Lrec’12), 12:3806–13. Citeseer.

    Phakhawat Sarakit, Thanaruk Theeramunkong, Choochart Haruechaiyasak, and Manabu Okumura. 2015. “Classifying Emotion in Thai Youtube Comments.” In 2015 6th International Conference of Information and Communication Technology for Embedded Systems (Ic-Ictes), 1–5. IEEE.

    Julio Savigny and Ayu Purwarianti. 2017. “Emotion Classification on Youtube Comments Using Word Embedding.” In 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (Icaicta), 1–5. IEEE.

    Aliaksei Severyn, Alessandro Moschitti, Olga Uryupina, Barbara Plank, and Katja Filippova. 2016. “Multi-Lingual Opinion Mining on Youtube.” Information Processing & Management 52 (1): 46–60.

    Carlo Strapparava and Rada Mihalcea. 2007. “Semeval-2007 Task 14: Affective Text.” In Proceedings of the Fourth International Workshop on Semantic Evaluations (Semeval-2007), 70–74.

    Carlo Strapparava and Rada Mihalcea. 2008. “Learning to Identify Emotions in Text.” In Proceedings of the 2008 Acm Symposium on Applied Computing, 1556–60.

    10.1145/1363686 :

    Nafis Irtiza Tripto and Mohammed Eunus Ali. 2018. “Detecting Multilabel Sentiment and Emotions from Bangla Youtube Comments.” In 2018 International Conference on Bangla Speech and Language Processing (Icbslp), 1–6. IEEE.

    Olga Uryupina, Barbara Plank, Aliaksei Severyn, Agata Rotondi, and Alessandro Moschitti. 2014. “SenTube: A Corpus for Sentiment Analysis on Youtube Social Media.” In LREC, 4244–9.

    Notes de bas de page

    1 Copyright  2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    2 https://github.com/RacheleSprugnoli/Esercitazioni_SA/tree/master/dataset

    3 Annotated datasets for emotion analysis have been mainly developed in enterprises and are not public, see for example (Bolioli, Salamino, and Porzionato 2013).

    4 https://webscraper.io/

    5 EN: “Communication for the enterprise, the media and complex organizations”

    6 https://commons.wikimedia.org/wiki/File:Plutchik-wheel.svg

    7 https://i.pinimg.com/originals/83/93/d6/8393d660082c3124a684edc3cade4607.jpg

    8 https://fasttext.cc/docs/en/supervised-tutorial.html

    9 Love is a blend of joy and trust; delight is a dyad made of love and surprise; sentimentality is made of trust and sadness.

    Auteur

    • Rachele Sprugnoli

      CIRCSE Research Centre, Università Cattolica del Sacro Cuore, Largo Agostino Gemelli 1, 20123 Milano – rachele.sprugnoli@unicatt.it

    Précédent Suivant
    Table des matières

    Le texte seul est utilisable sous licence Licence OpenEdition Books. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de livres
    1 / 9
    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    Proceedings of the Second Italian Conference on Computational Linguistics CLiC-it 2015

    3-4 December 2015, Trento

    Cristina Bosco, Sara Tonelli et Fabio Massimo Zanzotto (dir.)

    2015

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    Proceedings of the Third Italian Conference on Computational Linguistics CLiC-it 2016

    5-6 December 2016, Napoli

    Anna Corazza, Simonetta Montemagni et Giovanni Semeraro (dir.)

    2016

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    EVALITA. Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 7 December 2016, Naples

    Pierpaolo Basile, Franco Cutugno, Malvina Nissim et al. (dir.)

    2016

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    Proceedings of the Fourth Italian Conference on Computational Linguistics CLiC-it 2017

    11-12 December 2017, Rome

    Roberto Basili, Malvina Nissim et Giorgio Satta (dir.)

    2017

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018

    10-12 December 2018, Torino

    Elena Cabrio, Alessandro Mazzei et Fabio Tamburini (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian

    EVALITA Evaluation of NLP and Speech Tools for Italian

    Proceedings of the Final Workshop 12-13 December 2018, Naples

    Tommaso Caselli, Nicole Novielli, Viviana Patti et al. (dir.)

    2018

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    EVALITA Evaluation of NLP and Speech Tools for Italian - December 17th, 2020

    Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian Final Workshop

    Valerio Basile, Danilo Croce, Maria Maro et al. (dir.)

    2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Bologna, Italy, March 1-3, 2021

    Felice Dell'Orletta, Johanna Monti et Fabio Tamburini (dir.)

    2020

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021

    Milan, Italy, 26-28 January, 2022

    Elisabetta Fersini, Marco Passarotti et Viviana Patti (dir.)

    2022

    Voir plus de chapitres

    Sentiment Analysis of Latin Poetry: First Experiments on the Odes of Horace

    Rachele Sprugnoli, Francesco Mambrini, Marco Passarotti et al.

    Arretium or Arezzo? A Neural Approach to the Identification of Place Names in Historical Texts

    Rachele Sprugnoli

    Analysing the Evolution of Students’ Writing Skills and the Impact of Neo-standard Italian with the help of Computational Linguistics

    Rachele Sprugnoli, Sara Tonelli, Alessio Palmero Aprosio et al.

    A little bit of bella pianura: Detecting Code-Mixing in Historical English Travel Writing

    Rachele Sprugnoli, Sara Tonelli, Giovanni Moretti et al.

    Raising Interest and Collecting Suggestions on the EVALITA Evaluation Campaign

    Rachele Sprugnoli, Viviana Patti et Franco Cutugno

    Parsing Events: a New Perspective on Old Challenges

    Rachele Sprugnoli, Felice Dell’Orletta, Tommaso Caselli et al.

    The Annotation of Liber Abbaci, a Domain-Specific Latin Resource

    Francesco Grotto, Rachele Sprugnoli, Margherita Fantoli et al.

    KD Strikes Back: from Keyphrases to Labelled Domains Using External Knowledge Sources

    Giovanni Moretti, Rachele Sprugnoli et Sara Tonelli

    Digging in the Dirt: Extracting Keyphrases from Texts with KD

    Giovanni Moretti, Rachele Sprugnoli et Sara Tonelli

    UDante: First Steps Towards the Universal Dependencies Treebank of Dante’s Latin Works

    Flavio M. Cecchini, Rachele Sprugnoli, Giovanni Moretti et al.

    FacTA: Evaluation of Event Factuality and Temporal Anchoring

    Anne-Lyse Minard, Manuela Speranza, Rachele Sprugnoli et al.

    DaDoEval @ EVALITA 2020: Same-Genre and Cross-Genre Dating of Historical Documents

    Stefano Menini, Giovanni Moretti, Rachele Sprugnoli et al.

    Voir plus de chapitres
    1 / 12

    Sentiment Analysis of Latin Poetry: First Experiments on the Odes of Horace

    Rachele Sprugnoli, Francesco Mambrini, Marco Passarotti et al.

    Arretium or Arezzo? A Neural Approach to the Identification of Place Names in Historical Texts

    Rachele Sprugnoli

    Analysing the Evolution of Students’ Writing Skills and the Impact of Neo-standard Italian with the help of Computational Linguistics

    Rachele Sprugnoli, Sara Tonelli, Alessio Palmero Aprosio et al.

    A little bit of bella pianura: Detecting Code-Mixing in Historical English Travel Writing

    Rachele Sprugnoli, Sara Tonelli, Giovanni Moretti et al.

    Raising Interest and Collecting Suggestions on the EVALITA Evaluation Campaign

    Rachele Sprugnoli, Viviana Patti et Franco Cutugno

    Parsing Events: a New Perspective on Old Challenges

    Rachele Sprugnoli, Felice Dell’Orletta, Tommaso Caselli et al.

    The Annotation of Liber Abbaci, a Domain-Specific Latin Resource

    Francesco Grotto, Rachele Sprugnoli, Margherita Fantoli et al.

    KD Strikes Back: from Keyphrases to Labelled Domains Using External Knowledge Sources

    Giovanni Moretti, Rachele Sprugnoli et Sara Tonelli

    Digging in the Dirt: Extracting Keyphrases from Texts with KD

    Giovanni Moretti, Rachele Sprugnoli et Sara Tonelli

    UDante: First Steps Towards the Universal Dependencies Treebank of Dante’s Latin Works

    Flavio M. Cecchini, Rachele Sprugnoli, Giovanni Moretti et al.

    FacTA: Evaluation of Event Factuality and Temporal Anchoring

    Anne-Lyse Minard, Manuela Speranza, Rachele Sprugnoli et al.

    DaDoEval @ EVALITA 2020: Same-Genre and Cross-Genre Dating of Historical Documents

    Stefano Menini, Giovanni Moretti, Rachele Sprugnoli et al.

    Accès ouvert

    Accès ouvert

    ePub

    PDF

    PDF du chapitre

    1 Copyright  2020 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    2 https://github.com/RacheleSprugnoli/Esercitazioni_SA/tree/master/dataset

    3 Annotated datasets for emotion analysis have been mainly developed in enterprises and are not public, see for example (Bolioli, Salamino, and Porzionato 2013).

    4 https://webscraper.io/

    5 EN: “Communication for the enterprise, the media and complex organizations”

    6 https://commons.wikimedia.org/wiki/File:Plutchik-wheel.svg

    7 https://i.pinimg.com/originals/83/93/d6/8393d660082c3124a684edc3cade4607.jpg

    8 https://fasttext.cc/docs/en/supervised-tutorial.html

    9 Love is a blend of joy and trust; delight is a dyad made of love and surprise; sentimentality is made of trust and sadness.

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    X Facebook Email

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Ce livre est cité par

    • Miaschi, Alessio. Alzetta, Chiara. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2023) Testing the Effectiveness of the Diagnostic Probing Paradigm on Italian Treebanks. Information, 14. DOI: 10.3390/info14030144
    • Miaschi, Alessio. Sarti, Gabriele. Brunato, Dominique. Dell’Orletta, Felice. Venturi, Giulia. (2022) Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties. Italian Journal of Computational Linguistics, 8. DOI: 10.4000/ijcol.965
    • Saga, Satoshi. Shirakawa, Kanta. (2025) Investigating the Effect of Pseudo-Haptics on Perceptions Toward Onomatopoeia Text During Finger-Point Tracing. Multimodal Technologies and Interaction, 9. DOI: 10.3390/mti9100100
    • (2025) Book reviews. Yearbook of Phraseology, 16. DOI: 10.1515/phras-2025-0012

    Ce chapitre est cité par

    • Sprugnoli, Rachele. Mambrini, Francesco. Passarotti, Marco. Moretti, Giovanni. (2023) The Sentiment of Latin Poetry. Annotation and Automatic Analysis of the Odes of Horace. Italian Journal of Computational Linguistics, 9. DOI: 10.4000/ijcol.1125
    • Narrative Roads to Rebuild China's Global Image -Sentiment Analysis of Twitter Activities after China's Covid-19 Aid Activities in Italy(2023) . DOI: 10.1145/3644479.3644482
    • Semeraro, Alfonso. Vilella, Salvatore. Improta, Riccardo. De Duro, Edoardo Sebastiano. Mohammad, Saif M.. Ruffo, Giancarlo. Stella, Massimo. (2025) EmoAtlas: An emotional network analyzer of texts that merges psychological lexicons, artificial intelligence, and network science. Behavior Research Methods, 57. DOI: 10.3758/s13428-024-02553-7
    • EmotionAlBERTo: Emotion Recognition of Italian Social Media Texts Through BERT(2022) . DOI: 10.1109/ICPR56361.2022.9956403
    • Sprugnoli, Rachele. Mambrini, Francesco. Passarotti, Marco. Moretti, Giovanni. (2022) Proceedings of the Eighth Italian Conference on Computational Linguistics CliC-it 2021. DOI: 10.4000/books.aaccademia.10854
    • Zhang, Shibingfeng. Fernicola, Francesco. Garcea, Federico. Bonora, Paolo. Barrón-Cedeño, Alberto. (2022) AriEmozione 2.0: Identifying Emotions in Opera Verses and Arias. Italian Journal of Computational Linguistics, 8. DOI: 10.4000/ijcol.1039
    • Koptyra, Bartłomiej. Ngo, Anh. Radliński, Łukasz. Kocoń, Jan. (2023) Lecture Notes in Computer Science Computational Science – ICCS 2023. DOI: 10.1007/978-3-031-35995-8_26
    • Semeraro, Alfonso. Vilella, Salvatore. Ruffo, Giancarlo. (2021) PyPlutchik: Visualising and comparing emotion-annotated corpora. PLOS ONE, 16. DOI: 10.1371/journal.pone.0256503
    • Forciniti, Alessia. Zavarrone, Emma. Paolillo, Mirella. (2024) Emotion recognition in italian political language for prefiguring crisis in the balance of the parties’ coalitions. Quality & Quantity, 58. DOI: 10.1007/s11135-023-01729-1
    • Koufakou, Anna. Nieves, Elijah. (2025) Review of recent emotion-annotated text corpora and resources. Language Resources and Evaluation, 59. DOI: 10.1007/s10579-025-09828-1
    • De Santis, Francesco. Bich, Philippe. Ciravegna, Gabriele. Barbiero, Pietro. Giordano, Danilo. Cerquitelli, Tania. (2025) Linearly-interpretable concept embedding models for text analysis. Machine Learning, 114. DOI: 10.1007/s10994-025-06839-5
    • Domingues Aparecido, Thales David. Carrillo, Alexis. Camargo, Chico Q.. Stella, Massimo. (2025) Benchmarking Psychological Lexicons and Large Language Models for Emotion Detection in Brazilian Portuguese. AI, 6. DOI: 10.3390/ai6100249
    • Manai, Simone. Gemme, Laura. Zanoli, Roberto. Lavelli, Alberto. (2025) The IDRE Dataset in Practice: Training and Evaluation of Small-to-Medium-Sized LLMs for Empathetic Rephrasing. Electronics, 14. DOI: 10.3390/electronics14204052

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Sprugnoli, R. (2020). MultiEmotions-It: a New Dataset for Opinion Polarity and Emotion Analysis for Italian. In F. Dell’Orletta, J. Monti, & F. Tamburini (éds.), Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8910
    Sprugnoli, Rachele. « MultiEmotions-It: A New Dataset for Opinion Polarity and Emotion Analysis for Italian ». In Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta, Johanna Monti, et Fabio Tamburini. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8910.
    Sprugnoli, Rachele. « MultiEmotions-It: A New Dataset for Opinion Polarity and Emotion Analysis for Italian ». Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020, édité par Felice Dell’Orletta et al., Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8910.

    Référence numérique du livre

    Format

    Dell’Orletta, F., Monti, J., & Tamburini, F. (éds.). (2020). Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-it 2020. Torino: Accademia University Press. https://doi.org/10.4000/books.aaccademia.8203
    Dell’Orletta, Felice, Johanna Monti, et Fabio Tamburini, éd. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Torino: Accademia University Press, 2020. doi:10.4000/books.aaccademia.8203.
    Dell’Orletta, Felice, et al., éditeurs. Proceedings of the Seventh Italian Conference on Computational Linguistics CLiC-It 2020. Accademia University Press, 2020, https://doi.org/10.4000/books.aaccademia.8203.
    Compatible avec Zotero Zotero

    1 / 3

    Accademia University Press

    Accademia University Press

    • Plan du site
    • Se connecter

    Suivez-nous

    • Facebook
    • Flux RSS

    URL : http://www.aaccademia.it/

    Email : info@aaccademia.it

    Adresse :

    Accademia University Press

    Via Carlo Alberto 55

    I‐10123

    Torino

    Italia

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement