1 The DiDi Project
1The autonomous Italian province of South Tyrol is characterized by a multilingual environment with three official languages (Italian, German, and Ladin), an institutional bior trilingualism (depending on the percentage of the Ladin population), and diverse individual language repertoires (Ciccolone, 2010).
2In the regionally funded DiDi project1, the goal was to build a South Tyrolean CMC corpus to document the current language use of residents and to analyse it socio-linguistically with a focus on age. The project initially focused on the Germanspeaking language group. However, all information regarding the project, e.g. the invitation to participate, the privacy agreement, the project web site, and the questionnaire for socio-demographic data was published in German and Italian. Hence, we attracted speakers of both Italian and German. Accordingly, the collected data is multilingual, with major parts in German but with a substantial portion in Italian (100,000 of 600,000 tokens).
3The collected multilingual CMC corpus combines Facebook status updates, comments, and private messages with socio-demographic data (e.g. language biography, internet usage habits, and general parameters like age, gender, level of education) of the writers. The data was enriched with linguistic annotations on thread, text and token level including language-specific part-of-speech (PoS) and lemma information, normalisation, and language identification.
4In this paper, we describe the corpus with respect to its multilingual characteristics and give special emphasis to the Italian part of the corpus to which we added manually corrected PoS annotations. Hence, it presents a continuation of Frey et al. (2015) which was restricted to German texts of the corpus, not taking into account the full variety of data collected for the total corpus.
2 Corpus Construction
5For the purpose of the DiDi project, we collected language data from social networking sites (SNS) and combined it with socio-demographic data about the writers obtained from a questionnaire. We chose to collect data from Facebook as this SNS is well known in South Tyrol, hosts a wide variety of different communication settings, and is used over the whole territory by nearly all groups of the society.
6Related research mainly draws on public data such as public Facebook groups, Twitter or chat data (e.g. Celli and Polonio (2013), Basile and Nissim (2013), Burghardt et al. (2016), Beißwenger (2013)), excluding the possibility to analyse discourse patterns of non-public everyday language use.
7Collecting non-public and personal data for the DiDi corpus raised technical issues regarding Italian privacy regulations (which require user consent incl. privacy statement), the time-saving acquisition of authentic and complete language data, and the assignment of language data to questionnaire data. These issues have been solved by developing a Facebook application2 that allowed for the gathering of all three sorts of data (user consent, language data, questionnaire data) at once. In addition, the application was easy to share via Facebook which helped to promote the project and to reach many potential participants. While data collection was solely managed by the Facebook application, we relied on Facebook’s in-platform means (i.e. users’ sharing and liking) to recruit participants. In order to reach older users (> 50 years) it was necessary to additionally resort to Facebook advertisment3.
8With the consent of each participant, the data was downloaded via the Facebook Graph API4 and from the used questionnaire service5, and stored in a local MongoDB6 data base. Both entities were linked via randomised unique identifiers. A python interface provided access points to retrieve user and text data from the data base in a linked and structured format, and also allowed to rebuild the conversational structure of threads by linking successive text objects together. This information can now be used to analyse turn-taking and language choices within threads7.
3 Corpus Annotations
- 8 See Frey et al. (2015) for detailed information on the anonymisation procedure and the normalisatio (...)
9This section describes the annotations added during the process of corpus construction8.
3.1 Socio-demographic Information about Participants
10The corpus provides the following sociodemographic information about the participants obtained from the online questionnaire: gender, education, employment, internet communication habits, communication devices in use, internet experience, first language(s) (L1), and usage of a South Tyrolean German or Italian dialect and its particular origin.
3.2 Linguistic Annotation of Texts
11The corpus was annotated on text and token level with a series of information.
-
Language identification:
The used languages of a text were identified in a semi-automatic approach: Firstly, using the language identification tool langid.py (Lui and Baldwin, 2012), and secondly, manually correcting short texts and texts with a low confidence score.
-
Tokenisation:
The corpus was tokenized with the Twitter tokenizer ark-twokenize-py9 and subsequently corrected manually for non-standard language tokenisation issues.
-
Part-of-speech tagging and lemmatization:
(Corrected) tokens were annotated with PoS tags and lemma information considering the predominant language of the text at hand. We tagged Italian texts with the Italian tag set of the Universal Dependencies project10 using the RDR PoS Tagger (Nguyen et al., 2014). Subsequently, we manually corrected PoS annotations to handle bad tagging accuracy for social media texts. Additionally, we used the TreeTagger (Schmid, 1994; Schmid, 1995) to assign PoS tags for German, English, Spanish, French and Portuguese texts applying the standard tagsets for each language. No manual correction was performed for these languages.
-
Normalisation:
So far, we have manually normalised nonstandard language to word-by-word standard transcriptions only for German texts.
-
Variety of German:
We classified German texts as dialect, nondialect or unclassifiable texts applying a heuristic approach based on the normalisation.
-
Untranslatable dialect lexemes:
We have created a lexicon for untranslatable dialect words encountered during manual normalisation. The dialect lexicon was used to post-process out-of-vocabulary (OOV) tokens in the corpus.
-
Foreign language insertions:
The most common OOV tokens that we manually classified as foreign language vocabulary have been annotated with information about their language origin.
-
CMC phenomena:
Emoticons, emojis, @mentions, hashtags, hyperlinks, and iterations of graphemes and punctuation marks were annotated automatically using regular expressions.
-
Topic of the text:
In order to investigate context factors of language choice we annotated texts as either political or non-political according to a list of politicians, political parties and political terms.
3.3 Conversation-related Annotations
12We rebuilt conversation threads by linking successive texts and created thread objects containing ordered lists of texts that are accessible via the Python interface. Thread objects contain information about the used languages and the number of active interlocutors and recipients of a message as well as the time passed between two texts.
13As described in Frey et al. (2015), no text content of non-participants of the DiDi project was stored, but general information about the publishing time and the language of the text was kept. If all interlocutors of a thread were participants of the project, the whole conversation is available.
3.4 User-related Annotations
14In addition to socio-demographic data, we added information about the users’ (multilingual) communicational behaviour, i.e. their primary language, used languages and the number of interlocutors.
4 Corpus Data
4.1 Corpus Size
15The DiDi corpus comprises public and non-public language data of 136 South Tyrolean Facebook users. The users could choose to provide either their Facebook wall communication (status updates and comments), their chat (i.e. private messages) communication or both. In the end, 50 people provided access to both types of data. 80 users only provided access to their Facebook wall and 6 users gave us only their chat communication. In total, the corpus consists of around 600 thousand tokens that are distributed over the text categories status updates (172 ,66 tokens), comments (94,512 tokens) and chat messages (328,796 tokens).
4.2 Multilingualism in the Corpus
16The corpus is highly multilingual. Although the initial intention of the project was to document the use of German in South Tyrol, German language content comprises only 58% of the corpus. 13% are written in Italian and 4% in English (the remainder of the messages was either classified as unidentifiable language, non-language or other language). The distribution of the languages is based on the language backgrounds of the participants and is comparable to the multilingual community of South Tyrol. The following tables show the distribution of profiles, texts and tokens (table 1) and text type (table 2) by L1.
Table 1: Distribution of profiles, texts and tokens by L1.
User L1
|
Profiles
|
Texts
|
Tokens
|
IT
|
9
|
4,260
|
80,368
|
DE
|
108
|
29,883
|
421,262
|
other
|
3
|
407
|
8,643
|
IT + DE
|
11
|
4,165
|
75,359
|
DE + other
|
5
|
1,110
|
10,642
|
Total
|
136
|
39,825
|
596,274
|
Table 2: Distribution of texts by text type (SU = status updated, CO = comments, PM = private messages) by L1.
User L1
|
SU
|
CO
|
PM
|
IT
|
1,682
|
1,063
|
1,515
|
DE
|
7,286
|
4,890
|
17,707
|
other
|
172
|
45
|
190
|
IT+DE
|
1,962
|
343
|
2,791
|
DE+other
|
1,031
|
166
|
13
|
Total
|
11,102
|
6,507
|
22,216
|
17While very few users wrote only in their first language, most users used at least two (88%), very often even three (73%) or more (51%) languages. Table 3 shows the number and proportion of German, Italian and English texts written as first or second/foreign language.
Table 3: Distribution of text language by L1 or L2 use.
Text written
|
as L1
|
as L2
|
IT
|
4,761 (57%)
|
3,566 (42%)
|
DE
|
23,191 (99%)
|
170 (1%)
|
EN
|
166 (4%)
|
3,625 (96%)
|
All languages
|
28,120 (78%)
|
7,842 (22%)
|
18In terms of multilingual language use in the DiDi corpus, we observe a slight difference between Italian and German-speaking users. L1 Italian speakers stick more to their L1 compared to the German-speaking participants, who are characterized by a higher usage of L2 Italian. The comparison of L1 and L2 usage in status updates, comments and private messages (c.f. Table 4) shows that the respective L1 is preferred in all messages types. We find the highest percentage of second or foreign language use in status updates, whereas in comments and private messages around 75% of the texts are written in L1.
Table 4: Distribution of L1 and L2 use by text types.
Text written
|
as L1
|
as L2
|
Status updates
|
6,774 (61%)
|
3,032 (27%)
|
Comments
|
5,089 (78%)
|
924 (14%)
|
Messages
|
16,257 (73%)
|
3,886 (17%)
|
Total
|
28,120 (71%)
|
7,842 (20%)
|
- 11 Texts were annotated as mixed-language texts during the correction of the language identification, (...)
19Finally, we observed 4,295 code-switching instances on conversation level and at least 1,653 texts that contain multiple languages11. The average number of code-switching instances per user is 10%, meaning that every tenth text does not continue the language of the previous text in the thread (the maximum was around every second text, i.e. 42%). The average proportion of text with multiple languages per user is 4% (max. 25%).
5 Issues in Corpus Creation
20In addition to general issues of working with social media texts (e.g. text processing on noisy, short texts as described for example in (Baldwin et al., 2013; Eisenstein, 2013)), the high diversity in used languages and varieties in our corpus led to various restraints in corpus creation and processing as cross-lingual annotation and information extraction are still crucial problems in natural language processing. We tried to address the demands of a multilingual corpus by providing language specific PoS tagging and by applying language independent annotations. We are aware of the fact that this is by no means sufficient to deal with linguistic research questions that exceed language boundaries. Moreover, manual correction tasks occupied a significant part of the work on the corpus as automatic annotation (e.g. for language identification) does not yet provide the accuracy expected for linguistic studies (Carter et al., 2013; Lui and Baldwin, 2014).
6 Conclusion and Future Work
21In this paper we presented a freely available language corpus of Facebook user profiles from South Tyrol, Italy. The multilingual corpus is anonymised and annotated with socio-demographic data of users, language specific (and for Italian manually corrected) PoS tags, lemmas and linguistic annotations mainly related to used languages, varieties and multilingual phenomena. The corpus is accessible for querying via ANNIS12 or can be obtained as processable data for research purposes on http://www.eurac.edu/didi.
Acknowledgements
22The project was financed by the Provincia autonoma di Bolzano – Alto Adige, Ripartizione Diritto allo studio, università e ricerca scientifica, Legge provinciale 13 dicembre 2006, n. 14 ”Ricerca e innovazione”.