• Contenu principal
  • Menu
OpenEdition Books
  • Accueil
  • Catalogue de 16080 livres
  • Éditeurs
  • Auteurs
  • Facebook
  • X
  • Partager
    • Facebook

    • X

    • Accueil
    • Catalogue de 16080 livres
    • Éditeurs
    • Auteurs
  • Ressources numériques en sciences humaines et sociales

    • OpenEdition
  • Nos plateformes

    • OpenEdition Books
    • OpenEdition Journals
    • Hypothèses
    • Calenda
  • Bibliothèques

    • OpenEdition Freemium
  • Suivez-nous

  • Lettre d’information
OpenEdition Search

Redirection vers OpenEdition Search.

À quel endroit ?
  • Presses universitaires de Franche-Comté
  • ›
  • Les Cahiers de la MSHE Ledoux
  • ›
  • Formaliser les langues avec l’ordinateur...
  • ›
  • Troisieme partie. Analyse syntaxique
  • ›
  • 18. Mapping, filtering and measuring imp...
  • Presses universitaires de Franche-Comté
  • Presses universitaires de Franche-Comté
    Presses universitaires de Franche-Comté
    Informations sur la couverture
    Table des matières
    Liens vers le livre
    Informations sur la couverture
    Table des matières
    Formats de lecture

    Plan

    Plan détaillé Texte intégral I. Mapping ambiguity in the Portuguese DELAFII. Measuring the impact of ambiguity in a Portuguese corpusIII. Disambiguation grammar of past participle in compound tenses with ter (to have) : a case studyIV. Exotic wordsConclusion Bibliographie Annexe Notes de bas de page Notes de fin Auteurs

    Formaliser les langues avec l’ordinateur : de INTEX à Nooj

    Ce livre est recensé par

    Précédent Suivant
    Table des matières

    18. Mapping, filtering and measuring impact of ambiguous words in Portuguese1

    Jorge Baptista et Luís Faísca

    p. 305-324

    Texte intégral Bibliographie Bibliographie Annexe Appendix Notes de bas de page Notes de fin Auteurs

    Texte intégral

    I. Mapping ambiguity in the Portuguese DELAF

    1The Portuguese DELAF (v. 2), built by the LabEL team2, has been publicly available since 2002. It contains 936,215 entries, consisting of 889,986 different inflected forms. There are 43,127 different ambiguous inflected forms, that is, word forms belonging to different categories and / or lemmas, which correspond to 89,356 DELAF ambiguous entries3. For example, the inflected word capital (capital) is ambiguous because it has three entries in the DELAF4 :

    capital, capital. A : ms : fs

    (as in pena capital, “death penalty”)

    capital, capital. N : fs

    (the first city of a country)

    capital, capital. N : ms

    (funds for investement)

    2It is possible to obtain the full list of different, inflected, ambiguous forms with the grammatical categories associated to them5. The three entries above are thus factorized as :

    capital, A_N_N

    3About 10 % of Portuguese DELAF entries are ambiguous words, which correspond to 4.85 % of the DELAF different inflected forms.

    1. Ambiguity class (AC)

    4One can consider A_N_N an ambiguity class (AC). There are 137 ambiguity classes in the DELAF. The number of ambiguous word forms per ambiguity class is very uneven (Table 1) :

    Table 1 : Distribution of ambiguity classes (AC) per number of ambiguous word forms (WF)

    Image 10000000000002940000012CD50CAE5C46CB4F8F.jpg

    5There are 56 ambiguity classes (40.88 %) with only one word form. The quantitatively more important ambiguity classes are (Table 2) :

    Table 2 : Quantitatively more important ambiguity classes (AC)*

    Image 100000000000028800000150A4750F15A40DE891.jpg

    *WF = number of word forms per ambiguity class ;
    % WF = percentage of total number of word forms (43,127)

    6The 7 largest ambiguity classes represent 97.15 % of the ambiguous word forms of the DELAF ; the A_N ambiguity class alone contains more than 56 % of the total of the ambiguous word forms.

    2. Ambiguity level (Amb)

    7Each ambiguity class corresponds to a certain ambiguity level (Amb). For instance, for the A_N class Amb = 2, while for A_N_V class Amb = 3, and so on. Distribution of ambiguity classes by the ambiguity level of their word forms is shown below (Table 3) :

    Table 3 : Distribution of ambiguity classes (AC) by ambiguity level (Amb)*

    Image 1000000000000275000000C24DA7F4528531782A.jpg

    *WF = number of word forms per ambiguity class ;
    % WF = percentage of total number of word forms (43,127).

    8The majority of the ambiguous word forms show Amb = 2 (93.51 %), or Amb = 3 (5.87 %), but the number of ambiguity classes with Amb = 2 is slightly less (40) than that with Amb = 3 (50). The most ambiguous word forms present Amb = 6, but there are only two words of this kind, each one belonging to a different ambiguity class. The distribution of the most important ambiguity classes with Amb = 2 is shown below (Table 4).

    9Five ambiguity classes with Amb = 2 stand out as the most prominent : N_N, V_V, N_V, A_V and A_N. Together, these five classes constitute about 92.5 % of the ambiguous words of DELAF, with A_N ambiguity class alone representing more than half.

    Table 4 : Ambiguity classes (AC) with ambiguity level Amb = 2*

    Image 100000000000022D000001C0B1EA64E562269725.jpg

    *WF = number of word forms per ambiguity class ; % WF = percentage of total number of word forms (43,127).

    3. Ambiguity types (AT)

    10It is also possible to consider different ambiguity types, i.e., ntuples of categories involved in different ambiguity classes. For example, in ambiguity class A_N_V there are three (binary) ambiguity types : A/N, A/V and N/V, besides the (ternary) A/N/V ambiguity type. An ambiguity type involves different ambiguity classes. For example, here are the 25 ambiguity classes where the ambiguity type A/V may be found (Table 5).

    11As we can see, the ambiguity class A_V alone contains most of the word forms presenting this ambiguity type (82.6 %), followed by class A_N_V (15 %). The remaining classes are quantitatively less important. On the other hand, the A/V ambiguity type involves ambiguity classes were all other categories are represented.

    Table 5 : Ambiguity type A/V*

    Image 100000000000023E00000256A323AD64A47B3AAE.jpg

    AC = ambiguity class, WF = number of word forms per ambiguity class ; % WF = percentage of total number of word forms (43,127) ; %AT = percentage of total number of word forms involving this ambiguity type (8,774) ; Amb = ambiguity level.

    4. Using ambiguity information with DELAF

    12The three types of information on ambiguity – Amb (ambiguity level), AC (ambiguity class) and AT (ambiguity type) – can be added to the DELAF : it is possible to build a priority DELAF of ambiguous words where this information is given, as in the following entries of capital :

    capital, capital. A+Amb=3+AC=A_N_N+AT=A/N+AT=N/N : ms : f s
    capital, capital. N+Amb=3+AC=A_N_N+AT=A/N+AT=N/N : fs
    capital, capital. N+Amb=3+AC=A_N_N+AT=A/N+AT=N/N : ms

    13This information could then be used on disambiguation grammars, as we will see below.

    II. Measuring the impact of ambiguity in a Portuguese corpus

    1. Preliminaries

    14In order to see how ambiguity affects real texts, we have applied the Portuguese DELAF to a large corpus of Portuguese journalistic text, the CETEMPúblico corpus6, using INTEX (v. 4.31)7. Here are raw results from lexical analysis of this text (Table 6).

    15The corpus contains about 12.8 million tokens (9.7 million simple words). About 8.96 million simple words were identified by the DELAF (92.324 % of the text words). The simple word dictionary of the text (DLF) contains 103,045 entries and 83,690 different inflected forms (46.67 % of the corpus different simple words).

    Table 6 : Lexical analysis of CETEMPúblico (Part 01) corpus using DELAF

    Image 1000000000000288000000D4337D363CCE26A92C.jpg

    16A finite-state transducer (FST)8, allows the (tentative) tagging of proper nouns (N+Nprop ; Silberztein 2000 :123), i.e. simple words beginning in capital letter, followed by another letter, and not previously identified by the DELAF (Fig.1) :

    Fig. 1 : Npr+.fst

    Image 10000000000001FD00000076317B84161E63FE33.jpg

    17In this FST, <U> stands for any uppercase letter from the alphabet, while <W> stands for any letter. There are 57,275 different tokens that may be (tentatively) tagged in this way (31.963 % of the corpus different simple words), otherwise, they would not be recognised and would then be considered unknown tokens (ERR). The remaining 15,175 different words (8.468 % of the corpus different simple words) were left as unknown (ERR). For the purposes of this paper, the list of unknown tokens, ERR, and the list of tokens tagged by the Npr+.fst were not taken into consideration. We will thus focus on the remaining words that form the dictionary of simple words of the text (DLF).

    2. The DLF of the CetemPúblico (Part 01) corpus

    18The distribution of the DLF lexical entries by ambiguity level is shown below (Table 7) :

    Table 7 : Distribution of the simple word dictionary of the CETEMPúblico (Part 01) corpus by ambiguity level (Amb).

    Image 1000000000000294000000DC4113545F2A702416.jpg

    DIF = number of different inflected forms of the DLF ; % DIF = percentage of total number of forms of the DLF (83,690) ; LE = number of lexical entries of the DLF ; % LE = percentage of total number of lexical entries of the DLF (103,046) ; FRQ = frequency, i.e., number of tokens ; % FRQ = percentage of total number of tokens (8,960,421) ; PROD = Amb*FRQ ; % PROD = percentage of total PROD (17,691,627).

    19In the first place, it is interesting to verify that almost 80 % of the DLF different inflected forms (DIF) are non-ambiguous and represent 64,57 % of DLF entries9.

    20As it is now possible to associate the DIF list to the frequency list of the corpus’ tokens, we can see that non-ambiguous words represent about 44.52 % of the tokens. This constitutes a first approximation to the degree of ambiguity of the corpus’ words, for it means that more than a half (55.48 %) of the corpus different tokens is ambiguous.

    21However, we proposed (Baptista e Faísca 2001) another measure for evaluating the impact of ambiguity in a text. The weight of an ambiguous word to the global ambiguity of a text may be viewed as the product of its ambiguity level (Amb) by its frequency (FRQ). In the absence of a better name, we plainly called it product (PROD). This measure seems more adequate than mere frequency, for it is related with the number of analysis that must removed from the text in the process of reducing its ambiguity. Any gain in ambiguity reduction can be calculated as the difference between the total PROD (17,691,627) and the remaining PROD after the disambiguation process has been carried out. The base-line would be a figure corresponding to the total disambiguation of the texts words, that is, the sum of their frequencies (8,960,421).

    22Considering this PROD measure, it is now clear that even if non-ambiguous words are a substantial part of a text’s tokens, ambiguous words contribute significantly (77.452 %) to the global ambiguity of a corpus such as this. Here we find something that can be viewed as a surprise : while frequency values associated to each ambiguity level are quite different, the impact of ambiguity classes with Amb = 3 to 5 is relatively similar, even if ambiguity classes with Amb = 2 reflect a greater impact.

    3. The dlf of the tokens’ frequency list of the CetemPúblico corpus

    23We tried to verify if there were significant changes when, instead of just Part 1 (with less than 10 million words), we would consider the ambiguity of the entire CetemPúblico corpus (that contains about 200 million words). For this, we used the frequency list of the corpus10. The distribution of tokens by ambiguity level is shown in Table 8.

    Table 8 : Distribution of the simple word dictionary of the CETEMPúblico corpus by ambiguity level (Amb)

    Image 1000000000000242000001CC7E0A016AF174189D.jpg

    DIF = number of different inflected forms in the DLF ; % DIF = percentage of total number of forms in the DLF (157.989) ; LE = number of lexical entries ; % LE = percentage of total number of lexical entries (186.239) ; FRQ = frequency, i.e., number of tokens in the corpus ; % FRQ = percentage of total number of tokens (159.899.990) ; PROD = Amb*FRQ ; % PROD = percentage of total PROD (17,691,627).

    24It the first place, while the number of tokens of the entire corpus is 17.8 times larger than that of Part 1, the number of different word forms and the number of lexical entries is just about twice as large. Still, even with such a large corpus, DIF only constitute 17,752 % of the entire DELAF different inflected forms, while DE represents 19,893 % of DELAF lexical entries Secondly, when we compared the difference between the percentages for DIF, LE, FRQ and PROD by ambiguity level among the two corpora (Table 9), we find that they were, for the most part, minimal :

    Table 9 : Difference between the percentages of DIF, LE, FRQ and PROD by ambiguity level in the entire CETEMPúblico (CP) and only in Part 1 (P1)

    Image 1000000000000298000000D3EFA7F7F146EDAB3F.jpg

    25The only significant differences were : the percentage of non-ambiguous different inflected forms (DIF) and of lexical entries (LE) in the DLF of the entire CETEMPúblico is slightly larger than that of Part 1. However, the percentage of FRQ and of PROD is smaller, therefore, the impact on the corpora global ambiguity of ambiguous words with Amb = 2 or 3 is slightly larger (2.8 %), especially for words with Amb = 3 (1.91 %).

    26It is thus reasonable to assume that most observations regarding ambiguity in Part 1 will also hold for the entire CETEMPúblico corpus.

    III. Disambiguation grammar of past participle in compound tenses with ter (to have) : a case study

    27We begin by explaining that in Portuguese, the past participle, noted <V : K> in the DELAF and abbreviated as K in this paper, is an invariable form of the verb, only used in compound tenses with temporal auxiliary ter (to have) and (more rarely, and quickly becoming obsolete) haver (to there be)11 as in :

    O João cumprimentou a Maria
    John greeted Mary
    O João (tinha +havia) cumprimentado a Maria
    John has greeted Mary

    28There are 11,374 K in the Portuguese DELAF. In many cases (5,301), K is ambiguous with words of other categories, mainly with adjectives. In fact, the ambiguity type A/V :k affects 5,182 word forms, which represents 97.755 % of K ambiguous forms and constitutes 59,061 % of all ambiguity classes with ambiguity type A/V.

    29In view of identifying the compound tense, it is necessary to disambiguate K. Usually, general-purpose disambiguation grammars, such as the one shown below (Fig.2) only use the grammatical categories available in the DELAF.

    30This grammar can be viewed as a first approach, obviously very incipient, to the compound past tense disambiguation problem.

    31When we apply this grammar to the CETEMPúblico (Part 1), we obtain 27,327 matches from the 145,998 occurrences of ambiguous K word forms. Naturally, the next step is to evaluate the results of this grammar. In this sense, we think that ambiguity information can be useful to identify the cases where the grammar could be improved or to detect problems in the dictionary. Results are shown in Table 10, sorted by ambiguity level.

    Fig. 2 : Disambiguation grammar Ter_Vk.fst

    Image 100000000000027A0000010DC09E27E752786596.jpg

    Table 10 : Ambiguous <V : K> in the DELAF

    Image 10000000000002910000036258E92C0DE282FCA2.jpg

    Amb = ambiguity level ; AC = Ambiguity class ; DIF=Different inflected forms (in the DELAF) ; WF-P1 = different word forms (in the corpus) ; FRQ-P1 = frequency (in the corpus) ; WF-fst = different word forms retrieved by the FST ; FRQ-fst = frequency. For each column, we indicated the percentages, based on the total of that column. For formatting reasons, the first two columns were repeated.

    32In order to evaluate the performance of the grammar, we added to the table the non-ambiguous K entries of the DELAF. For each ambiguity level we indicate the ambiguity classes involved. The number of different inflected forms in the DELAF concerns only K forms. We calculated their total frequency in the corpus and the number of occurrences matched by the grammar.

    33The impact of K forms in the total PROD of CETEMPúblico (17,691,627 ; see §2.1) is only 1.934 %, but as one can see, it involves 145,998 occurrences.

    a) Amb=1 (non-ambiguous K forms)

    34Theoretically, the non ambiguous K forms (Amb = 1) should had been all be matched by the grammar. In fact success rate is high (88.279 %) but 1,031 occurrences of K forms were not matched by the grammar12.

    35Looking through the concordances of non-ambiguous K not detected by the grammar, we found many forms that can also function as adjectives, in predicative construction with copulatives ser and estar and even in attributive position next to a noun. These forms were not marked as adjectives in the DELAF :

    Segundo a jovem, Emmet Roy foi acometido de dores está fundeado na Baía de Cascais

    36In many cases, theses adjectives are attested in adnominal attribute position :

    90 dias num barco fundeado a 500 metros de Monróvia

    37Some non-ambiguous K appear in the <haver> <V : K> compound tense, not described here :

    muitas ambulâncias haviam afluído ao local

    38There are some K forms that are ambiguous with proper nouns. This is the case of Chiado (a commercial area in downtown Lisbon ; 158 occurrences) and Granado (a proper (family) name ; 28 occurrences) :

    queremos recuperar o prestígio do velho Chiado
    a resposta (oral) que dei ao jornalista António Granado

    39Of course, ambiguity between K forms and proper names were not considered.

    b) Amb > 1 (ambiguous K forms)

    40The number of matches of ambiguous K forms with Amb>1 is very low (an average of 14 %). This comes naturally from the fact that the more a word has other categories, the less likely is it to appear as a K in a compound tense. Other disambiguation grammars should be built in order to solve some of the predicative and attributive uses of adjectives belonging to the A/V : k ambiguity type.

    41Even for the matched occurrences, success rate is not satisfactory, because the grammar eliminates correct analysis, i.e., it produces significant silence. For instance, there are some N of the N/V : k ambiguity type that can have ter as a support verb. Ambiguity class A_INTERJ_N_V is one of these cases. It contains three forms : cuidado, obrigado, sentido. Looking to the concordances where these forms appear, it was possible to determine the silence produced by the grammar :

    Table 11 : Ambiguous <V : K> in the DELAF : Ambiguity class A_INTERJ_N_V

    Image 100000000000028800000081D063E42A2BB027AD.jpg

    Number of forms per category matched by the grammar. % = success rate, i.e. percentage of forms correctly tagged as K.

    42The success rate varies considerably : while cuidado was incorrectly tagged most of the times, with obrigado it was just the opposite ; in the case of sentido, about half of the tags were correct.

    43However, this may not be always the case. With class A_N_V_V13, in spite of the fact that there is potential N analysis, the grammar shows a 100 % success rate.

    44Considering that any disambiguation grammar should avoid producing silence, it is possible to increase precision. This can be done by reducing the scope of the grammar using the information of ambiguity class. In most of the cases where correct analysis were eliminated, this was due to the fact the word was not a <V : K>, but a <N>. If, instead of just using the tag <V : K>, we use the same grammar but with tags stating the ambiguity class, leaving out only the classes were an analysis as <N> is potentially possible, it should be possible to obtain higher success rates. This was in fact the case : for the A_V class alone, success rate is very high (around 99 %)14.

    45For the remaining ambiguity classes, the use of ambiguity information to identify problematic ambiguous word forms can help devising different strategies to constraint the general grammar shown above and to improve its performance.

    IV. Exotic words

    1. A filter for ambiguous exotic words

    46There are many ambiguous words in the DELAF that present some analyses that are very unlikely to occur in texts. For example, the words uma and umas, among other analysis (as DET), can be tagged as inflected forms of an extremely rare verb umar (an intransitive verb said about wood that gets wet). The word uma belongs to class DET_DET_V (Amb = 3), while umas is a DET_V (Amb = 2). These words appear 82,302 and 664 times in the corpus, which results in a very high impact in text global ambiguity : PROD = 248,234. If we remove the V analysis from the DELAF, using a filter, we obtain substantial reduction of PROD to 165,268.

    47The general purpose of building lexical filters is to reduce the noise produced during lexical analysis of texts, but maintaining a low and controlled level of silence, in order to improve the following steps in the text’s processing. It is only a facultative tool, to be used with care, surely. But it is also a useful tool, especially when it is meant to be a part of applications were high efficiency is paramount to the objective of 100 % correctness (at the current state of the art, this goal is still a mirage).

    48In a previous paper (Baptista & Faísca 2001), we have used frequency information associated to the ambiguous words of CetemPúblico (Part 1) to identify the 560 most frequent ambiguous exotic word forms15 and to produce a filter that eliminates those exotic analyses. The 17,047 % ambiguity reduction thus obtained16 may be viewed as an important contribution to the disambiguation task in the general processing of texts.

    49This approach can be seen as complementary with the approach that consist of structuring the lexicon by levels (Garrigues 1992). Furthermore, it presents the advantage that only some of the inflected forms of a lexical entry (the ambiguous forms) are affected.

    50It is possible to use ambiguity information to guide the discovery of exotic words and to help constructing different types of filters. Two examples are given below.

    2. X-áveis

    51Many second person-plural past-imperfective verb forms are ambiguous with A-vel plural forms :

    amáveis, amar. V : I2p

    (‘you-pl used to love’)

    amáveis, amável. A : mp : fp

    (‘amiable, friendly’)

    52This is another case of a A/V ambiguity type. The use of the second-plural person is becoming obsolete in European Portuguese. The general idea is that we would not produce any significant silence if we would remove these <V : I2p> analysis from the DELAF, especially in this kind of journalistic texts such as the CetemPúblico.

    53There are 1,611 ambiguous X-áveis word forms. Only 4 of them do not involve A/V ambiguity type. The remaining 1,607 are distributed as follows (Table 12) :

    Table 12 : X-áveis word forms with ambiguity type A/V

    Image 10000000000002780000006E78DDC941A0B154CD.jpg

    AC = Ambiguity class ; DELAF=different inflected word forms in the DELAF ; WF-
    P1 = different inflected word forms in the corpus ; FRQ = frequency ; PROD = product (FRQ*Amb).

    54In (almost17) 100 % of the A_V cases, the <V : I2p> analysis is incorrect :

    a União Europeia já fez progressos consideráveis

    (considerable)

    as vossas condições de vida aqui serão deploráveis

    (deplorable)

    não só permite adiar todas as medidas desagradáveis

    (unpleasant)

    As sondagens são contraditórias e pouco fiáveis

    (reliable)

    Tratando-se de matérias muito inflamáveis

    (inflamable)

    aconteceram as cenas mais lamentáveis

    (regrettable)

    médio ou longo prazo haverá resultados palpáveis

    (palpable)

    com resultados considerados razoáveis

    (reasonable)

    hábitos alimentares naturais e saudáveis

    (healthy)

    estão ao serviço dos grupos mais vulneráveis

    (vulnerable)

    55For the A_N_V words also, the <V : I2p> analysis is incorrect. However, is not possible to fully disambiguate between the N or the A analyses, except for the case of adjective ultrapassáveis (“possible to be by-passed”), for which we cannot conceive a natural N construction.

    56The impact of ambiguity in the corpus resulting from the elimination of the verb analysis would represent a PROD of 5,721, which corresponds to a reduction of PROD of 3,417 (37.393 % of total PROD before reduction).

    3. X-ais

    57There are 662 ambiguous X-ais word forms in the DELAF. Only 262 of these words appear in the corpus, totalling 75,388 occurrences. A single word (mais, ADV_N, “plus / more”) is responsible for 43,499 (57,7 %) of these occurrences. The remaining words belong to 16 different ambiguity classes, but only 11 are in fact present in the corpus, representing 31,889 occurrences. From these, there are 299 word forms presenting the A/V ambiguity type, of which 137 appear in the corpus, totalling 14, 120 occurrences (that is, 44.279 % of all ambiguous X-ais word forms, excluding mais). All verb forms correspond to <V : P2p> for verbs ending in -ar or <V : S2p : Y2p> for verbs ending in -ir.

    Table 12 : X-ais word forms with ambiguity type A/V

    Image 100000000000027D000000B55D40F2175B3C1190.jpg

    AC = Ambiguity class ; DELAF = different inflected word forms in the DELAF ; WF-
    P1 = different inflected word forms in the corpus ; FRQ = frequency ; PROD =
    product (FRQ*Amb)

    58Most of these V analyses correspond, in fact, to exotic words. They represent a PROD of 14,120 (33,708 % of the initial PROD, before filtering).

    59The fact that we can pin-point ambiguous words via their ambiguity level (Amb), ambiguity class (AC) or ambiguity type (AT) makes it possible to ascertain which words are more or less likely to occur in texts. Such intuitions can be confirmed on large corpora in order to decide which would be more reasonable to include in filters. Ambiguity grammars may include this new type of tags.

    Conclusion

    60In this paper, we mapped the ambiguity of words of the Portuguese DELAF and evaluated its impact on a large corpus. Linguistically oriented disambiguation techniques can profit from the ambiguity information retrieved in this manner. It is possible to use this kind of information to trace precisely the situations where a disambiguation grammar is most efficient or, otherwise, shows poor success rate. It can also help to maintain dictionaries, making easier to find lacunae or eventual mistakes. Finally, it may guide us to determine general rules to produce lexical filters.

    Bibliographie

    Des DOI sont automatiquement ajoutés aux références bibliographiques par Bilbo, l’outil d’annotation bibliographique d’OpenEdition. Ces références bibliographiques peuvent être téléchargées dans les formats APA, Chicago et MLA.

    Format

    • APA
    • Chicago
    • MLA
    Garrigues, M. (1992). Dictionnaires hiérarchiques du français. Principes et méthode d’extraction. Langue française, 96(1), 88-100. https://doi.org/10.3406/lfr.1992.5783
    Garrigues, Mylène. “Dictionnaires hiérarchiques du français. Principes et méthode d’extraction”. Langue française 96, no. 1 (1992): 88-100. doi:10.3406/lfr.1992.5783.
    Garrigues, Mylène. “Dictionnaires hiérarchiques du français. Principes et méthode d’extraction”. Langue française, vols. 96, no. 1, 1992, pp. 88-100. Crossref, https://doi.org/10.3406/lfr.1992.5783.

    Cette bibliographie a été enrichie de toutes les références bibliographiques automatiquement générées par Bilbo en utilisant Crossref.

    Bibliographie

    BAPTISTA J., FAÍSCA L. (2001), “Um filtro para palavras ‘exóticas’ frequentes do Português”, Seminários de Linguística 4, Faro, U. Algarve, p. 65-86.

    BAPTISTA J. (2003), Palavras ambíguas do Dicionário das Palavras Simples do Português, Technical Repport, [Confidential], Faro.

    CASTELEIRO, J. M. (1981), Sintaxe transformacional do adjectivo. Regime das construções completivas., Lisboa, INIC.

    10.3406/lfr.1992.5783 :

    GARRIGUES M. (1992), “Dictionnaires hiérarchiques du français. Principes et méthode d’extraction”, Langue Française 96, Paris, Larousse, p. 88-100.

    SILBERZTEIN M. (1993), Dictionnaire électroniques et analyse automatique de textes. Le système INTEX, Paris, Masson.

    SILBERZTEIN M. (2000), INTEX Manual, Paris, LADL / ASSTRIL.

    Annexe

    Appendix

    # ! /usr/local/bin/perl

    # Max Silberztein © 2003

    # perl program that displays category ambiguities

    # for each form of a DELAF/DELACF dictionary.

    #

    # C : > perl display_ambiguities.perl <mydelaf.dic >result.txt

    #

    # ATTENTION : this program uses \r\n as NEWLINE separators.

    #

    $lastform="" ;

    $lastinfo="" ;

    while (<>)

    {

    # remove \n and \r’s (rather than chomp)

    s/[\n\r]//g ;

    # remove all syntactic and semantic codes (e.g. +zzz)

    s/\+[^+ : ]*//g ;

    # computes the $form and the $category

    ($form, $info1) = split (/, /, $_) ;

    ($lemma, $info2) = split (/\./, $info1) ;

    ($category) = split (/ : /, $info2) ;

    if ($form eq $lastform) # same form as previous line

    {

    # add current category to previous list of categories

    $lastinfo = $lastinfo . "/" . $category ;

    }

    else # a new form

    {

    if ($lastform ne "") # the first $lastform is empty

    {

    # prints out $lastform with the list of categories

    printf ("% s, % s\r\n", $lastform, $lastinfo) ;

    }

    $lastform = $form ;

    $lastinfo = $category ;

    }

    }

    printf ("% s, % s\r\n", $lastform, $lastinfo) ;

    Notes de bas de page

    2 http://label.ist.utl.pt/.

    3 Mean ambiguity is then 1.05 analysis per word form in the DELAF, and 2.07 for each ambiguous word.

    4 Notations : The codes for grammatical categories are transparent : A = Adjective, ADV = Adverb, CONJ = Conjunction, DET = Determiner, INTERJ = Interjection, N = Noun, PFX = Prefix, PREP = Preposition, PRO = Pronoun, V = Verb. Ambiguity classes (cf. §1.1.) are designated by the sequence of grammatical categories, in alphabetic order, connected by the underscore (in this case, A_N_V), in bold, whereas ambiguity types (cf.§1.3) were represented in the same way, but using the slash (e.g. A/N).

    5 This was done using a simple PERL program built by M. Silberztein (2003) ; see Annex. The full list of ambiguous words, sorted alphabetically and by ambiguity class is given in Baptista (2003).

    6 http://www.linguateca.pt/cetempublico/. This corpus with over 200 million words is divided in 20 fragments. For the purpose of this paper we used the first fragment, which is a text of 59,790 Kb.

    7 http://www.nyu.edu/pages/linguistics/intex. M. Silberztein (1993, 2000).

    8 In previous versions of INTEX the same result was obtained by other means.

    9 The average ambiguity of the DLF inflected forms is 1.231 (2.129 for the ambiguous words only ; compare with values in note 2).

    10 http://www.linguateca.pt/. Due to different atomization used by the authors of this list, we only used the frequency information associated to simple words and ignored all sequences of words connected by hyphen (e.g. verb-clitic pronoun combinations), that they considered as a single token. Furthermore, unknown tokens were not considered here, including Nprop (see §2.1). The resulting list contains 157.989 different simple words, which correspond to about 160 million tokens (that is, a corpus 17,845 times larger and a word list longer than t those of Part 1). Notice also that this list includes the word forms of Part 1.

    11 The compound tense with haver was not considered in this paper. The so called absolute participle construction is, in true, a reduced adjectival clause. A list of past participles that cannot be used as adjectives is given in Casteleiro 1981 :150- 154.

    12 There are 607 occurrences from the 170 word forms that were detected by the grammar that do not appear in the context described by the grammar.143 word forms (occurring 240 times) were not detected by the grammar. Adding 607 to 424 referred to above, we obtain 1 031, i.e., the difference between the K of Part 1 and the K detected by the grammar.

    13 A_N_V_V class : 8 DELAF entries, 8 different inflected forms in the text’s DLF, corresponding to 888 occurrences (0.61 %), 4 DIF matched by the grammar (dito, lido, sobrado e valido) corresponding to 309 occurrences (1,13 %).

    14 The remaining classes (A_V_V and A_V_V_V) have only very few elements (10 and 1, respectively) and show a very low number of matches (4), therefore success rate (100 %) is inexpressive. On the other hand, words of class A_ADV_V, with only two elements, and also with low number of matches (5, all of demasiado) were always incorrectly tagged as K, for these were all instances of the adjective (4 occurrences) or the adverb (1 occurrence).

    15 More precisely, we selected exotic words from ambiguous word forms with the larger impact in the corpus global ambiguity, with PROD≥200.

    16 This was calculated as the difference between the corpus’ global ambiguity before the application of the filter (PROD_0) and the residual ambiguity left by the filter (PROD_1), compared with the base-line corresponding to the flat text, where all ambiguity would have been removed (i.e. the sum of the frequency of all word forms of the corpus (FRQ) : (PROD_0 – PROD_1)*100/ (PROD_0 – FRQ).

    17 The only exception found was the word veneráveis (venerable, A : mp : fp), with 4 occurrences, two of them used as nouns while the other were adjectives. However, notice that this word was not considered N in the DELAF.

    Notes de fin

    1 This paper was first presented to the 6th INTEX Workshop, held in Sofia, Hungary, May 28-30, 2003. Research for this paper was partially funded by Fundação para a Ciência e a Tecnologia.

    Auteurs

    • Jorge Baptista

      University of Algarve (Portugal) – inesc-id and fchs
      E-mail : jbaptis@ualg.pt.

    • Luís Faísca

      University of Algarve (Portugal) – inesc-id and fchs

    Précédent Suivant
    Table des matières

    Le texte seul est utilisable sous licence Licence OpenEdition Books. Les autres éléments (illustrations, fichiers annexes importés) sont « Tous droits réservés », sauf mention contraire.

    Voir plus de livres
    La pensée de la race en Italie

    La pensée de la race en Italie

    Du romantisme au fascisme

    Aurélien Aramini et Elena Bovo (dir.)

    2018

    La formation d’une opinion démocratique

    La formation d’une opinion démocratique

    Le cas du Jura, de la révolution de 1848 à la « république triomphante » (vers 1895)

    Pierre Merlin

    2017

    Les mutations récentes du foncier et des agricultures en Europe

    Les mutations récentes du foncier et des agricultures en Europe

    Gérard Chouquer et Marie-Claude Maurel (dir.)

    2018

    Deux frontières aux destins croisés ?

    Deux frontières aux destins croisés ?

    Étude interdisciplinaire et comparative des délimitations territoriales entre la France et la Suisse, entre la Bourgogne et la Franche-Comté (xive-xxie siècle)

    Benjamin Castets Fontaine, Maxime Kaci, Jérôme Loiseau et al. (dir.)

    2019

    Un mousquetaire du journalisme : Alexandre Dumas

    Un mousquetaire du journalisme : Alexandre Dumas

    Sarah Mombert et Corinne Saminadayar-Perrin (dir.)

    2019

    Libertaire ! Essais sur l’écriture, la pensée et la vie de Joseph Déjacque (1821-1865)

    Libertaire ! Essais sur l’écriture, la pensée et la vie de Joseph Déjacque (1821-1865)

    Thomas Bouchet et Patrick Samzun (dir.)

    2019

    Les encyclopédismes en France à l'ère des révolutions (1789-1850)

    Les encyclopédismes en France à l'ère des révolutions (1789-1850)

    Vincent Bourdeau, Jean-Luc Chappey et Julien Vincent (dir.)

    2020

    Le verre du VIIIe au XVIe siècle en Europe occidentale

    Le verre du VIIIe au XVIe siècle en Europe occidentale

    Inès Pactat et Claudine Munier (dir.)

    2020

    Les révolutions du commerce. France, xviiie-xxie siècle

    Les révolutions du commerce. France, xviiie-xxie siècle

    Jean-Claude Daumas (dir.)

    2020

    Le patrimoine industriel au prisme de nouveaux défis

    Le patrimoine industriel au prisme de nouveaux défis

    Usages économiques et enjeux environnementaux

    Marina Gasnier

    2018

    La petite entreprise au péril de la famille ?

    La petite entreprise au péril de la famille ?

    L’exemple de l’Arc jurassien franco-suisse

    Laurent Amiotte-Suchet, Yvan Droz et Fenneke Reysoo

    2017

    Une imagination républicaine, François-Vincent Raspail (1794-1878)

    Une imagination républicaine, François-Vincent Raspail (1794-1878)

    Jonathan Barbier et Ludovic Frobert (dir.)

    2017

    Voir plus de livres
    1 / 12
    La pensée de la race en Italie

    La pensée de la race en Italie

    Du romantisme au fascisme

    Aurélien Aramini et Elena Bovo (dir.)

    2018

    La formation d’une opinion démocratique

    La formation d’une opinion démocratique

    Le cas du Jura, de la révolution de 1848 à la « république triomphante » (vers 1895)

    Pierre Merlin

    2017

    Les mutations récentes du foncier et des agricultures en Europe

    Les mutations récentes du foncier et des agricultures en Europe

    Gérard Chouquer et Marie-Claude Maurel (dir.)

    2018

    Deux frontières aux destins croisés ?

    Deux frontières aux destins croisés ?

    Étude interdisciplinaire et comparative des délimitations territoriales entre la France et la Suisse, entre la Bourgogne et la Franche-Comté (xive-xxie siècle)

    Benjamin Castets Fontaine, Maxime Kaci, Jérôme Loiseau et al. (dir.)

    2019

    Un mousquetaire du journalisme : Alexandre Dumas

    Un mousquetaire du journalisme : Alexandre Dumas

    Sarah Mombert et Corinne Saminadayar-Perrin (dir.)

    2019

    Libertaire ! Essais sur l’écriture, la pensée et la vie de Joseph Déjacque (1821-1865)

    Libertaire ! Essais sur l’écriture, la pensée et la vie de Joseph Déjacque (1821-1865)

    Thomas Bouchet et Patrick Samzun (dir.)

    2019

    Les encyclopédismes en France à l'ère des révolutions (1789-1850)

    Les encyclopédismes en France à l'ère des révolutions (1789-1850)

    Vincent Bourdeau, Jean-Luc Chappey et Julien Vincent (dir.)

    2020

    Le verre du VIIIe au XVIe siècle en Europe occidentale

    Le verre du VIIIe au XVIe siècle en Europe occidentale

    Inès Pactat et Claudine Munier (dir.)

    2020

    Les révolutions du commerce. France, xviiie-xxie siècle

    Les révolutions du commerce. France, xviiie-xxie siècle

    Jean-Claude Daumas (dir.)

    2020

    Le patrimoine industriel au prisme de nouveaux défis

    Le patrimoine industriel au prisme de nouveaux défis

    Usages économiques et enjeux environnementaux

    Marina Gasnier

    2018

    La petite entreprise au péril de la famille ?

    La petite entreprise au péril de la famille ?

    L’exemple de l’Arc jurassien franco-suisse

    Laurent Amiotte-Suchet, Yvan Droz et Fenneke Reysoo

    2017

    Une imagination républicaine, François-Vincent Raspail (1794-1878)

    Une imagination républicaine, François-Vincent Raspail (1794-1878)

    Jonathan Barbier et Ludovic Frobert (dir.)

    2017

    Accès ouvert

    Accès ouvert freemium

    ePub

    PDF

    PDF du chapitre

    Suggérer l’acquisition à votre bibliothèque

    Acheter

    Édition imprimée

    Presses universitaires de Franche-Comté
    • amazon.fr
    • decitre.fr
    • mollat.com
    • leslibraires.fr
    • placedeslibraires.fr
    • lcdpu.fr
    ePub / PDF

    2 http://label.ist.utl.pt/.

    3 Mean ambiguity is then 1.05 analysis per word form in the DELAF, and 2.07 for each ambiguous word.

    4 Notations : The codes for grammatical categories are transparent : A = Adjective, ADV = Adverb, CONJ = Conjunction, DET = Determiner, INTERJ = Interjection, N = Noun, PFX = Prefix, PREP = Preposition, PRO = Pronoun, V = Verb. Ambiguity classes (cf. §1.1.) are designated by the sequence of grammatical categories, in alphabetic order, connected by the underscore (in this case, A_N_V), in bold, whereas ambiguity types (cf.§1.3) were represented in the same way, but using the slash (e.g. A/N).

    5 This was done using a simple PERL program built by M. Silberztein (2003) ; see Annex. The full list of ambiguous words, sorted alphabetically and by ambiguity class is given in Baptista (2003).

    6 http://www.linguateca.pt/cetempublico/. This corpus with over 200 million words is divided in 20 fragments. For the purpose of this paper we used the first fragment, which is a text of 59,790 Kb.

    7 http://www.nyu.edu/pages/linguistics/intex. M. Silberztein (1993, 2000).

    8 In previous versions of INTEX the same result was obtained by other means.

    9 The average ambiguity of the DLF inflected forms is 1.231 (2.129 for the ambiguous words only ; compare with values in note 2).

    10 http://www.linguateca.pt/. Due to different atomization used by the authors of this list, we only used the frequency information associated to simple words and ignored all sequences of words connected by hyphen (e.g. verb-clitic pronoun combinations), that they considered as a single token. Furthermore, unknown tokens were not considered here, including Nprop (see §2.1). The resulting list contains 157.989 different simple words, which correspond to about 160 million tokens (that is, a corpus 17,845 times larger and a word list longer than t those of Part 1). Notice also that this list includes the word forms of Part 1.

    11 The compound tense with haver was not considered in this paper. The so called absolute participle construction is, in true, a reduced adjectival clause. A list of past participles that cannot be used as adjectives is given in Casteleiro 1981 :150- 154.

    12 There are 607 occurrences from the 170 word forms that were detected by the grammar that do not appear in the context described by the grammar.143 word forms (occurring 240 times) were not detected by the grammar. Adding 607 to 424 referred to above, we obtain 1 031, i.e., the difference between the K of Part 1 and the K detected by the grammar.

    13 A_N_V_V class : 8 DELAF entries, 8 different inflected forms in the text’s DLF, corresponding to 888 occurrences (0.61 %), 4 DIF matched by the grammar (dito, lido, sobrado e valido) corresponding to 309 occurrences (1,13 %).

    14 The remaining classes (A_V_V and A_V_V_V) have only very few elements (10 and 1, respectively) and show a very low number of matches (4), therefore success rate (100 %) is inexpressive. On the other hand, words of class A_ADV_V, with only two elements, and also with low number of matches (5, all of demasiado) were always incorrectly tagged as K, for these were all instances of the adjective (4 occurrences) or the adverb (1 occurrence).

    15 More precisely, we selected exotic words from ambiguous word forms with the larger impact in the corpus global ambiguity, with PROD≥200.

    16 This was calculated as the difference between the corpus’ global ambiguity before the application of the filter (PROD_0) and the residual ambiguity left by the filter (PROD_1), compared with the base-line corresponding to the flat text, where all ambiguity would have been removed (i.e. the sum of the frequency of all word forms of the corpus (FRQ) : (PROD_0 – PROD_1)*100/ (PROD_0 – FRQ).

    17 The only exception found was the word veneráveis (venerable, A : mp : fp), with 4 occurrences, two of them used as nouns while the other were adjectives. However, notice that this word was not considered N in the DELAF.

    1 This paper was first presented to the 6th INTEX Workshop, held in Sofia, Hungary, May 28-30, 2003. Research for this paper was partially funded by Fundação para a Ciência e a Tecnologia.

    Formaliser les langues avec l’ordinateur : de INTEX à Nooj

    X Facebook Email

    Formaliser les langues avec l’ordinateur : de INTEX à Nooj

    Ce livre est diffusé en accès ouvert freemium. L’accès à la lecture en ligne est disponible. L’accès aux versions PDF et ePub est réservé aux bibliothèques l’ayant acquis. Vous pouvez vous connecter à votre bibliothèque à l’adresse suivante : https://freemium.openedition.org/oebooks

    Suggérer l’acquisition à votre bibliothèque Acheter ce livre aux formats PDF et ePub

    Si vous avez des questions, vous pouvez nous écrire à access[at]openedition.org

    Formaliser les langues avec l’ordinateur : de INTEX à Nooj

    Vérifiez si votre bibliothèque a déjà acquis ce livre : authentifiez-vous à OpenEdition Freemium for Books.

    Vous pouvez suggérer à votre bibliothèque d’acquérir un ou plusieurs livres publiés sur OpenEdition Books. N’hésitez pas à lui indiquer nos coordonnées : access[at]openedition.org

    Vous pouvez également nous indiquer, à l’aide du formulaire suivant, les coordonnées de votre bibliothèque afin que nous la contactions pour lui suggérer l’achat de ce livre. Les champs suivis de (*) sont obligatoires.

    Veuillez, s’il vous plaît, remplir tous les champs.

    La syntaxe de l’email est incorrecte.

    Référence numérique du chapitre

    Format

    Baptista, J., & Faísca, L. (2007). 18. Mapping, filtering and measuring impact of ambiguous words in Portuguese. In S. Koeva, D. Maurel, & M. Silberztein (éds.), Formaliser les langues avec l’ordinateur : de INTEX à Nooj. Besançon: Presses universitaires de Franche-Comté. https://doi.org/10.4000/books.pufc.27184
    Baptista, Jorge, et Luís Faísca. « 18. Mapping, Filtering and Measuring Impact of Ambiguous Words in Portuguese ». In Formaliser Les Langues Avec l’ordinateur : De INTEX à Nooj, édité par Svetla Koeva, Denis Maurel, et Max Silberztein. Besançon: Presses universitaires de Franche-Comté, 2007. doi:10.4000/books.pufc.27184.
    Baptista, Jorge, et Luís Faísca. « 18. Mapping, Filtering and Measuring Impact of Ambiguous Words in Portuguese ». Formaliser Les Langues Avec l’ordinateur : De INTEX à Nooj, édité par Svetla Koeva et al., Presses universitaires de Franche-Comté, 2007, https://doi.org/10.4000/books.pufc.27184.

    Référence numérique du livre

    Format

    Koeva, S., Maurel, D., & Silberztein, M. (éds.). (2007). Formaliser les langues avec l’ordinateur : de INTEX à Nooj. Besançon: Presses universitaires de Franche-Comté. https://doi.org/10.4000/books.pufc.26889
    Koeva, Svetla, Denis Maurel, et Max Silberztein, éd. Formaliser les langues avec l’ordinateur : de INTEX à Nooj. Besançon: Presses universitaires de Franche-Comté, 2007. doi:10.4000/books.pufc.26889.
    Koeva, Svetla, et al., éditeurs. Formaliser les langues avec l’ordinateur : de INTEX à Nooj. Presses universitaires de Franche-Comté, 2007, https://doi.org/10.4000/books.pufc.26889.
    Compatible avec Zotero Zotero

    1 / 3

    Presses universitaires de Franche-Comté

    Presses universitaires de Franche-Comté

    • Plan du site
    • Se connecter

    Suivez-nous

    • LinkedIn
    • Flux RSS

    URL : http://pufc.univ-fcomte.fr

    Email : Presses-pufc@univ-fcomte.fr

    Adresse :

    47, rue Mégevand

    25030

    Besançon

    France

    OpenEdition
    • Candidater à OpenEdition Books
    • Connaître le programme OpenEdition Freemium
    • Commander des livres
    • S’abonner à la lettre d’OpenEdition
    • CGU d’OpenEdition Books
    • Accessibilité : partiellement conforme
    • Données personnelles
    • Gestion des cookies
    • Système de signalement