Document (#26684)

Author

Yang, C.C.
Li, K.W.

Title

Automatic construction of English/Chinese parallel corpora

Source

Journal of the American Society for Information Science and technology. 54(2003) no.8, S.730-742

Year

2003

Abstract

As the demand for global information increases significantly, multilingual corpora has become a valuable linguistic resource for applications to cross-lingual information retrieval and natural language processing. In order to cross the boundaries that exist between different languages, dictionaries are the most typical tools. However, the general-purpose dictionary is less sensitive in both genre and domain. It is also impractical to manually construct tailored bilingual dictionaries or sophisticated multilingual thesauri for large applications. Corpusbased approaches, which do not have the limitation of dictionaries, provide a statistical translation model with which to cross the language boundary. There are many domain-specific parallel or comparable corpora that are employed in machine translation and cross-lingual information retrieval. Most of these are corpora between Indo-European languages, such as English/French and English/Spanish. The Asian/Indo-European corpus, especially English/Chinese corpus, is relatively sparse. The objective of the present research is to construct English/ Chinese parallel corpus automatically from the World Wide Web. In this paper, an alignment method is presented which is based an dynamic programming to identify the one-to-one Chinese and English title pairs. The method includes alignment at title level, word level and character level. The longest common subsequence (LCS) is applied to find the most reliabie Chinese translation of an English word. As one word for a language may translate into two or more words repetitively in another language, the edit operation, deletion, is used to resolve redundancy. A score function is then proposed to determine the optimal title pairs. Experiments have been conducted to investigate the performance of the proposed method using the daily press release articles by the Hong Kong SAR government as the test bed. The precision of the result is 0.998 while the recall is 0.806. The release articles and speech articles, published by Hongkong & Shanghai Banking Corporation Limited, are also used to test our method, the precision is 1.00, and the recall is 0.948.

Theme

Computerlinguistik

Similar documents (author)

1. Yang, S.C.: ¬An interpretive and situated approach to an evaluation of Perseus digital libraries (2001) 4.48

   4.4805427 = sum of:
     4.4805427 = weight(author_txt:yang in 933) [ClassicSimilarity], result of:
       4.4805427 = fieldWeight in 933, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.168868 = idf(docFreq=92, maxDocs=44421)
         0.625 = fieldNorm(doc=933)
   

2. Yang, K.: Information retrieval on the Web (2004) 4.48

   4.4805427 = sum of:
     4.4805427 = weight(author_txt:yang in 5278) [ClassicSimilarity], result of:
       4.4805427 = fieldWeight in 5278, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.168868 = idf(docFreq=92, maxDocs=44421)
         0.625 = fieldNorm(doc=5278)
   

3. Yang, C.C.: Content-based image retrievaI : a comparison between query by example and image browsing map approaches (2005) 4.48

   4.4805427 = sum of:
     4.4805427 = weight(author_txt:yang in 5649) [ClassicSimilarity], result of:
       4.4805427 = fieldWeight in 5649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.168868 = idf(docFreq=92, maxDocs=44421)
         0.625 = fieldNorm(doc=5649)
   

4. Salton, G.; Yang, C.S.: On the specification of term values in automatic indexing (1973) 3.58

   3.584434 = sum of:
     3.584434 = weight(author_txt:yang in 5475) [ClassicSimilarity], result of:
       3.584434 = fieldWeight in 5475, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.168868 = idf(docFreq=92, maxDocs=44421)
         0.5 = fieldNorm(doc=5475)
   

5. Yang, Y.; Chute, C.G.A.: ¬A schematic analysis of the Unified Medical Language System (1992) 3.58

   3.584434 = sum of:
     3.584434 = weight(author_txt:yang in 6444) [ClassicSimilarity], result of:
       3.584434 = fieldWeight in 6444, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.168868 = idf(docFreq=92, maxDocs=44421)
         0.5 = fieldNorm(doc=6444)
   

Similar documents (content)

1. Li, K.W.; Yang, C.C.: Conceptual analysis of parallel corpus collected from the Web (2006) 1.60

   1.5959946 = sum of:
     1.5959946 = product of:
       2.216659 = sum of:
         0.061401706 = weight(abstract_txt:languages in 51) [ClassicSimilarity], result of:
           0.061401706 = score(doc=51,freq=4.0), product of:
             0.094651245 = queryWeight, product of:
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.018238211 = queryNorm
             0.64871526 = fieldWeight in 51, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.03701406 = weight(abstract_txt:precision in 51) [ClassicSimilarity], result of:
           0.03701406 = score(doc=51,freq=1.0), product of:
             0.1072187 = queryWeight, product of:
               1.0643197 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018238211 = queryNorm
             0.3452202 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.05737736 = weight(abstract_txt:european in 51) [ClassicSimilarity], result of:
           0.05737736 = score(doc=51,freq=2.0), product of:
             0.11398378 = queryWeight, product of:
               1.0973834 = boost
               5.6951146 = idf(docFreq=405, maxDocs=44421)
               0.018238211 = queryNorm
             0.5033818 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6951146 = idf(docFreq=405, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.04177424 = weight(abstract_txt:recall in 51) [ClassicSimilarity], result of:
           0.04177424 = score(doc=51,freq=1.0), product of:
             0.11622469 = queryWeight, product of:
               1.108118 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018238211 = queryNorm
             0.35942656 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.05105372 = weight(abstract_txt:construct in 51) [ClassicSimilarity], result of:
           0.05105372 = score(doc=51,freq=1.0), product of:
             0.13285492 = queryWeight, product of:
               1.1847471 = boost
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.018238211 = queryNorm
             0.38428175 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.07762554 = weight(abstract_txt:multilingual in 51) [ClassicSimilarity], result of:
           0.07762554 = score(doc=51,freq=2.0), product of:
             0.1394288 = queryWeight, product of:
               1.2137048 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.018238211 = queryNorm
             0.5567397 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.09718845 = weight(abstract_txt:pairs in 51) [ClassicSimilarity], result of:
           0.09718845 = score(doc=51,freq=2.0), product of:
             0.16196673 = queryWeight, product of:
               1.3081264 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.018238211 = queryNorm
             0.60005194 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.19358607 = weight(abstract_txt:alignment in 51) [ClassicSimilarity], result of:
           0.19358607 = score(doc=51,freq=5.0), product of:
             0.18892325 = queryWeight, product of:
               1.4127963 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.018238211 = queryNorm
             1.024681 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.117505185 = weight(abstract_txt:lingual in 51) [ClassicSimilarity], result of:
           0.117505185 = score(doc=51,freq=1.0), product of:
             0.23159583 = queryWeight, product of:
               1.5642357 = boost
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.018238211 = queryNorm
             0.5073718 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.08731733 = weight(abstract_txt:title in 51) [ClassicSimilarity], result of:
           0.08731733 = score(doc=51,freq=2.0), product of:
             0.17262888 = queryWeight, product of:
               1.654014 = boost
               5.722582 = idf(docFreq=394, maxDocs=44421)
               0.018238211 = queryNorm
             0.50580955 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.722582 = idf(docFreq=394, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.08943862 = weight(abstract_txt:method in 51) [ClassicSimilarity], result of:
           0.08943862 = score(doc=51,freq=5.0), product of:
             0.14225343 = queryWeight, product of:
               1.733737 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018238211 = queryNorm
             0.6287273 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.07448832 = weight(abstract_txt:corpus in 51) [ClassicSimilarity], result of:
           0.07448832 = score(doc=51,freq=1.0), product of:
             0.19563591 = queryWeight, product of:
               1.7607868 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.018238211 = queryNorm
             0.38074973 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.077612996 = weight(abstract_txt:translation in 51) [ClassicSimilarity], result of:
           0.077612996 = score(doc=51,freq=1.0), product of:
             0.20106944 = queryWeight, product of:
               1.7850711 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.018238211 = queryNorm
             0.38600093 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.17380562 = weight(abstract_txt:parallel in 51) [ClassicSimilarity], result of:
           0.17380562 = score(doc=51,freq=4.0), product of:
             0.21680985 = queryWeight, product of:
               1.8536254 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.018238211 = queryNorm
             0.80165005 = fieldWeight in 51, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.07719327 = weight(abstract_txt:cross in 51) [ClassicSimilarity], result of:
           0.07719327 = score(doc=51,freq=1.0), product of:
             0.22050697 = queryWeight, product of:
               2.1585543 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.018238211 = queryNorm
             0.3500718 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.33838373 = weight(abstract_txt:corpora in 51) [ClassicSimilarity], result of:
           0.33838373 = score(doc=51,freq=5.0), product of:
             0.34539735 = queryWeight, product of:
               2.7015395 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.018238211 = queryNorm
             0.97969407 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.23767872 = weight(abstract_txt:chinese in 51) [ClassicSimilarity], result of:
           0.23767872 = score(doc=51,freq=3.0), product of:
             0.348572 = queryWeight, product of:
               3.034262 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.018238211 = queryNorm
             0.6818641 = fieldWeight in 51, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.32621396 = weight(abstract_txt:english in 51) [ClassicSimilarity], result of:
           0.32621396 = score(doc=51,freq=6.0), product of:
             0.38223752 = queryWeight, product of:
               3.7595642 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018238211 = queryNorm
             0.8534326 = fieldWeight in 51, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
       0.72 = coord(18/25)
   

2. Xu, J.; Weischedel, R.: Empirical studies on the impact of lexical resources on CLIR performance (2005) 0.57

   0.5694754 = sum of:
     0.5694754 = product of:
       1.581876 = sum of:
         0.14688149 = weight(abstract_txt:lingual in 2020) [ClassicSimilarity], result of:
           0.14688149 = score(doc=2020,freq=1.0), product of:
             0.23159583 = queryWeight, product of:
               1.5642357 = boost
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.018238211 = queryNorm
             0.63421476 = fieldWeight in 2020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.05634947 = weight(abstract_txt:language in 2020) [ClassicSimilarity], result of:
           0.05634947 = score(doc=2020,freq=2.0), product of:
             0.12227733 = queryWeight, product of:
               1.607403 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018238211 = queryNorm
             0.46083337 = fieldWeight in 2020, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.131678 = weight(abstract_txt:corpus in 2020) [ClassicSimilarity], result of:
           0.131678 = score(doc=2020,freq=2.0), product of:
             0.19563591 = queryWeight, product of:
               1.7607868 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.018238211 = queryNorm
             0.6730768 = fieldWeight in 2020, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.09701624 = weight(abstract_txt:translation in 2020) [ClassicSimilarity], result of:
           0.09701624 = score(doc=2020,freq=1.0), product of:
             0.20106944 = queryWeight, product of:
               1.7850711 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.018238211 = queryNorm
             0.48250115 = fieldWeight in 2020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.26608446 = weight(abstract_txt:parallel in 2020) [ClassicSimilarity], result of:
           0.26608446 = score(doc=2020,freq=6.0), product of:
             0.21680985 = queryWeight, product of:
               1.8536254 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.018238211 = queryNorm
             1.2272711 = fieldWeight in 2020, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.09649158 = weight(abstract_txt:cross in 2020) [ClassicSimilarity], result of:
           0.09649158 = score(doc=2020,freq=1.0), product of:
             0.22050697 = queryWeight, product of:
               2.1585543 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.018238211 = queryNorm
             0.43758973 = fieldWeight in 2020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.3783245 = weight(abstract_txt:corpora in 2020) [ClassicSimilarity], result of:
           0.3783245 = score(doc=2020,freq=4.0), product of:
             0.34539735 = queryWeight, product of:
               2.7015395 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.018238211 = queryNorm
             1.0953312 = fieldWeight in 2020, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.24257983 = weight(abstract_txt:chinese in 2020) [ClassicSimilarity], result of:
           0.24257983 = score(doc=2020,freq=2.0), product of:
             0.348572 = queryWeight, product of:
               3.034262 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.018238211 = queryNorm
             0.69592464 = fieldWeight in 2020, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
         0.16647036 = weight(abstract_txt:english in 2020) [ClassicSimilarity], result of:
           0.16647036 = score(doc=2020,freq=1.0), product of:
             0.38223752 = queryWeight, product of:
               3.7595642 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018238211 = queryNorm
             0.4355155 = fieldWeight in 2020, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.078125 = fieldNorm(doc=2020)
       0.36 = coord(9/25)
   

3. Yang, C.C.; Luk, J.: Automatic generation of English/Chinese thesaurus based on a parallel corpus in laws (2003) 0.54

   0.5431884 = sum of:
     0.5431884 = product of:
       1.0445931 = sum of:
         0.038376067 = weight(abstract_txt:languages in 2616) [ClassicSimilarity], result of:
           0.038376067 = score(doc=2616,freq=4.0), product of:
             0.094651245 = queryWeight, product of:
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.018238211 = queryNorm
             0.40544704 = fieldWeight in 2616, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.023133788 = weight(abstract_txt:precision in 2616) [ClassicSimilarity], result of:
           0.023133788 = score(doc=2616,freq=1.0), product of:
             0.1072187 = queryWeight, product of:
               1.0643197 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018238211 = queryNorm
             0.21576263 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.025357448 = weight(abstract_txt:european in 2616) [ClassicSimilarity], result of:
           0.025357448 = score(doc=2616,freq=1.0), product of:
             0.11398378 = queryWeight, product of:
               1.0973834 = boost
               5.6951146 = idf(docFreq=405, maxDocs=44421)
               0.018238211 = queryNorm
             0.22246541 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6951146 = idf(docFreq=405, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.0261089 = weight(abstract_txt:recall in 2616) [ClassicSimilarity], result of:
           0.0261089 = score(doc=2616,freq=1.0), product of:
             0.11622469 = queryWeight, product of:
               1.108118 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018238211 = queryNorm
             0.22464159 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.012616295 = weight(abstract_txt:most in 2616) [ClassicSimilarity], result of:
           0.012616295 = score(doc=2616,freq=1.0), product of:
             0.08192649 = queryWeight, product of:
               1.1394483 = boost
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.018238211 = queryNorm
             0.15399532 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.16421849 = weight(abstract_txt:lingual in 2616) [ClassicSimilarity], result of:
           0.16421849 = score(doc=2616,freq=5.0), product of:
             0.23159583 = queryWeight, product of:
               1.5642357 = boost
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.018238211 = queryNorm
             0.7090736 = fieldWeight in 2616, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.034506865 = weight(abstract_txt:language in 2616) [ClassicSimilarity], result of:
           0.034506865 = score(doc=2616,freq=3.0), product of:
             0.12227733 = queryWeight, product of:
               1.607403 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018238211 = queryNorm
             0.28220165 = fieldWeight in 2616, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.065839 = weight(abstract_txt:corpus in 2616) [ClassicSimilarity], result of:
           0.065839 = score(doc=2616,freq=2.0), product of:
             0.19563591 = queryWeight, product of:
               1.7607868 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.018238211 = queryNorm
             0.3365384 = fieldWeight in 2616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.04850812 = weight(abstract_txt:translation in 2616) [ClassicSimilarity], result of:
           0.04850812 = score(doc=2616,freq=1.0), product of:
             0.20106944 = queryWeight, product of:
               1.7850711 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.018238211 = queryNorm
             0.24125057 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.076811954 = weight(abstract_txt:parallel in 2616) [ClassicSimilarity], result of:
           0.076811954 = score(doc=2616,freq=2.0), product of:
             0.21680985 = queryWeight, product of:
               1.8536254 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.018238211 = queryNorm
             0.3542826 = fieldWeight in 2616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.107880875 = weight(abstract_txt:cross in 2616) [ClassicSimilarity], result of:
           0.107880875 = score(doc=2616,freq=5.0), product of:
             0.22050697 = queryWeight, product of:
               2.1585543 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.018238211 = queryNorm
             0.48924023 = fieldWeight in 2616, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.17152983 = weight(abstract_txt:chinese in 2616) [ClassicSimilarity], result of:
           0.17152983 = score(doc=2616,freq=4.0), product of:
             0.348572 = queryWeight, product of:
               3.034262 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.018238211 = queryNorm
             0.492093 = fieldWeight in 2616, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
         0.24970554 = weight(abstract_txt:english in 2616) [ClassicSimilarity], result of:
           0.24970554 = score(doc=2616,freq=9.0), product of:
             0.38223752 = queryWeight, product of:
               3.7595642 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018238211 = queryNorm
             0.6532732 = fieldWeight in 2616, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2616)
       0.52 = coord(13/25)
   

4. Lam, W.; Chan, K.; Radev, D.; Saggion, H.; Teufel, S.: Context-based generic cross-lingual retrieval of documents and automated summaries (2005) 0.50

   0.5001315 = sum of:
     0.5001315 = product of:
       1.3892541 = sum of:
         0.08590326 = weight(abstract_txt:pairs in 2965) [ClassicSimilarity], result of:
           0.08590326 = score(doc=2965,freq=1.0), product of:
             0.16196673 = queryWeight, product of:
               1.3081264 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.018238211 = queryNorm
             0.53037596 = fieldWeight in 2965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.29376298 = weight(abstract_txt:lingual in 2965) [ClassicSimilarity], result of:
           0.29376298 = score(doc=2965,freq=4.0), product of:
             0.23159583 = queryWeight, product of:
               1.5642357 = boost
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.018238211 = queryNorm
             1.2684295 = fieldWeight in 2965, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.039845094 = weight(abstract_txt:language in 2965) [ClassicSimilarity], result of:
           0.039845094 = score(doc=2965,freq=1.0), product of:
             0.12227733 = queryWeight, product of:
               1.607403 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018238211 = queryNorm
             0.3258584 = fieldWeight in 2965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.093110405 = weight(abstract_txt:corpus in 2965) [ClassicSimilarity], result of:
           0.093110405 = score(doc=2965,freq=1.0), product of:
             0.19563591 = queryWeight, product of:
               1.7607868 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.018238211 = queryNorm
             0.47593716 = fieldWeight in 2965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.09701624 = weight(abstract_txt:translation in 2965) [ClassicSimilarity], result of:
           0.09701624 = score(doc=2965,freq=1.0), product of:
             0.20106944 = queryWeight, product of:
               1.7850711 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.018238211 = queryNorm
             0.48250115 = fieldWeight in 2965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.10862852 = weight(abstract_txt:parallel in 2965) [ClassicSimilarity], result of:
           0.10862852 = score(doc=2965,freq=1.0), product of:
             0.21680985 = queryWeight, product of:
               1.8536254 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.018238211 = queryNorm
             0.5010313 = fieldWeight in 2965, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.19298317 = weight(abstract_txt:cross in 2965) [ClassicSimilarity], result of:
           0.19298317 = score(doc=2965,freq=4.0), product of:
             0.22050697 = queryWeight, product of:
               2.1585543 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.018238211 = queryNorm
             0.87517947 = fieldWeight in 2965, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.24257983 = weight(abstract_txt:chinese in 2965) [ClassicSimilarity], result of:
           0.24257983 = score(doc=2965,freq=2.0), product of:
             0.348572 = queryWeight, product of:
               3.034262 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.018238211 = queryNorm
             0.69592464 = fieldWeight in 2965, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
         0.23542464 = weight(abstract_txt:english in 2965) [ClassicSimilarity], result of:
           0.23542464 = score(doc=2965,freq=2.0), product of:
             0.38223752 = queryWeight, product of:
               3.7595642 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018238211 = queryNorm
             0.6159119 = fieldWeight in 2965, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.078125 = fieldNorm(doc=2965)
       0.36 = coord(9/25)
   

5. Talvensaari, T.; Laurikkala, J.; Järvelin, K.; Juhola, M.: ¬A study on automatic creation of a comparable document collection in cross-language information retrieval (2006) 0.49

   0.4866213 = sum of:
     0.4866213 = product of:
       1.1059575 = sum of:
         0.053175434 = weight(abstract_txt:languages in 601) [ClassicSimilarity], result of:
           0.053175434 = score(doc=601,freq=3.0), product of:
             0.094651245 = queryWeight, product of:
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.018238211 = queryNorm
             0.5618039 = fieldWeight in 601, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.11903105 = weight(abstract_txt:pairs in 601) [ClassicSimilarity], result of:
           0.11903105 = score(doc=601,freq=3.0), product of:
             0.16196673 = queryWeight, product of:
               1.3081264 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.018238211 = queryNorm
             0.7349105 = fieldWeight in 601, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.05088106 = weight(abstract_txt:articles in 601) [ClassicSimilarity], result of:
           0.05088106 = score(doc=601,freq=2.0), product of:
             0.1204344 = queryWeight, product of:
               1.3815218 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.018238211 = queryNorm
             0.42247945 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.14995112 = weight(abstract_txt:alignment in 601) [ClassicSimilarity], result of:
           0.14995112 = score(doc=601,freq=3.0), product of:
             0.18892325 = queryWeight, product of:
               1.4127963 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.018238211 = queryNorm
             0.7937144 = fieldWeight in 601, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.031876076 = weight(abstract_txt:language in 601) [ClassicSimilarity], result of:
           0.031876076 = score(doc=601,freq=1.0), product of:
             0.12227733 = queryWeight, product of:
               1.607403 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018238211 = queryNorm
             0.26068673 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.07999633 = weight(abstract_txt:method in 601) [ClassicSimilarity], result of:
           0.07999633 = score(doc=601,freq=4.0), product of:
             0.14225343 = queryWeight, product of:
               1.733737 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018238211 = queryNorm
             0.5623508 = fieldWeight in 601, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.10976135 = weight(abstract_txt:translation in 601) [ClassicSimilarity], result of:
           0.10976135 = score(doc=601,freq=2.0), product of:
             0.20106944 = queryWeight, product of:
               1.7850711 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.018238211 = queryNorm
             0.54588777 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.08690281 = weight(abstract_txt:parallel in 601) [ClassicSimilarity], result of:
           0.08690281 = score(doc=601,freq=1.0), product of:
             0.21680985 = queryWeight, product of:
               1.8536254 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.018238211 = queryNorm
             0.40082502 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.07719327 = weight(abstract_txt:cross in 601) [ClassicSimilarity], result of:
           0.07719327 = score(doc=601,freq=1.0), product of:
             0.22050697 = queryWeight, product of:
               2.1585543 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.018238211 = queryNorm
             0.3500718 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.21401267 = weight(abstract_txt:corpora in 601) [ClassicSimilarity], result of:
           0.21401267 = score(doc=601,freq=2.0), product of:
             0.34539735 = queryWeight, product of:
               2.7015395 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.018238211 = queryNorm
             0.61961293 = fieldWeight in 601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
         0.1331763 = weight(abstract_txt:english in 601) [ClassicSimilarity], result of:
           0.1331763 = score(doc=601,freq=1.0), product of:
             0.38223752 = queryWeight, product of:
               3.7595642 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018238211 = queryNorm
             0.3484124 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0625 = fieldNorm(doc=601)
       0.44 = coord(11/25)