Document (#30602)

Author

Talvensaari, T.
Laurikkala, J.
Järvelin, K.
Juhola, M.

Title

¬A study on automatic creation of a comparable document collection in cross-language information retrieval

Source

Journal of documentation. 62(2006) no.3, S.372-387

Year

2006

Abstract

Purpose - To present a method for creating a comparable document collection from two document collections in different languages. Design/methodology/approach - The best query keys were extracted from a Finnish source collection (articles of the newspaper Aamulehti) with the relative average term frequency formula. The keys were translated into English with a dictionary-based query translation program. The resulting lists of words were used as queries that were run against the target collection (Los Angeles Times articles) with the nearest neighbor method. The documents were aligned with unrestricted and date-restricted alignment schemes, which were also combined. Findings - The combined alignment scheme was found the best, when the relatedness of the document pairs was assessed with a five-degree relevance scale. Of the 400 document pairs, roughly 40 percent were highly or fairly related and 75 percent included at least lexical similarity. Research limitations/implications - The number of alignment pairs was small due to the short common time period of the two collections, and their geographical (and thus, topical) remoteness. In future, our aim is to build larger comparable corpora in various languages and use them as source of translation knowledge for the purposes of cross-language information retrieval (CLIR). Practical implications - Readily available parallel corpora are scarce. With this method, two unrelated document collections can relatively easily be aligned to create a CLIR resource. Originality/value - The method can be applied to weakly linked collections and morphologically complex languages, such as Finnish.

Theme

Retrievalstudien
Multilinguale Probleme

Similar documents (author)

1. Järvelin, K.: ¬An analysis of two approaches in information retrieval : from frameworks to study designs (2007) 4.99

   4.9924345 = sum of:
     4.9924345 = weight(author_txt:järvelin in 1326) [ClassicSimilarity], result of:
       4.9924345 = fieldWeight in 1326, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.625 = fieldNorm(doc=1326)
   

2. Järvelin, K.: Evaluation (2011) 4.99

   4.9924345 = sum of:
     4.9924345 = weight(author_txt:järvelin in 1548) [ClassicSimilarity], result of:
       4.9924345 = fieldWeight in 1548, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.625 = fieldNorm(doc=1548)
   

3. Järvelin, K.; Vakkari, P.: ¬The evolution of library and information science 1965-1985 : a content analysis of journal titles (1993) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 4648) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 4648, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=4648)
   

4. Kristensen, J.; Järvelin, K.: ¬The effectiveness of a searching thesaurus in free-text searching in a full-text database (1990) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 2111) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 2111, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=2111)
   

5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 6907) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 6907, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=6907)
   

Similar documents (content)

1. Dadashkarimia, J.; Shakery, A.; Failia, H.; Zamani, H.: ¬An expectation-maximization algorithm for query translation based on pseudo-relevant documents (2017) 0.60

   0.6047402 = sum of:
     0.6047402 = product of:
       1.162962 = sum of:
         0.06771837 = weight(abstract_txt:query in 4296) [ClassicSimilarity], result of:
           0.06771837 = score(doc=4296,freq=8.0), product of:
             0.09208086 = queryWeight, product of:
               1.0610114 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.01825346 = queryNorm
             0.7354229 = fieldWeight in 4296, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.05106713 = weight(abstract_txt:source in 4296) [ClassicSimilarity], result of:
           0.05106713 = score(doc=4296,freq=3.0), product of:
             0.10579104 = queryWeight, product of:
               1.1372602 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.01825346 = queryNorm
             0.48271695 = fieldWeight in 4296, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.03914538 = weight(abstract_txt:cross in 4296) [ClassicSimilarity], result of:
           0.03914538 = score(doc=4296,freq=1.0), product of:
             0.12779544 = queryWeight, product of:
               1.2499512 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.01825346 = queryNorm
             0.3063128 = fieldWeight in 4296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.15743291 = weight(abstract_txt:translation in 4296) [ClassicSimilarity], result of:
           0.15743291 = score(doc=4296,freq=9.0), product of:
             0.15537383 = queryWeight, product of:
               1.3782382 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.01825346 = queryNorm
             1.0132525 = fieldWeight in 4296, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.108527705 = weight(abstract_txt:corpora in 4296) [ClassicSimilarity], result of:
           0.108527705 = score(doc=4296,freq=2.0), product of:
             0.20017603 = queryWeight, product of:
               1.564377 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.01825346 = queryNorm
             0.54216135 = fieldWeight in 4296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.020787736 = weight(abstract_txt:with in 4296) [ClassicSimilarity], result of:
           0.020787736 = score(doc=4296,freq=4.0), product of:
             0.07614129 = queryWeight, product of:
               1.6711142 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01825346 = queryNorm
             0.2730153 = fieldWeight in 4296, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.046706017 = weight(abstract_txt:languages in 4296) [ClassicSimilarity], result of:
           0.046706017 = score(doc=4296,freq=1.0), product of:
             0.1645662 = queryWeight, product of:
               1.737206 = boost
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.01825346 = queryNorm
             0.28381294 = fieldWeight in 4296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.17401777 = weight(abstract_txt:clir in 4296) [ClassicSimilarity], result of:
           0.17401777 = score(doc=4296,freq=2.0), product of:
             0.27422944 = queryWeight, product of:
               1.8310171 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.01825346 = queryNorm
             0.63457 = fieldWeight in 4296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.18710062 = weight(abstract_txt:aligned in 4296) [ClassicSimilarity], result of:
           0.18710062 = score(doc=4296,freq=2.0), product of:
             0.28780732 = queryWeight, product of:
               1.875799 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.01825346 = queryNorm
             0.65008986 = fieldWeight in 4296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.08113368 = weight(abstract_txt:method in 4296) [ClassicSimilarity], result of:
           0.08113368 = score(doc=4296,freq=4.0), product of:
             0.16488676 = queryWeight, product of:
               2.0079055 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01825346 = queryNorm
             0.49205697 = fieldWeight in 4296, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.044784673 = weight(abstract_txt:collection in 4296) [ClassicSimilarity], result of:
           0.044784673 = score(doc=4296,freq=1.0), product of:
             0.17612647 = queryWeight, product of:
               2.075213 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.01825346 = queryNorm
             0.25427565 = fieldWeight in 4296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.0799905 = weight(abstract_txt:collections in 4296) [ClassicSimilarity], result of:
           0.0799905 = score(doc=4296,freq=3.0), product of:
             0.17977262 = queryWeight, product of:
               2.0965834 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.01825346 = queryNorm
             0.44495374 = fieldWeight in 4296, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
         0.1045495 = weight(abstract_txt:pairs in 4296) [ClassicSimilarity], result of:
           0.1045495 = score(doc=4296,freq=1.0), product of:
             0.2816048 = queryWeight, product of:
               2.272485 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.01825346 = queryNorm
             0.3712632 = fieldWeight in 4296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4296)
       0.52 = coord(13/25)
   

2. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.57

   0.57331795 = sum of:
     0.57331795 = product of:
       1.1025345 = sum of:
         0.047392994 = weight(abstract_txt:query in 1139) [ClassicSimilarity], result of:
           0.047392994 = score(doc=1139,freq=3.0), product of:
             0.09208086 = queryWeight, product of:
               1.0610114 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.01825346 = queryNorm
             0.51468885 = fieldWeight in 1139, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.033695567 = weight(abstract_txt:source in 1139) [ClassicSimilarity], result of:
           0.033695567 = score(doc=1139,freq=1.0), product of:
             0.10579104 = queryWeight, product of:
               1.1372602 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.01825346 = queryNorm
             0.3185106 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.044737577 = weight(abstract_txt:cross in 1139) [ClassicSimilarity], result of:
           0.044737577 = score(doc=1139,freq=1.0), product of:
             0.12779544 = queryWeight, product of:
               1.2499512 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.01825346 = queryNorm
             0.3500718 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.05385726 = weight(abstract_txt:combined in 1139) [ClassicSimilarity], result of:
           0.05385726 = score(doc=1139,freq=1.0), product of:
             0.14462051 = queryWeight, product of:
               1.3296897 = boost
               5.9584646 = idf(docFreq=311, maxDocs=44421)
               0.01825346 = queryNorm
             0.37240404 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9584646 = idf(docFreq=311, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.13410693 = weight(abstract_txt:translation in 1139) [ClassicSimilarity], result of:
           0.13410693 = score(doc=1139,freq=5.0), product of:
             0.15537383 = queryWeight, product of:
               1.3782382 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.01825346 = queryNorm
             0.8631243 = fieldWeight in 1139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.016799027 = weight(abstract_txt:with in 1139) [ClassicSimilarity], result of:
           0.016799027 = score(doc=1139,freq=2.0), product of:
             0.07614129 = queryWeight, product of:
               1.6711142 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01825346 = queryNorm
             0.22062966 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.16887261 = weight(abstract_txt:finnish in 1139) [ClassicSimilarity], result of:
           0.16887261 = score(doc=1139,freq=2.0), product of:
             0.24590263 = queryWeight, product of:
               1.7338717 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.01825346 = queryNorm
             0.6867458 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.1406276 = weight(abstract_txt:clir in 1139) [ClassicSimilarity], result of:
           0.1406276 = score(doc=1139,freq=1.0), product of:
             0.27422944 = queryWeight, product of:
               1.8310171 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.01825346 = queryNorm
             0.51281 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.051182482 = weight(abstract_txt:collection in 1139) [ClassicSimilarity], result of:
           0.051182482 = score(doc=1139,freq=1.0), product of:
             0.17612647 = queryWeight, product of:
               2.075213 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.01825346 = queryNorm
             0.29060075 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.074642256 = weight(abstract_txt:collections in 1139) [ClassicSimilarity], result of:
           0.074642256 = score(doc=1139,freq=2.0), product of:
             0.17977262 = queryWeight, product of:
               2.0965834 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.01825346 = queryNorm
             0.4152037 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.17785503 = weight(abstract_txt:comparable in 1139) [ClassicSimilarity], result of:
           0.17785503 = score(doc=1139,freq=2.0), product of:
             0.29138345 = queryWeight, product of:
               2.311604 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.01825346 = queryNorm
             0.61038136 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.09828771 = weight(abstract_txt:were in 1139) [ClassicSimilarity], result of:
           0.09828771 = score(doc=1139,freq=5.0), product of:
             0.19176346 = queryWeight, product of:
               2.8645232 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01825346 = queryNorm
             0.5125466 = fieldWeight in 1139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.060477532 = weight(abstract_txt:document in 1139) [ClassicSimilarity], result of:
           0.060477532 = score(doc=1139,freq=1.0), product of:
             0.22533925 = queryWeight, product of:
               2.874845 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.01825346 = queryNorm
             0.26838437 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
       0.52 = coord(13/25)
   

3. Li, K.W.; Yang, C.C.: Conceptual analysis of parallel corpus collected from the Web (2006) 0.44

   0.43630633 = sum of:
     0.43630633 = product of:
       1.211962 = sum of:
         0.044737577 = weight(abstract_txt:cross in 51) [ClassicSimilarity], result of:
           0.044737577 = score(doc=51,freq=1.0), product of:
             0.12779544 = queryWeight, product of:
               1.2499512 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.01825346 = queryNorm
             0.3500718 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.059974443 = weight(abstract_txt:translation in 51) [ClassicSimilarity], result of:
           0.059974443 = score(doc=51,freq=1.0), product of:
             0.15537383 = queryWeight, product of:
               1.3782382 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.01825346 = queryNorm
             0.38600093 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.19611128 = weight(abstract_txt:corpora in 51) [ClassicSimilarity], result of:
           0.19611128 = score(doc=51,freq=5.0), product of:
             0.20017603 = queryWeight, product of:
               1.564377 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.01825346 = queryNorm
             0.97969407 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.106756605 = weight(abstract_txt:languages in 51) [ClassicSimilarity], result of:
           0.106756605 = score(doc=51,freq=4.0), product of:
             0.1645662 = queryWeight, product of:
               1.737206 = boost
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.01825346 = queryNorm
             0.64871526 = fieldWeight in 51, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.15120013 = weight(abstract_txt:aligned in 51) [ClassicSimilarity], result of:
           0.15120013 = score(doc=51,freq=1.0), product of:
             0.28780732 = queryWeight, product of:
               1.875799 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.01825346 = queryNorm
             0.52535194 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.10366881 = weight(abstract_txt:method in 51) [ClassicSimilarity], result of:
           0.10366881 = score(doc=51,freq=5.0), product of:
             0.16488676 = queryWeight, product of:
               2.0079055 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01825346 = queryNorm
             0.6287273 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.1689775 = weight(abstract_txt:pairs in 51) [ClassicSimilarity], result of:
           0.1689775 = score(doc=51,freq=2.0), product of:
             0.2816048 = queryWeight, product of:
               2.272485 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.01825346 = queryNorm
             0.60005194 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.33658004 = weight(abstract_txt:alignment in 51) [ClassicSimilarity], result of:
           0.33658004 = score(doc=51,freq=5.0), product of:
             0.328473 = queryWeight, product of:
               2.454318 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01825346 = queryNorm
             1.024681 = fieldWeight in 51, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
         0.043955598 = weight(abstract_txt:were in 51) [ClassicSimilarity], result of:
           0.043955598 = score(doc=51,freq=1.0), product of:
             0.19176346 = queryWeight, product of:
               2.8645232 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01825346 = queryNorm
             0.2292178 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=51)
       0.36 = coord(9/25)
   

4. Yang, C.C.; Li, K.W.: Automatic construction of English/Chinese parallel corpora (2003) 0.38

   0.3783914 = sum of:
     0.3783914 = product of:
       0.9459785 = sum of:
         0.04213487 = weight(abstract_txt:articles in 2683) [ClassicSimilarity], result of:
           0.04213487 = score(doc=2683,freq=3.0), product of:
             0.093064144 = queryWeight, product of:
               1.0666614 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.01825346 = queryNorm
             0.45275083 = fieldWeight in 2683, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.07829076 = weight(abstract_txt:cross in 2683) [ClassicSimilarity], result of:
           0.07829076 = score(doc=2683,freq=4.0), product of:
             0.12779544 = queryWeight, product of:
               1.2499512 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.01825346 = queryNorm
             0.6126256 = fieldWeight in 2683, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.090893924 = weight(abstract_txt:translation in 2683) [ClassicSimilarity], result of:
           0.090893924 = score(doc=2683,freq=3.0), product of:
             0.15537383 = queryWeight, product of:
               1.3782382 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.01825346 = queryNorm
             0.5850015 = fieldWeight in 2683, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.13291875 = weight(abstract_txt:corpora in 2683) [ClassicSimilarity], result of:
           0.13291875 = score(doc=2683,freq=3.0), product of:
             0.20017603 = queryWeight, product of:
               1.564377 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.01825346 = queryNorm
             0.6640093 = fieldWeight in 2683, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.010393868 = weight(abstract_txt:with in 2683) [ClassicSimilarity], result of:
           0.010393868 = score(doc=2683,freq=1.0), product of:
             0.07614129 = queryWeight, product of:
               1.6711142 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01825346 = queryNorm
             0.13650765 = fieldWeight in 2683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.06605228 = weight(abstract_txt:languages in 2683) [ClassicSimilarity], result of:
           0.06605228 = score(doc=2683,freq=2.0), product of:
             0.1645662 = queryWeight, product of:
               1.737206 = boost
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.01825346 = queryNorm
             0.40137208 = fieldWeight in 2683, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.08113368 = weight(abstract_txt:method in 2683) [ClassicSimilarity], result of:
           0.08113368 = score(doc=2683,freq=4.0), product of:
             0.16488676 = queryWeight, product of:
               2.0079055 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01825346 = queryNorm
             0.49205697 = fieldWeight in 2683, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.14785531 = weight(abstract_txt:pairs in 2683) [ClassicSimilarity], result of:
           0.14785531 = score(doc=2683,freq=2.0), product of:
             0.2816048 = queryWeight, product of:
               2.272485 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.01825346 = queryNorm
             0.52504545 = fieldWeight in 2683, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.11004218 = weight(abstract_txt:comparable in 2683) [ClassicSimilarity], result of:
           0.11004218 = score(doc=2683,freq=1.0), product of:
             0.29138345 = queryWeight, product of:
               2.311604 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.01825346 = queryNorm
             0.3776542 = fieldWeight in 2683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
         0.1862629 = weight(abstract_txt:alignment in 2683) [ClassicSimilarity], result of:
           0.1862629 = score(doc=2683,freq=2.0), product of:
             0.328473 = queryWeight, product of:
               2.454318 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01825346 = queryNorm
             0.56705695 = fieldWeight in 2683, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2683)
       0.4 = coord(10/25)
   

5. Pirkola, A.; Puolamäki, D.; Järvelin, K.: Applying query structuring in cross-language retrieval (2003) 0.35

   0.35210156 = sum of:
     0.35210156 = product of:
       0.9780599 = sum of:
         0.06840589 = weight(abstract_txt:query in 2074) [ClassicSimilarity], result of:
           0.06840589 = score(doc=2074,freq=4.0), product of:
             0.09208086 = queryWeight, product of:
               1.0610114 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.01825346 = queryNorm
             0.74288934 = fieldWeight in 2074, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.034752257 = weight(abstract_txt:articles in 2074) [ClassicSimilarity], result of:
           0.034752257 = score(doc=2074,freq=1.0), product of:
             0.093064144 = queryWeight, product of:
               1.0666614 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.01825346 = queryNorm
             0.37342262 = fieldWeight in 2074, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.055921976 = weight(abstract_txt:cross in 2074) [ClassicSimilarity], result of:
           0.055921976 = score(doc=2074,freq=1.0), product of:
             0.12779544 = queryWeight, product of:
               1.2499512 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.01825346 = queryNorm
             0.43758973 = fieldWeight in 2074, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.12984847 = weight(abstract_txt:translation in 2074) [ClassicSimilarity], result of:
           0.12984847 = score(doc=2074,freq=3.0), product of:
             0.15537383 = queryWeight, product of:
               1.3782382 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.01825346 = queryNorm
             0.8357165 = fieldWeight in 2074, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.25853232 = weight(abstract_txt:finnish in 2074) [ClassicSimilarity], result of:
           0.25853232 = score(doc=2074,freq=3.0), product of:
             0.24590263 = queryWeight, product of:
               1.7338717 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.01825346 = queryNorm
             1.0513605 = fieldWeight in 2074, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.06672288 = weight(abstract_txt:languages in 2074) [ClassicSimilarity], result of:
           0.06672288 = score(doc=2074,freq=1.0), product of:
             0.1645662 = queryWeight, product of:
               1.737206 = boost
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.01825346 = queryNorm
             0.40544704 = fieldWeight in 2074, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.1720297 = weight(abstract_txt:keys in 2074) [ClassicSimilarity], result of:
           0.1720297 = score(doc=2074,freq=1.0), product of:
             0.27031034 = queryWeight, product of:
               1.8178862 = boost
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.01825346 = queryNorm
             0.63641554 = fieldWeight in 2074, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.08195739 = weight(abstract_txt:method in 2074) [ClassicSimilarity], result of:
           0.08195739 = score(doc=2074,freq=2.0), product of:
             0.16488676 = queryWeight, product of:
               2.0079055 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01825346 = queryNorm
             0.4970526 = fieldWeight in 2074, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
         0.10988899 = weight(abstract_txt:were in 2074) [ClassicSimilarity], result of:
           0.10988899 = score(doc=2074,freq=4.0), product of:
             0.19176346 = queryWeight, product of:
               2.8645232 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01825346 = queryNorm
             0.5730445 = fieldWeight in 2074, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.078125 = fieldNorm(doc=2074)
       0.36 = coord(9/25)