Document (#32140)

Author

Talvensaari, T.
Juhola, M.
Laurikkala, J.
Järvelin, K.

Title

Corpus-based cross-language information retrieval in retrieval of highly relevant documents

Source

Journal of the American Society for Information Science and Technology. 58(2007) no.3, S.322-334

Year

2007

Abstract

Information retrieval systems' ability to retrieve highly relevant documents has become more and more important in the age of extremely large collections, such as the World Wide Web (WWW). The authors' aim was to find out how corpus-based cross-language information retrieval (CLIR) manages in retrieving highly relevant documents. They created a Finnish-Swedish comparable corpus from two loosely related document collections and used it as a source of knowledge for query translation. Finnish test queries were translated into Swedish and run against a Swedish test collection. Graded relevance assessments were used in evaluating the results and three relevance criterion levels-liberal, regular, and stringent-were applied. The runs were also evaluated with generalized recall and precision, which weight the retrieved documents according to their relevance level. The performance of the Comparable Corpus Translation system (COCOT) was compared to that of a dictionarybased query translation program; the two translation methods were also combined. The results indicate that corpus-based CUR performs particularly well with highly relevant documents. In average precision, COCOT even matched the monolingual baseline on the highest relevance level. The performance of the different query translation methods was further analyzed by finding out reasons for poor rankings of highly relevant documents.

Theme

Multilinguale Probleme

Similar documents (author)

1. Järvelin, K.: ¬An analysis of two approaches in information retrieval : from frameworks to study designs (2007) 4.99

   4.989572 = sum of:
     4.989572 = weight(author_txt:järvelin in 326) [ClassicSimilarity], result of:
       4.989572 = fieldWeight in 326, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.625 = fieldNorm(doc=326)
   

2. Järvelin, K.: Evaluation (2011) 4.99

   4.989572 = sum of:
     4.989572 = weight(author_txt:järvelin in 548) [ClassicSimilarity], result of:
       4.989572 = fieldWeight in 548, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.625 = fieldNorm(doc=548)
   

3. Järvelin, K.; Vakkari, P.: ¬The evolution of library and information science 1965-1985 : a content analysis of journal titles (1993) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 4649) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 4649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=4649)
   

4. Kristensen, J.; Järvelin, K.: ¬The effectiveness of a searching thesaurus in free-text searching in a full-text database (1990) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 2043) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 2043, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=2043)
   

5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 3.99

   3.9916575 = sum of:
     3.9916575 = weight(author_txt:järvelin in 5907) [ClassicSimilarity], result of:
       3.9916575 = fieldWeight in 5907, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.983315 = idf(docFreq=40, maxDocs=44218)
         0.5 = fieldNorm(doc=5907)
   

Similar documents (content)

1. Lehtokangas, R.; Keskustalo, H.; Järvelin, K.: Experiments with transitive dictionary translation and pseudo-relevance feedback using graded relevance assessments (2008) 0.65

   0.6491291 = sum of:
     0.6491291 = product of:
       1.2483252 = sum of:
         0.041419752 = weight(abstract_txt:language in 1349) [ClassicSimilarity], result of:
           0.041419752 = score(doc=1349,freq=5.0), product of:
             0.07086787 = queryWeight, product of:
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.016945573 = queryNorm
             0.5844645 = fieldWeight in 1349, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.0820196 = weight(abstract_txt:graded in 1349) [ClassicSimilarity], result of:
           0.0820196 = score(doc=1349,freq=1.0), product of:
             0.15167108 = queryWeight, product of:
               1.0344553 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.016945573 = queryNorm
             0.5407728 = fieldWeight in 1349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.086481966 = weight(abstract_txt:liberal in 1349) [ClassicSimilarity], result of:
           0.086481966 = score(doc=1349,freq=1.0), product of:
             0.1571236 = queryWeight, product of:
               1.0528852 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.016945573 = queryNorm
             0.55040723 = fieldWeight in 1349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.056219812 = weight(abstract_txt:performance in 1349) [ClassicSimilarity], result of:
           0.056219812 = score(doc=1349,freq=5.0), product of:
             0.08687683 = queryWeight, product of:
               1.1072031 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016945573 = queryNorm
             0.6471209 = fieldWeight in 1349, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.012307216 = weight(abstract_txt:based in 1349) [ClassicSimilarity], result of:
           0.012307216 = score(doc=1349,freq=1.0), product of:
             0.061769113 = queryWeight, product of:
               1.1434222 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016945573 = queryNorm
             0.19924548 = fieldWeight in 1349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.112639934 = weight(abstract_txt:stringent in 1349) [ClassicSimilarity], result of:
           0.112639934 = score(doc=1349,freq=1.0), product of:
             0.18739268 = queryWeight, product of:
               1.149838 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.016945573 = queryNorm
             0.6010904 = fieldWeight in 1349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.0629317 = weight(abstract_txt:cross in 1349) [ClassicSimilarity], result of:
           0.0629317 = score(doc=1349,freq=2.0), product of:
             0.12711711 = queryWeight, product of:
               1.3392984 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.016945573 = queryNorm
             0.49506867 = fieldWeight in 1349, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.036817174 = weight(abstract_txt:retrieval in 1349) [ClassicSimilarity], result of:
           0.036817174 = score(doc=1349,freq=3.0), product of:
             0.097867295 = queryWeight, product of:
               1.6619161 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016945573 = queryNorm
             0.37619486 = fieldWeight in 1349, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.16768447 = weight(abstract_txt:finnish in 1349) [ClassicSimilarity], result of:
           0.16768447 = score(doc=1349,freq=2.0), product of:
             0.24431658 = queryWeight, product of:
               1.856743 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016945573 = queryNorm
             0.6863409 = fieldWeight in 1349, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.044260778 = weight(abstract_txt:were in 1349) [ClassicSimilarity], result of:
           0.044260778 = score(doc=1349,freq=2.0), product of:
             0.13644274 = queryWeight, product of:
               2.1939187 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.016945573 = queryNorm
             0.32439086 = fieldWeight in 1349, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.10523564 = weight(abstract_txt:relevance in 1349) [ClassicSimilarity], result of:
           0.10523564 = score(doc=1349,freq=3.0), product of:
             0.19711176 = queryWeight, product of:
               2.3585582 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016945573 = queryNorm
             0.5338882 = fieldWeight in 1349, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.18205461 = weight(abstract_txt:swedish in 1349) [ClassicSimilarity], result of:
           0.18205461 = score(doc=1349,freq=1.0), product of:
             0.3722196 = queryWeight, product of:
               2.8068588 = boost
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.016945573 = queryNorm
             0.48910537 = fieldWeight in 1349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
         0.2582526 = weight(abstract_txt:translation in 1349) [ClassicSimilarity], result of:
           0.2582526 = score(doc=1349,freq=3.0), product of:
             0.386311 = queryWeight, product of:
               3.6915934 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.016945573 = queryNorm
             0.66850954 = fieldWeight in 1349, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=1349)
       0.52 = coord(13/25)
   

2. Talvensaari, T.; Laurikkala, J.; Järvelin, K.; Juhola, M.: ¬A study on automatic creation of a comparable document collection in cross-language information retrieval (2006) 0.52

   0.52126306 = sum of:
     0.52126306 = product of:
       1.002429 = sum of:
         0.018523475 = weight(abstract_txt:language in 5601) [ClassicSimilarity], result of:
           0.018523475 = score(doc=5601,freq=1.0), product of:
             0.07086787 = queryWeight, product of:
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.016945573 = queryNorm
             0.26138046 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.052378494 = weight(abstract_txt:collections in 5601) [ClassicSimilarity], result of:
           0.052378494 = score(doc=5601,freq=4.0), product of:
             0.08927223 = queryWeight, product of:
               1.1223634 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.016945573 = queryNorm
             0.58672774 = fieldWeight in 5601, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.012307216 = weight(abstract_txt:based in 5601) [ClassicSimilarity], result of:
           0.012307216 = score(doc=5601,freq=1.0), product of:
             0.061769113 = queryWeight, product of:
               1.1434222 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016945573 = queryNorm
             0.19924548 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.044499435 = weight(abstract_txt:cross in 5601) [ClassicSimilarity], result of:
           0.044499435 = score(doc=5601,freq=1.0), product of:
             0.12711711 = queryWeight, product of:
               1.3392984 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.016945573 = queryNorm
             0.35006642 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.11770976 = weight(abstract_txt:comparable in 5601) [ClassicSimilarity], result of:
           0.11770976 = score(doc=5601,freq=2.0), product of:
             0.19297425 = queryWeight, product of:
               1.650156 = boost
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.016945573 = queryNorm
             0.60997653 = fieldWeight in 5601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.901097 = idf(docFreq=120, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.021256406 = weight(abstract_txt:retrieval in 5601) [ClassicSimilarity], result of:
           0.021256406 = score(doc=5601,freq=1.0), product of:
             0.097867295 = queryWeight, product of:
               1.6619161 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016945573 = queryNorm
             0.21719621 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.057711508 = weight(abstract_txt:query in 5601) [ClassicSimilarity], result of:
           0.057711508 = score(doc=5601,freq=2.0), product of:
             0.13735034 = queryWeight, product of:
               1.7050449 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.016945573 = queryNorm
             0.4201774 = fieldWeight in 5601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.16768447 = weight(abstract_txt:finnish in 5601) [ClassicSimilarity], result of:
           0.16768447 = score(doc=5601,freq=2.0), product of:
             0.24431658 = queryWeight, product of:
               1.856743 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016945573 = queryNorm
             0.6863409 = fieldWeight in 5601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.08280433 = weight(abstract_txt:were in 5601) [ClassicSimilarity], result of:
           0.08280433 = score(doc=5601,freq=7.0), product of:
             0.13644274 = queryWeight, product of:
               2.1939187 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.016945573 = queryNorm
             0.6068797 = fieldWeight in 5601, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.060757827 = weight(abstract_txt:relevance in 5601) [ClassicSimilarity], result of:
           0.060757827 = score(doc=5601,freq=1.0), product of:
             0.19711176 = queryWeight, product of:
               2.3585582 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016945573 = queryNorm
             0.3082405 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.0531824 = weight(abstract_txt:documents in 5601) [ClassicSimilarity], result of:
           0.0531824 = score(doc=5601,freq=1.0), product of:
             0.20646831 = queryWeight, product of:
               2.9563963 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.016945573 = queryNorm
             0.2575814 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.102751255 = weight(abstract_txt:highly in 5601) [ClassicSimilarity], result of:
           0.102751255 = score(doc=5601,freq=1.0), product of:
             0.30139714 = queryWeight, product of:
               3.2607305 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.016945573 = queryNorm
             0.34091648 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
         0.21086234 = weight(abstract_txt:translation in 5601) [ClassicSimilarity], result of:
           0.21086234 = score(doc=5601,freq=2.0), product of:
             0.386311 = queryWeight, product of:
               3.6915934 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.016945573 = queryNorm
             0.54583573 = fieldWeight in 5601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=5601)
       0.52 = coord(13/25)
   

3. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.51

   0.5135796 = sum of:
     0.5135796 = product of:
       1.0699575 = sum of:
         0.1025245 = weight(abstract_txt:graded in 2884) [ClassicSimilarity], result of:
           0.1025245 = score(doc=2884,freq=1.0), product of:
             0.15167108 = queryWeight, product of:
               1.0344553 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.016945573 = queryNorm
             0.675966 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.10810245 = weight(abstract_txt:liberal in 2884) [ClassicSimilarity], result of:
           0.10810245 = score(doc=2884,freq=1.0), product of:
             0.1571236 = queryWeight, product of:
               1.0528852 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.016945573 = queryNorm
             0.688009 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.028807044 = weight(abstract_txt:level in 2884) [ClassicSimilarity], result of:
           0.028807044 = score(doc=2884,freq=1.0), product of:
             0.08197728 = queryWeight, product of:
               1.0755289 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.016945573 = queryNorm
             0.3514028 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.021756291 = weight(abstract_txt:based in 2884) [ClassicSimilarity], result of:
           0.021756291 = score(doc=2884,freq=2.0), product of:
             0.061769113 = queryWeight, product of:
               1.1434222 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016945573 = queryNorm
             0.35221958 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.04068665 = weight(abstract_txt:test in 2884) [ClassicSimilarity], result of:
           0.04068665 = score(doc=2884,freq=1.0), product of:
             0.10319587 = queryWeight, product of:
               1.2067199 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.016945573 = queryNorm
             0.39426625 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.03757637 = weight(abstract_txt:retrieval in 2884) [ClassicSimilarity], result of:
           0.03757637 = score(doc=2884,freq=2.0), product of:
             0.097867295 = queryWeight, product of:
               1.6619161 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016945573 = queryNorm
             0.38395226 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.08835234 = weight(abstract_txt:query in 2884) [ClassicSimilarity], result of:
           0.08835234 = score(doc=2884,freq=3.0), product of:
             0.13735034 = queryWeight, product of:
               1.7050449 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.016945573 = queryNorm
             0.6432626 = fieldWeight in 2884, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.03912137 = weight(abstract_txt:were in 2884) [ClassicSimilarity], result of:
           0.03912137 = score(doc=2884,freq=1.0), product of:
             0.13644274 = queryWeight, product of:
               2.1939187 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.016945573 = queryNorm
             0.28672373 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.15189457 = weight(abstract_txt:relevance in 2884) [ClassicSimilarity], result of:
           0.15189457 = score(doc=2884,freq=4.0), product of:
             0.19711176 = queryWeight, product of:
               2.3585582 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016945573 = queryNorm
             0.7706013 = fieldWeight in 2884, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.13653955 = weight(abstract_txt:relevant in 2884) [ClassicSimilarity], result of:
           0.13653955 = score(doc=2884,freq=3.0), product of:
             0.21767385 = queryWeight, product of:
               2.7710762 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.016945573 = queryNorm
             0.62726665 = fieldWeight in 2884, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.13295601 = weight(abstract_txt:documents in 2884) [ClassicSimilarity], result of:
           0.13295601 = score(doc=2884,freq=4.0), product of:
             0.20646831 = queryWeight, product of:
               2.9563963 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.016945573 = queryNorm
             0.64395356 = fieldWeight in 2884, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.18164027 = weight(abstract_txt:highly in 2884) [ClassicSimilarity], result of:
           0.18164027 = score(doc=2884,freq=2.0), product of:
             0.30139714 = queryWeight, product of:
               3.2607305 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.016945573 = queryNorm
             0.6026609 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
       0.48 = coord(12/25)
   

4. Airio, E.: Who benefits from CLIR in web retrieval? (2008) 0.45

   0.44513893 = sum of:
     0.44513893 = product of:
       1.0116794 = sum of:
         0.058576375 = weight(abstract_txt:language in 2342) [ClassicSimilarity], result of:
           0.058576375 = score(doc=2342,freq=10.0), product of:
             0.07086787 = queryWeight, product of:
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.016945573 = queryNorm
             0.82655764 = fieldWeight in 2342, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.025142265 = weight(abstract_txt:performance in 2342) [ClassicSimilarity], result of:
           0.025142265 = score(doc=2342,freq=1.0), product of:
             0.08687683 = queryWeight, product of:
               1.1072031 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016945573 = queryNorm
             0.28940126 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.012307216 = weight(abstract_txt:based in 2342) [ClassicSimilarity], result of:
           0.012307216 = score(doc=2342,freq=1.0), product of:
             0.061769113 = queryWeight, product of:
               1.1434222 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016945573 = queryNorm
             0.19924548 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.032549318 = weight(abstract_txt:test in 2342) [ClassicSimilarity], result of:
           0.032549318 = score(doc=2342,freq=1.0), product of:
             0.10319587 = queryWeight, product of:
               1.2067199 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.016945573 = queryNorm
             0.315413 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.044499435 = weight(abstract_txt:cross in 2342) [ClassicSimilarity], result of:
           0.044499435 = score(doc=2342,freq=1.0), product of:
             0.12711711 = queryWeight, product of:
               1.3392984 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.016945573 = queryNorm
             0.35006642 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.036817174 = weight(abstract_txt:retrieval in 2342) [ClassicSimilarity], result of:
           0.036817174 = score(doc=2342,freq=3.0), product of:
             0.097867295 = queryWeight, product of:
               1.6619161 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016945573 = queryNorm
             0.37619486 = fieldWeight in 2342, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.091249906 = weight(abstract_txt:query in 2342) [ClassicSimilarity], result of:
           0.091249906 = score(doc=2342,freq=5.0), product of:
             0.13735034 = queryWeight, product of:
               1.7050449 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.016945573 = queryNorm
             0.6643588 = fieldWeight in 2342, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.16768447 = weight(abstract_txt:finnish in 2342) [ClassicSimilarity], result of:
           0.16768447 = score(doc=2342,freq=2.0), product of:
             0.24431658 = queryWeight, product of:
               1.856743 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016945573 = queryNorm
             0.6863409 = fieldWeight in 2342, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.06259419 = weight(abstract_txt:were in 2342) [ClassicSimilarity], result of:
           0.06259419 = score(doc=2342,freq=4.0), product of:
             0.13644274 = queryWeight, product of:
               2.1939187 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.016945573 = queryNorm
             0.45875797 = fieldWeight in 2342, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.18205461 = weight(abstract_txt:swedish in 2342) [ClassicSimilarity], result of:
           0.18205461 = score(doc=2342,freq=1.0), product of:
             0.3722196 = queryWeight, product of:
               2.8068588 = boost
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.016945573 = queryNorm
             0.48910537 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.2982044 = weight(abstract_txt:translation in 2342) [ClassicSimilarity], result of:
           0.2982044 = score(doc=2342,freq=4.0), product of:
             0.386311 = queryWeight, product of:
               3.6915934 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.016945573 = queryNorm
             0.7719283 = fieldWeight in 2342, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
       0.44 = coord(11/25)
   

5. Moreira Orengo, V.; Huyck, C.: Relevance feedback and cross-language information retrieval (2006) 0.36

   0.3640457 = sum of:
     0.3640457 = product of:
       0.9101143 = sum of:
         0.023154344 = weight(abstract_txt:language in 970) [ClassicSimilarity], result of:
           0.023154344 = score(doc=970,freq=1.0), product of:
             0.07086787 = queryWeight, product of:
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.016945573 = queryNorm
             0.32672557 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.04444566 = weight(abstract_txt:performance in 970) [ClassicSimilarity], result of:
           0.04444566 = score(doc=970,freq=2.0), product of:
             0.08687683 = queryWeight, product of:
               1.1072031 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016945573 = queryNorm
             0.51159394 = fieldWeight in 970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.05562429 = weight(abstract_txt:cross in 970) [ClassicSimilarity], result of:
           0.05562429 = score(doc=970,freq=1.0), product of:
             0.12711711 = queryWeight, product of:
               1.3392984 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.016945573 = queryNorm
             0.43758303 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.026570506 = weight(abstract_txt:retrieval in 970) [ClassicSimilarity], result of:
           0.026570506 = score(doc=970,freq=1.0), product of:
             0.097867295 = queryWeight, product of:
               1.6619161 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.016945573 = queryNorm
             0.27149525 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.051010247 = weight(abstract_txt:query in 970) [ClassicSimilarity], result of:
           0.051010247 = score(doc=970,freq=1.0), product of:
             0.13735034 = queryWeight, product of:
               1.7050449 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.016945573 = queryNorm
             0.37138787 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.03912137 = weight(abstract_txt:were in 970) [ClassicSimilarity], result of:
           0.03912137 = score(doc=970,freq=1.0), product of:
             0.13644274 = queryWeight, product of:
               2.1939187 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.016945573 = queryNorm
             0.28672373 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.15189457 = weight(abstract_txt:relevance in 970) [ClassicSimilarity], result of:
           0.15189457 = score(doc=970,freq=4.0), product of:
             0.19711176 = queryWeight, product of:
               2.3585582 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016945573 = queryNorm
             0.7706013 = fieldWeight in 970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.07883114 = weight(abstract_txt:relevant in 970) [ClassicSimilarity], result of:
           0.07883114 = score(doc=970,freq=1.0), product of:
             0.21767385 = queryWeight, product of:
               2.7710762 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.016945573 = queryNorm
             0.36215258 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.17588425 = weight(abstract_txt:documents in 970) [ClassicSimilarity], result of:
           0.17588425 = score(doc=970,freq=7.0), product of:
             0.20646831 = queryWeight, product of:
               2.9563963 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.016945573 = queryNorm
             0.8518704 = fieldWeight in 970, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
         0.26357794 = weight(abstract_txt:translation in 970) [ClassicSimilarity], result of:
           0.26357794 = score(doc=970,freq=2.0), product of:
             0.386311 = queryWeight, product of:
               3.6915934 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.016945573 = queryNorm
             0.68229467 = fieldWeight in 970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.078125 = fieldNorm(doc=970)
       0.4 = coord(10/25)