Document (#29394)

Author

Hansen, P.
Karlgren, J.

Title

Effects of foreign language and task scenario on relevance assessment

Source

Journal of documentation. 61(2005) no.5, S.623-639

Year

2005

Abstract

Purpose - This paper aims to investigate how readers assess relevance of retrieved documents in a foreign language they know well compared with their native language, and whether work-task scenario descriptions have effect on the assessment process. Design/methodology/approach - Queries, test collections, and relevance assessments were used from the 2002 Interactive CLEF. Swedish first-language speakers, fluent in English, were given simulated information-seeking scenarios and presented with retrieval results in both languages. Twenty-eight subjects in four groups were asked to rate the retrieved text documents by relevance. A two-level work-task scenario description framework was developed and applied to facilitate the study of context effects on the assessment process. Findings - Relevance assessment takes longer in a foreign language than in the user first language. The quality of assessments by comparison with pre-assessed results is inferior to those made in the users' first language. Work-task scenario descriptions had an effect on the assessment process, both by measured access time and by self-report by subjects. However, effects on results by traditional relevance ranking were detectable. This may be an argument for extending the traditional IR experimental topical relevance measures to cater for context effects. Originality/value - An extended two-level work-task scenario description framework was developed and applied. Contextual aspects had an effect on the relevance assessment process. English texts took longer to assess than Swedish and were assessed less well, especially for the most difficult queries. The IR research field needs to close this gap and to design information access systems with users' language competence in mind.

Footnote

Vgl. auch unter: http://www.emeraldinsight.com/10.1108/00220410510625831

Theme

Retrievalstudien

Similar documents (author)

1. Hansen, K.A.: Local breaking news : sources, technology, and new routines (1994) 5.23

   5.2279267 = sum of:
     5.2279267 = weight(author_txt:hansen in 1610) [ClassicSimilarity], result of:
       5.2279267 = score(doc=1610,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.11955025 = queryNorm
         5.227927 = fieldWeight in 1610, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.625 = fieldNorm(doc=1610)
   

2. Hansen, E.J.: Interactive video for reflection : learning theory and a new use of the medium (1994) 5.23

   5.2279267 = sum of:
     5.2279267 = weight(author_txt:hansen in 1988) [ClassicSimilarity], result of:
       5.2279267 = score(doc=1988,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.11955025 = queryNorm
         5.227927 = fieldWeight in 1988, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.625 = fieldNorm(doc=1988)
   

3. Hansen, B.: Konzept für die benutzerorientierte Erschließung von Kinderliteratur für einen Kinder-OPAC : am Beispiel von BÜCHERSCHATZ (1996) 5.23

   5.2279267 = sum of:
     5.2279267 = weight(author_txt:hansen in 480) [ClassicSimilarity], result of:
       5.2279267 = score(doc=480,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.11955025 = queryNorm
         5.227927 = fieldWeight in 480, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.625 = fieldNorm(doc=480)
   

4. Hansen, D.G.: Professionalizing library education, the California connection : James Gillis, Everett Perry, and Joseph Daniels (2004) 5.23

   5.2279267 = sum of:
     5.2279267 = weight(author_txt:hansen in 12) [ClassicSimilarity], result of:
       5.2279267 = score(doc=12,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.11955025 = queryNorm
         5.227927 = fieldWeight in 12, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.625 = fieldNorm(doc=12)
   

5. Friis-Hansen, J.B.: Subject retrieval in Denmark, 1975-1985 : a survey (1985) 4.18

   4.182341 = sum of:
     4.182341 = weight(author_txt:hansen in 1170) [ClassicSimilarity], result of:
       4.182341 = score(doc=1170,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.11955025 = queryNorm
         4.1823416 = fieldWeight in 1170, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.364683 = idf(docFreq=27, maxDocs=44218)
           0.5 = fieldNorm(doc=1170)
   

Similar documents (content)

1. Azpiazu, I.M.; Soledad Pera, M.: Is cross-lingual readability assessment possible? (2020) 0.36

   0.3576321 = sum of:
     0.3576321 = product of:
       0.8128002 = sum of:
         0.010683187 = weight(abstract_txt:with in 5868) [ClassicSimilarity], result of:
           0.010683187 = score(doc=5868,freq=3.0), product of:
             0.0451189 = queryWeight, product of:
               1.0339782 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.017456347 = queryNorm
             0.23677856 = fieldWeight in 5868, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.017688036 = weight(abstract_txt:results in 5868) [ClassicSimilarity], result of:
           0.017688036 = score(doc=5868,freq=2.0), product of:
             0.06567425 = queryWeight, product of:
               1.0803398 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.017456347 = queryNorm
             0.26932985 = fieldWeight in 5868, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.034199692 = weight(abstract_txt:english in 5868) [ClassicSimilarity], result of:
           0.034199692 = score(doc=5868,freq=1.0), product of:
             0.112185426 = queryWeight, product of:
               1.1528834 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.017456347 = queryNorm
             0.30484968 = fieldWeight in 5868, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.021444162 = weight(abstract_txt:first in 5868) [ClassicSimilarity], result of:
           0.021444162 = score(doc=5868,freq=1.0), product of:
             0.094078735 = queryWeight, product of:
               1.2930298 = boost
               4.168018 = idf(docFreq=1860, maxDocs=44218)
               0.017456347 = queryNorm
             0.22793847 = fieldWeight in 5868, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.168018 = idf(docFreq=1860, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.037124835 = weight(abstract_txt:process in 5868) [ClassicSimilarity], result of:
           0.037124835 = score(doc=5868,freq=2.0), product of:
             0.11849445 = queryWeight, product of:
               1.6756418 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.017456347 = queryNorm
             0.31330442 = fieldWeight in 5868, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.04740724 = weight(abstract_txt:effect in 5868) [ClassicSimilarity], result of:
           0.04740724 = score(doc=5868,freq=1.0), product of:
             0.15965475 = queryWeight, product of:
               1.6844329 = boost
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.017456347 = queryNorm
             0.29693598 = fieldWeight in 5868, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.03450682 = weight(abstract_txt:were in 5868) [ClassicSimilarity], result of:
           0.03450682 = score(doc=5868,freq=2.0), product of:
             0.12157053 = queryWeight, product of:
               1.8975854 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017456347 = queryNorm
             0.283842 = fieldWeight in 5868, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.09627741 = weight(abstract_txt:effects in 5868) [ClassicSimilarity], result of:
           0.09627741 = score(doc=5868,freq=2.0), product of:
             0.22366837 = queryWeight, product of:
               2.3021545 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.017456347 = queryNorm
             0.43044713 = fieldWeight in 5868, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.08169275 = weight(abstract_txt:language in 5868) [ClassicSimilarity], result of:
           0.08169275 = score(doc=5868,freq=2.0), product of:
             0.25257322 = queryWeight, product of:
               3.459719 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017456347 = queryNorm
             0.32344183 = fieldWeight in 5868, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.25267357 = weight(abstract_txt:assessment in 5868) [ClassicSimilarity], result of:
           0.25267357 = score(doc=5868,freq=5.0), product of:
             0.35893178 = queryWeight, product of:
               3.5717723 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.017456347 = queryNorm
             0.7039598 = fieldWeight in 5868, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
         0.17910247 = weight(abstract_txt:scenario in 5868) [ClassicSimilarity], result of:
           0.17910247 = score(doc=5868,freq=1.0), product of:
             0.4591656 = queryWeight, product of:
               3.687838 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.017456347 = queryNorm
             0.39006072 = fieldWeight in 5868, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5868)
       0.44 = coord(11/25)
   

2. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.28

   0.28122646 = sum of:
     0.28122646 = product of:
       0.7030661 = sum of:
         0.012209358 = weight(abstract_txt:with in 5169) [ClassicSimilarity], result of:
           0.012209358 = score(doc=5169,freq=3.0), product of:
             0.0451189 = queryWeight, product of:
               1.0339782 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.017456347 = queryNorm
             0.27060407 = fieldWeight in 5169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.050868012 = weight(abstract_txt:subjects in 5169) [ClassicSimilarity], result of:
           0.050868012 = score(doc=5169,freq=2.0), product of:
             0.10614027 = queryWeight, product of:
               1.1213915 = boost
               5.4221253 = idf(docFreq=530, maxDocs=44218)
               0.017456347 = queryNorm
             0.4792527 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4221253 = idf(docFreq=530, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.0711541 = weight(abstract_txt:assessed in 5169) [ClassicSimilarity], result of:
           0.0711541 = score(doc=5169,freq=1.0), product of:
             0.1672606 = queryWeight, product of:
               1.4077126 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.017456347 = queryNorm
             0.42540863 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.0246536 = weight(abstract_txt:work in 5169) [ClassicSimilarity], result of:
           0.0246536 = score(doc=5169,freq=1.0), product of:
             0.10395784 = queryWeight, product of:
               1.5694981 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.017456347 = queryNorm
             0.23714998 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.0300014 = weight(abstract_txt:process in 5169) [ClassicSimilarity], result of:
           0.0300014 = score(doc=5169,freq=1.0), product of:
             0.11849445 = queryWeight, product of:
               1.6756418 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.017456347 = queryNorm
             0.25318822 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.054179702 = weight(abstract_txt:effect in 5169) [ClassicSimilarity], result of:
           0.054179702 = score(doc=5169,freq=1.0), product of:
             0.15965475 = queryWeight, product of:
               1.6844329 = boost
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.017456347 = queryNorm
             0.3393554 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.048299488 = weight(abstract_txt:were in 5169) [ClassicSimilarity], result of:
           0.048299488 = score(doc=5169,freq=3.0), product of:
             0.12157053 = queryWeight, product of:
               1.8975854 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017456347 = queryNorm
             0.39729604 = fieldWeight in 5169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.0660177 = weight(abstract_txt:language in 5169) [ClassicSimilarity], result of:
           0.0660177 = score(doc=5169,freq=1.0), product of:
             0.25257322 = queryWeight, product of:
               3.459719 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017456347 = queryNorm
             0.26138046 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.12914176 = weight(abstract_txt:assessment in 5169) [ClassicSimilarity], result of:
           0.12914176 = score(doc=5169,freq=1.0), product of:
             0.35893178 = queryWeight, product of:
               3.5717723 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.017456347 = queryNorm
             0.35979474 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.21654102 = weight(abstract_txt:relevance in 5169) [ClassicSimilarity], result of:
           0.21654102 = score(doc=5169,freq=4.0), product of:
             0.35125336 = queryWeight, product of:
               4.079974 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017456347 = queryNorm
             0.616481 = fieldWeight in 5169, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
       0.4 = coord(10/25)
   

3. Brooks, T.A.: Topical subject expertise and the semantic distance model of relevance assessment (1995) 0.27

   0.2699537 = sum of:
     0.2699537 = product of:
       0.84360534 = sum of:
         0.008811345 = weight(abstract_txt:with in 4486) [ClassicSimilarity], result of:
           0.008811345 = score(doc=4486,freq=1.0), product of:
             0.0451189 = queryWeight, product of:
               1.0339782 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.017456347 = queryNorm
             0.19529167 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.08894263 = weight(abstract_txt:assessed in 4486) [ClassicSimilarity], result of:
           0.08894263 = score(doc=4486,freq=1.0), product of:
             0.1672606 = queryWeight, product of:
               1.4077126 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.017456347 = queryNorm
             0.5317608 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.100597076 = weight(abstract_txt:assessments in 4486) [ClassicSimilarity], result of:
           0.100597076 = score(doc=4486,freq=1.0), product of:
             0.18156992 = queryWeight, product of:
               1.4666927 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017456347 = queryNorm
             0.55404043 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.11730249 = weight(abstract_txt:effect in 4486) [ClassicSimilarity], result of:
           0.11730249 = score(doc=4486,freq=3.0), product of:
             0.15965475 = queryWeight, product of:
               1.6844329 = boost
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.017456347 = queryNorm
             0.73472595 = fieldWeight in 4486, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4296865 = idf(docFreq=526, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.034857154 = weight(abstract_txt:were in 4486) [ClassicSimilarity], result of:
           0.034857154 = score(doc=4486,freq=1.0), product of:
             0.12157053 = queryWeight, product of:
               1.8975854 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017456347 = queryNorm
             0.28672373 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.097254865 = weight(abstract_txt:effects in 4486) [ClassicSimilarity], result of:
           0.097254865 = score(doc=4486,freq=1.0), product of:
             0.22366837 = queryWeight, product of:
               2.3021545 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.017456347 = queryNorm
             0.43481725 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.1614272 = weight(abstract_txt:assessment in 4486) [ClassicSimilarity], result of:
           0.1614272 = score(doc=4486,freq=1.0), product of:
             0.35893178 = queryWeight, product of:
               3.5717723 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.017456347 = queryNorm
             0.44974342 = fieldWeight in 4486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
         0.23441255 = weight(abstract_txt:relevance in 4486) [ClassicSimilarity], result of:
           0.23441255 = score(doc=4486,freq=3.0), product of:
             0.35125336 = queryWeight, product of:
               4.079974 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017456347 = queryNorm
             0.6673603 = fieldWeight in 4486, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=4486)
       0.32 = coord(8/25)
   

4. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 0.27

   0.26934695 = sum of:
     0.26934695 = product of:
       0.9619534 = sum of:
         0.010573614 = weight(abstract_txt:with in 7469) [ClassicSimilarity], result of:
           0.010573614 = score(doc=7469,freq=1.0), product of:
             0.0451189 = queryWeight, product of:
               1.0339782 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.017456347 = queryNorm
             0.23435001 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.10673116 = weight(abstract_txt:assessed in 7469) [ClassicSimilarity], result of:
           0.10673116 = score(doc=7469,freq=1.0), product of:
             0.1672606 = queryWeight, product of:
               1.4077126 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.017456347 = queryNorm
             0.63811296 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.1707189 = weight(abstract_txt:assessments in 7469) [ClassicSimilarity], result of:
           0.1707189 = score(doc=7469,freq=2.0), product of:
             0.18156992 = queryWeight, product of:
               1.4666927 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017456347 = queryNorm
             0.94023776 = fieldWeight in 7469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.0369804 = weight(abstract_txt:work in 7469) [ClassicSimilarity], result of:
           0.0369804 = score(doc=7469,freq=1.0), product of:
             0.10395784 = queryWeight, product of:
               1.5694981 = boost
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.017456347 = queryNorm
             0.355725 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7943997 = idf(docFreq=2703, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.10024014 = weight(abstract_txt:task in 7469) [ClassicSimilarity], result of:
           0.10024014 = score(doc=7469,freq=1.0), product of:
             0.21770778 = queryWeight, product of:
               2.5393593 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.017456347 = queryNorm
             0.46043435 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.3070328 = weight(abstract_txt:scenario in 7469) [ClassicSimilarity], result of:
           0.3070328 = score(doc=7469,freq=1.0), product of:
             0.4591656 = queryWeight, product of:
               3.687838 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.017456347 = queryNorm
             0.66867554 = fieldWeight in 7469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
         0.22967644 = weight(abstract_txt:relevance in 7469) [ClassicSimilarity], result of:
           0.22967644 = score(doc=7469,freq=2.0), product of:
             0.35125336 = queryWeight, product of:
               4.079974 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017456347 = queryNorm
             0.65387684 = fieldWeight in 7469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=7469)
       0.28 = coord(7/25)
   

5. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.26

   0.2573601 = sum of:
     0.2573601 = product of:
       0.71488917 = sum of:
         0.009968899 = weight(abstract_txt:with in 139) [ClassicSimilarity], result of:
           0.009968899 = score(doc=139,freq=2.0), product of:
             0.0451189 = queryWeight, product of:
               1.0339782 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.017456347 = queryNorm
             0.22094731 = fieldWeight in 139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.030047825 = weight(abstract_txt:queries in 139) [ClassicSimilarity], result of:
           0.030047825 = score(doc=139,freq=1.0), product of:
             0.09414611 = queryWeight, product of:
               1.0561324 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.017456347 = queryNorm
             0.31916162 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.020214899 = weight(abstract_txt:results in 139) [ClassicSimilarity], result of:
           0.020214899 = score(doc=139,freq=2.0), product of:
             0.06567425 = queryWeight, product of:
               1.0803398 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.017456347 = queryNorm
             0.30780554 = fieldWeight in 139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.04196199 = weight(abstract_txt:retrieved in 139) [ClassicSimilarity], result of:
           0.04196199 = score(doc=139,freq=1.0), product of:
             0.117624484 = queryWeight, product of:
               1.1805001 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.017456347 = queryNorm
             0.35674536 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.080477655 = weight(abstract_txt:assessments in 139) [ClassicSimilarity], result of:
           0.080477655 = score(doc=139,freq=1.0), product of:
             0.18156992 = queryWeight, product of:
               1.4666927 = boost
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.017456347 = queryNorm
             0.44323233 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0917172 = idf(docFreq=99, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.18730484 = weight(abstract_txt:swedish in 139) [ClassicSimilarity], result of:
           0.18730484 = score(doc=139,freq=3.0), product of:
             0.22109857 = queryWeight, product of:
               1.6184905 = boost
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.017456347 = queryNorm
             0.84715533 = fieldWeight in 139, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.825686 = idf(docFreq=47, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.06235438 = weight(abstract_txt:were in 139) [ClassicSimilarity], result of:
           0.06235438 = score(doc=139,freq=5.0), product of:
             0.12157053 = queryWeight, product of:
               1.8975854 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.017456347 = queryNorm
             0.512907 = fieldWeight in 139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.0660177 = weight(abstract_txt:language in 139) [ClassicSimilarity], result of:
           0.0660177 = score(doc=139,freq=1.0), product of:
             0.25257322 = queryWeight, product of:
               3.459719 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017456347 = queryNorm
             0.26138046 = fieldWeight in 139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
         0.21654102 = weight(abstract_txt:relevance in 139) [ClassicSimilarity], result of:
           0.21654102 = score(doc=139,freq=4.0), product of:
             0.35125336 = queryWeight, product of:
               4.079974 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.017456347 = queryNorm
             0.616481 = fieldWeight in 139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=139)
       0.36 = coord(9/25)