Document (#13232)

Author

Tague-Sutcliffe, J.M.

Title

Some perspectives on the evaluation of information retrieval systems

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.1-3

Year

1996

Abstract

As an introduction to the papers in this special issue, some of the major problems facing in investigators evaluating information retrieval systems are presented. These problems include the question of the necessity of using real users, as opposed to subject experts, in making relevance judgements, the possibility of evaluating individual components of the retrieval process, rather than the process as a whole, the kinds of aggregation that are appropriate for the measures used in evaluating systems, the value of an analytic or simulatory, as opposed to an experimental, approach in evaluation retrieval systems, the difficulties in evaluating interactive systems, and the kind of generalization which are possible from information retrieval tests.

Theme

Retrievalstudien

Similar documents (author)

1. Tague-Sutcliffe, J.: ¬The pragmatics of information retrieval experimentation, revisited (1992) 6.39

   6.387083 = sum of:
     6.387083 = sum of:
       3.083463 = weight(author_txt:sutcliffe in 1734) [ClassicSimilarity], result of:
         3.083463 = score(doc=1734,freq=1.0), product of:
           0.6906719 = queryWeight, product of:
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.07735259 = queryNorm
           4.4644394 = fieldWeight in 1734, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.5 = fieldNorm(doc=1734)
       3.3036203 = weight(author_txt:tague in 1734) [ClassicSimilarity], result of:
         3.3036203 = score(doc=1734,freq=1.0), product of:
           0.7231683 = queryWeight, product of:
             1.0232549 = boost
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.07735259 = queryNorm
           4.5682592 = fieldWeight in 1734, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.5 = fieldNorm(doc=1734)
   

2. Tague-Sutcliffe, J.: Measuring information : an information services perspective (1995) 6.39

   6.387083 = sum of:
     6.387083 = sum of:
       3.083463 = weight(author_txt:sutcliffe in 293) [ClassicSimilarity], result of:
         3.083463 = score(doc=293,freq=1.0), product of:
           0.6906719 = queryWeight, product of:
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.07735259 = queryNorm
           4.4644394 = fieldWeight in 293, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.5 = fieldNorm(doc=293)
       3.3036203 = weight(author_txt:tague in 293) [ClassicSimilarity], result of:
         3.3036203 = score(doc=293,freq=1.0), product of:
           0.7231683 = queryWeight, product of:
             1.0232549 = boost
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.07735259 = queryNorm
           4.5682592 = fieldWeight in 293, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.5 = fieldNorm(doc=293)
   

3. Tague-Sutcliffe, J.: Information retrieval experimentation (1996) 6.39

   6.387083 = sum of:
     6.387083 = sum of:
       3.083463 = weight(author_txt:sutcliffe in 862) [ClassicSimilarity], result of:
         3.083463 = score(doc=862,freq=1.0), product of:
           0.6906719 = queryWeight, product of:
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.07735259 = queryNorm
           4.4644394 = fieldWeight in 862, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.5 = fieldNorm(doc=862)
       3.3036203 = weight(author_txt:tague in 862) [ClassicSimilarity], result of:
         3.3036203 = score(doc=862,freq=1.0), product of:
           0.7231683 = queryWeight, product of:
             1.0232549 = boost
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.07735259 = queryNorm
           4.5682592 = fieldWeight in 862, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.5 = fieldNorm(doc=862)
   

4. Tague-Sutcliffe, J.: Information retrieval experimentation (2009) 6.39

   6.387083 = sum of:
     6.387083 = sum of:
       3.083463 = weight(author_txt:sutcliffe in 788) [ClassicSimilarity], result of:
         3.083463 = score(doc=788,freq=1.0), product of:
           0.6906719 = queryWeight, product of:
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.07735259 = queryNorm
           4.4644394 = fieldWeight in 788, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.5 = fieldNorm(doc=788)
       3.3036203 = weight(author_txt:tague in 788) [ClassicSimilarity], result of:
         3.3036203 = score(doc=788,freq=1.0), product of:
           0.7231683 = queryWeight, product of:
             1.0232549 = boost
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.07735259 = queryNorm
           4.5682592 = fieldWeight in 788, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.5 = fieldNorm(doc=788)
   

5. Salminen, A.; Tague-Sutcliffe, J.; McClellan, C.: From text to hypertext by indexing (1995) 4.79

   4.790313 = sum of:
     4.790313 = sum of:
       2.3125973 = weight(author_txt:sutcliffe in 1931) [ClassicSimilarity], result of:
         2.3125973 = score(doc=1931,freq=1.0), product of:
           0.6906719 = queryWeight, product of:
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.07735259 = queryNorm
           3.3483295 = fieldWeight in 1931, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.928879 = idf(docFreq=15, maxDocs=44421)
             0.375 = fieldNorm(doc=1931)
       2.4777153 = weight(author_txt:tague in 1931) [ClassicSimilarity], result of:
         2.4777153 = score(doc=1931,freq=1.0), product of:
           0.7231683 = queryWeight, product of:
             1.0232549 = boost
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.07735259 = queryNorm
           3.4261944 = fieldWeight in 1931, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.1365185 = idf(docFreq=12, maxDocs=44421)
             0.375 = fieldNorm(doc=1931)
   

Similar documents (content)

1. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.17

   0.16986085 = sum of:
     0.16986085 = product of:
       0.6066459 = sum of:
         0.009540885 = weight(abstract_txt:information in 4311) [ClassicSimilarity], result of:
           0.009540885 = score(doc=4311,freq=1.0), product of:
             0.06310893 = queryWeight, product of:
               1.2929708 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020178286 = queryNorm
             0.15118122 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.022370787 = weight(abstract_txt:some in 4311) [ClassicSimilarity], result of:
           0.022370787 = score(doc=4311,freq=1.0), product of:
             0.09730209 = queryWeight, product of:
               1.3108673 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.020178286 = queryNorm
             0.22991067 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.035752457 = weight(abstract_txt:problems in 4311) [ClassicSimilarity], result of:
           0.035752457 = score(doc=4311,freq=1.0), product of:
             0.1330062 = queryWeight, product of:
               1.5326169 = boost
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.020178286 = queryNorm
             0.26880294 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.069973156 = weight(abstract_txt:evaluation in 4311) [ClassicSimilarity], result of:
           0.069973156 = score(doc=4311,freq=3.0), product of:
             0.14429408 = queryWeight, product of:
               1.5963273 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020178286 = queryNorm
             0.48493436 = fieldWeight in 4311, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.044596005 = weight(abstract_txt:systems in 4311) [ClassicSimilarity], result of:
           0.044596005 = score(doc=4311,freq=1.0), product of:
             0.20917603 = queryWeight, product of:
               3.0389504 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.020178286 = queryNorm
             0.21319844 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.066761434 = weight(abstract_txt:retrieval in 4311) [ClassicSimilarity], result of:
           0.066761434 = score(doc=4311,freq=2.0), product of:
             0.21726431 = queryWeight, product of:
               3.0971472 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020178286 = queryNorm
             0.3072821 = fieldWeight in 4311, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.35765114 = weight(abstract_txt:evaluating in 4311) [ClassicSimilarity], result of:
           0.35765114 = score(doc=4311,freq=4.0), product of:
             0.49011466 = queryWeight, product of:
               4.160653 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020178286 = queryNorm
             0.72972953 = fieldWeight in 4311, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
       0.28 = coord(7/25)
   

2. Dunlop, M.D.; Johnson, C.W.; Reid, J.: Exploring the layers of information retrieval evaluation (1998) 0.17

   0.16838774 = sum of:
     0.16838774 = product of:
       0.7016156 = sum of:
         0.024787944 = weight(abstract_txt:information in 4762) [ClassicSimilarity], result of:
           0.024787944 = score(doc=4762,freq=3.0), product of:
             0.06310893 = queryWeight, product of:
               1.2929708 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020178286 = queryNorm
             0.3927803 = fieldWeight in 4762, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
         0.04474592 = weight(abstract_txt:process in 4762) [ClassicSimilarity], result of:
           0.04474592 = score(doc=4762,freq=1.0), product of:
             0.1178807 = queryWeight, product of:
               1.4428428 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.020178286 = queryNorm
             0.37958646 = fieldWeight in 4762, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
         0.08569927 = weight(abstract_txt:evaluation in 4762) [ClassicSimilarity], result of:
           0.08569927 = score(doc=4762,freq=2.0), product of:
             0.14429408 = queryWeight, product of:
               1.5963273 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020178286 = queryNorm
             0.5939209 = fieldWeight in 4762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
         0.06689401 = weight(abstract_txt:systems in 4762) [ClassicSimilarity], result of:
           0.06689401 = score(doc=4762,freq=1.0), product of:
             0.20917603 = queryWeight, product of:
               3.0389504 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.020178286 = queryNorm
             0.31979766 = fieldWeight in 4762, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
         0.10014214 = weight(abstract_txt:retrieval in 4762) [ClassicSimilarity], result of:
           0.10014214 = score(doc=4762,freq=2.0), product of:
             0.21726431 = queryWeight, product of:
               3.0971472 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020178286 = queryNorm
             0.46092314 = fieldWeight in 4762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
         0.3793463 = weight(abstract_txt:evaluating in 4762) [ClassicSimilarity], result of:
           0.3793463 = score(doc=4762,freq=2.0), product of:
             0.49011466 = queryWeight, product of:
               4.160653 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020178286 = queryNorm
             0.77399504 = fieldWeight in 4762, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=4762)
       0.24 = coord(6/25)
   

3. Styltsvig, H.B.: Ontology-based information retrieval (2006) 0.17

   0.16782573 = sum of:
     0.16782573 = product of:
       0.4195643 = sum of:
         0.02979383 = weight(abstract_txt:introduction in 2154) [ClassicSimilarity], result of:
           0.02979383 = score(doc=2154,freq=1.0), product of:
             0.11324908 = queryWeight, product of:
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.020178286 = queryNorm
             0.26308233 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.03444239 = weight(abstract_txt:kind in 2154) [ClassicSimilarity], result of:
           0.03444239 = score(doc=2154,freq=1.0), product of:
             0.12474199 = queryWeight, product of:
               1.0495158 = boost
               5.8903265 = idf(docFreq=333, maxDocs=44421)
               0.020178286 = queryNorm
             0.27610904 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8903265 = idf(docFreq=333, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.017527726 = weight(abstract_txt:information in 2154) [ClassicSimilarity], result of:
           0.017527726 = score(doc=2154,freq=6.0), product of:
             0.06310893 = queryWeight, product of:
               1.2929708 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020178286 = queryNorm
             0.27773765 = fieldWeight in 2154, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.06541934 = weight(abstract_txt:aggregation in 2154) [ClassicSimilarity], result of:
           0.06541934 = score(doc=2154,freq=1.0), product of:
             0.19131744 = queryWeight, product of:
               1.2997503 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.020178286 = queryNorm
             0.34194133 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.016778091 = weight(abstract_txt:some in 2154) [ClassicSimilarity], result of:
           0.016778091 = score(doc=2154,freq=1.0), product of:
             0.09730209 = queryWeight, product of:
               1.3108673 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.020178286 = queryNorm
             0.172433 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.02237296 = weight(abstract_txt:process in 2154) [ClassicSimilarity], result of:
           0.02237296 = score(doc=2154,freq=1.0), product of:
             0.1178807 = queryWeight, product of:
               1.4428428 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.020178286 = queryNorm
             0.18979323 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.053628687 = weight(abstract_txt:problems in 2154) [ClassicSimilarity], result of:
           0.053628687 = score(doc=2154,freq=4.0), product of:
             0.1330062 = queryWeight, product of:
               1.5326169 = boost
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.020178286 = queryNorm
             0.4032044 = fieldWeight in 2154, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.05247987 = weight(abstract_txt:evaluation in 2154) [ClassicSimilarity], result of:
           0.05247987 = score(doc=2154,freq=3.0), product of:
             0.14429408 = queryWeight, product of:
               1.5963273 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020178286 = queryNorm
             0.36370078 = fieldWeight in 2154, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.033447005 = weight(abstract_txt:systems in 2154) [ClassicSimilarity], result of:
           0.033447005 = score(doc=2154,freq=1.0), product of:
             0.20917603 = queryWeight, product of:
               3.0389504 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.020178286 = queryNorm
             0.15989883 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.0936744 = weight(abstract_txt:retrieval in 2154) [ClassicSimilarity], result of:
           0.0936744 = score(doc=2154,freq=7.0), product of:
             0.21726431 = queryWeight, product of:
               3.0971472 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020178286 = queryNorm
             0.4311541 = fieldWeight in 2154, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
       0.4 = coord(10/25)
   

4. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.17

   0.16517876 = sum of:
     0.16517876 = product of:
       0.58992416 = sum of:
         0.050440356 = weight(abstract_txt:tests in 4700) [ClassicSimilarity], result of:
           0.050440356 = score(doc=4700,freq=1.0), product of:
             0.13279347 = queryWeight, product of:
               1.0828568 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.020178286 = queryNorm
             0.37984064 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.025242807 = weight(abstract_txt:information in 4700) [ClassicSimilarity], result of:
           0.025242807 = score(doc=4700,freq=7.0), product of:
             0.06310893 = queryWeight, product of:
               1.2929708 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020178286 = queryNorm
             0.3999879 = fieldWeight in 4700, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.035752457 = weight(abstract_txt:problems in 4700) [ClassicSimilarity], result of:
           0.035752457 = score(doc=4700,freq=1.0), product of:
             0.1330062 = queryWeight, product of:
               1.5326169 = boost
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.020178286 = queryNorm
             0.26880294 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.300847 = idf(docFreq=1636, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.080798045 = weight(abstract_txt:evaluation in 4700) [ClassicSimilarity], result of:
           0.080798045 = score(doc=4700,freq=4.0), product of:
             0.14429408 = queryWeight, product of:
               1.5963273 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020178286 = queryNorm
             0.559954 = fieldWeight in 4700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.077242546 = weight(abstract_txt:systems in 4700) [ClassicSimilarity], result of:
           0.077242546 = score(doc=4700,freq=3.0), product of:
             0.20917603 = queryWeight, product of:
               3.0389504 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.020178286 = queryNorm
             0.36927053 = fieldWeight in 4700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.1416224 = weight(abstract_txt:retrieval in 4700) [ClassicSimilarity], result of:
           0.1416224 = score(doc=4700,freq=9.0), product of:
             0.21726431 = queryWeight, product of:
               3.0971472 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020178286 = queryNorm
             0.6518438 = fieldWeight in 4700, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.17882557 = weight(abstract_txt:evaluating in 4700) [ClassicSimilarity], result of:
           0.17882557 = score(doc=4700,freq=1.0), product of:
             0.49011466 = queryWeight, product of:
               4.160653 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020178286 = queryNorm
             0.36486477 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
       0.28 = coord(7/25)
   

5. Rada, R.: Connecting and evaluating thesauri : issues and cases (1987) 0.16

   0.15793446 = sum of:
     0.15793446 = product of:
       0.65806025 = sum of:
         0.06609886 = weight(abstract_txt:kinds in 822) [ClassicSimilarity], result of:
           0.06609886 = score(doc=822,freq=1.0), product of:
             0.12135559 = queryWeight, product of:
               1.0351721 = boost
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.020178286 = queryNorm
             0.54467094 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.014311328 = weight(abstract_txt:information in 822) [ClassicSimilarity], result of:
           0.014311328 = score(doc=822,freq=1.0), product of:
             0.06310893 = queryWeight, product of:
               1.2929708 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020178286 = queryNorm
             0.22677183 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.060598537 = weight(abstract_txt:evaluation in 822) [ClassicSimilarity], result of:
           0.060598537 = score(doc=822,freq=1.0), product of:
             0.14429408 = queryWeight, product of:
               1.5963273 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020178286 = queryNorm
             0.4199655 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.06689401 = weight(abstract_txt:systems in 822) [ClassicSimilarity], result of:
           0.06689401 = score(doc=822,freq=1.0), product of:
             0.20917603 = queryWeight, product of:
               3.0389504 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.020178286 = queryNorm
             0.31979766 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.0708112 = weight(abstract_txt:retrieval in 822) [ClassicSimilarity], result of:
           0.0708112 = score(doc=822,freq=1.0), product of:
             0.21726431 = queryWeight, product of:
               3.0971472 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020178286 = queryNorm
             0.3259219 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.3793463 = weight(abstract_txt:evaluating in 822) [ClassicSimilarity], result of:
           0.3793463 = score(doc=822,freq=2.0), product of:
             0.49011466 = queryWeight, product of:
               4.160653 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020178286 = queryNorm
             0.77399504 = fieldWeight in 822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
       0.24 = coord(6/25)