Document (#18788)

Author

Frei, H.P.
Schäuble, P.

Title

Determining the effectiveness of retrieval algorithms

Source

Information processing and management. 27(1991) no.2/3, S.153-164

Year

1991

Abstract

A new effectiveness measure ('usefulness measure') is proposed to circumvent the problems associated with the classical recall and precision measures. It is difficult to evaluate systems that filter extremly dynamic information; the determination of all relevant dodcuments in a real life collection is hardly affordable, and the specification of binary relevance assessments is often problematic. The new measure relies on an statistical approach with which two retrieval algorithms are compared. In contrast to the classical recall and precision measures, the new measure requires only relative judgments, and the reply of the retrieval system os compared directly with the information need of the user rather than with the query. The new measure has the added ability to determine an error probability that indicates haw stable the usefulness measure is. Using a test collection of abstracts from CACM, it is shown that our new measure is also capable of disclosing the effect of manually assigned descriptors and yields a results similar to that of the traditional recall and precision measures.

Theme

Retrievalstudien

Aid

CACM

Similar documents (author)

1. Frei, H.P.; Meienberg, S.; Schäuble, P.: ¬The perils of interpreting recall and precision values (1991) 4.86

   4.8566275 = sum of:
     4.8566275 = sum of:
       2.1536624 = weight(author_txt:schäuble in 1786) [ClassicSimilarity], result of:
         2.1536624 = score(doc=1786,freq=1.0), product of:
           0.65180314 = queryWeight, product of:
             8.811096 = idf(docFreq=17, maxDocs=44421)
             0.07397526 = queryNorm
           3.304161 = fieldWeight in 1786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.811096 = idf(docFreq=17, maxDocs=44421)
             0.375 = fieldNorm(doc=1786)
       2.702965 = weight(author_txt:frei in 1786) [ClassicSimilarity], result of:
         2.702965 = score(doc=1786,freq=1.0), product of:
           0.7583883 = queryWeight, product of:
             1.0786675 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07397526 = queryNorm
           3.5640912 = fieldWeight in 1786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=1786)
   

2. Frei, U.: Sacherschließung in der Schweiz (2003) 2.25

   2.2524707 = sum of:
     2.2524707 = product of:
       4.5049415 = sum of:
         4.5049415 = weight(author_txt:frei in 2538) [ClassicSimilarity], result of:
           4.5049415 = score(doc=2538,freq=1.0), product of:
             0.7583883 = queryWeight, product of:
               1.0786675 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07397526 = queryNorm
             5.9401517 = fieldWeight in 2538, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=2538)
       0.5 = coord(1/2)
   

3. Frei, R.: Informationswissenschaftliche Begriffe und Kernprozesse aus Sicht des Radikalen Konstruktivismus (2009) 2.25

   2.2524707 = sum of:
     2.2524707 = product of:
       4.5049415 = sum of:
         4.5049415 = weight(author_txt:frei in 4268) [ClassicSimilarity], result of:
           4.5049415 = score(doc=4268,freq=1.0), product of:
             0.7583883 = queryWeight, product of:
               1.0786675 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07397526 = queryNorm
             5.9401517 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=4268)
       0.5 = coord(1/2)
   

4. Qiu, Y.; Frei, H.P.: Concept based query expansion (1993) 1.80

   1.8019766 = sum of:
     1.8019766 = product of:
       3.6039531 = sum of:
         3.6039531 = weight(author_txt:frei in 2677) [ClassicSimilarity], result of:
           3.6039531 = score(doc=2677,freq=1.0), product of:
             0.7583883 = queryWeight, product of:
               1.0786675 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07397526 = queryNorm
             4.7521214 = fieldWeight in 2677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.5 = fieldNorm(doc=2677)
       0.5 = coord(1/2)
   

5. Frei, H.P.; Stieger, D.: ¬The use of semantic links in hypertext information retrieval (1995) 1.80

   1.8019766 = sum of:
     1.8019766 = product of:
       3.6039531 = sum of:
         3.6039531 = weight(author_txt:frei in 1237) [ClassicSimilarity], result of:
           3.6039531 = score(doc=1237,freq=1.0), product of:
             0.7583883 = queryWeight, product of:
               1.0786675 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07397526 = queryNorm
             4.7521214 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.5 = fieldNorm(doc=1237)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.36

   0.3593635 = sum of:
     0.3593635 = product of:
       0.9982319 = sum of:
         0.010480976 = weight(abstract_txt:that in 5514) [ClassicSimilarity], result of:
           0.010480976 = score(doc=5514,freq=1.0), product of:
             0.056727346 = queryWeight, product of:
               1.3195585 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018177936 = queryNorm
             0.18476056 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.017428728 = weight(abstract_txt:with in 5514) [ClassicSimilarity], result of:
           0.017428728 = score(doc=5514,freq=2.0), product of:
             0.06319632 = queryWeight, product of:
               1.3927665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.018177936 = queryNorm
             0.2757871 = fieldWeight in 5514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.049804308 = weight(abstract_txt:compared in 5514) [ClassicSimilarity], result of:
           0.049804308 = score(doc=5514,freq=1.0), product of:
             0.1272602 = queryWeight, product of:
               1.3975383 = boost
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.018177936 = queryNorm
             0.3913581 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.052437928 = weight(abstract_txt:effectiveness in 5514) [ClassicSimilarity], result of:
           0.052437928 = score(doc=5514,freq=1.0), product of:
             0.13170785 = queryWeight, product of:
               1.4217501 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018177936 = queryNorm
             0.39813823 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.049941543 = weight(abstract_txt:retrieval in 5514) [ClassicSimilarity], result of:
           0.049941543 = score(doc=5514,freq=4.0), product of:
             0.09193899 = queryWeight, product of:
               1.4548323 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018177936 = queryNorm
             0.5432031 = fieldWeight in 5514, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.094877295 = weight(abstract_txt:measures in 5514) [ClassicSimilarity], result of:
           0.094877295 = score(doc=5514,freq=1.0), product of:
             0.22386521 = queryWeight, product of:
               2.2701595 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018177936 = queryNorm
             0.4238144 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.14163442 = weight(abstract_txt:precision in 5514) [ClassicSimilarity], result of:
           0.14163442 = score(doc=5514,freq=2.0), product of:
             0.2320853 = queryWeight, product of:
               2.3114626 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018177936 = queryNorm
             0.61026883 = fieldWeight in 5514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.19577463 = weight(abstract_txt:recall in 5514) [ClassicSimilarity], result of:
           0.19577463 = score(doc=5514,freq=3.0), product of:
             0.2515797 = queryWeight, product of:
               2.406583 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018177936 = queryNorm
             0.7781813 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.38585213 = weight(abstract_txt:measure in 5514) [ClassicSimilarity], result of:
           0.38585213 = score(doc=5514,freq=3.0), product of:
             0.52453864 = queryWeight, product of:
               5.3081136 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.018177936 = queryNorm
             0.73560286 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
       0.36 = coord(9/25)
   

2. Frei, H.P.; Meienberg, S.; Schäuble, P.: ¬The perils of interpreting recall and precision values (1991) 0.36

   0.35835245 = sum of:
     0.35835245 = product of:
       1.2798302 = sum of:
         0.023715742 = weight(abstract_txt:that in 1786) [ClassicSimilarity], result of:
           0.023715742 = score(doc=1786,freq=2.0), product of:
             0.056727346 = queryWeight, product of:
               1.3195585 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018177936 = queryNorm
             0.41806543 = fieldWeight in 1786, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.039953236 = weight(abstract_txt:retrieval in 1786) [ClassicSimilarity], result of:
           0.039953236 = score(doc=1786,freq=1.0), product of:
             0.09193899 = queryWeight, product of:
               1.4548323 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018177936 = queryNorm
             0.4345625 = fieldWeight in 1786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.11740068 = weight(abstract_txt:algorithms in 1786) [ClassicSimilarity], result of:
           0.11740068 = score(doc=1786,freq=1.0), product of:
             0.16477136 = queryWeight, product of:
               1.5902239 = boost
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.018177936 = queryNorm
             0.7125066 = fieldWeight in 1786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.14030723 = weight(abstract_txt:usefulness in 1786) [ClassicSimilarity], result of:
           0.14030723 = score(doc=1786,freq=1.0), product of:
             0.18556157 = queryWeight, product of:
               1.6875685 = boost
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.018177936 = queryNorm
             0.7561223 = fieldWeight in 1786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.16024107 = weight(abstract_txt:precision in 1786) [ClassicSimilarity], result of:
           0.16024107 = score(doc=1786,freq=1.0), product of:
             0.2320853 = queryWeight, product of:
               2.3114626 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018177936 = queryNorm
             0.6904404 = fieldWeight in 1786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.18084885 = weight(abstract_txt:recall in 1786) [ClassicSimilarity], result of:
           0.18084885 = score(doc=1786,freq=1.0), product of:
             0.2515797 = queryWeight, product of:
               2.406583 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018177936 = queryNorm
             0.7188531 = fieldWeight in 1786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
         0.6173634 = weight(abstract_txt:measure in 1786) [ClassicSimilarity], result of:
           0.6173634 = score(doc=1786,freq=3.0), product of:
             0.52453864 = queryWeight, product of:
               5.3081136 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.018177936 = queryNorm
             1.1769645 = fieldWeight in 1786, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.125 = fieldNorm(doc=1786)
       0.28 = coord(7/25)
   

3. Mowshowitz, A.; Kawaguchi, A.: Measuring search engine bias (2005) 0.32

   0.3206687 = sum of:
     0.3206687 = product of:
       0.89074636 = sum of:
         0.039825764 = weight(abstract_txt:collection in 2045) [ClassicSimilarity], result of:
           0.039825764 = score(doc=2045,freq=1.0), product of:
             0.10963706 = queryWeight, product of:
               1.2971677 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.018177936 = queryNorm
             0.36325094 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.010480976 = weight(abstract_txt:that in 2045) [ClassicSimilarity], result of:
           0.010480976 = score(doc=2045,freq=1.0), product of:
             0.056727346 = queryWeight, product of:
               1.3195585 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018177936 = queryNorm
             0.18476056 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.012323972 = weight(abstract_txt:with in 2045) [ClassicSimilarity], result of:
           0.012323972 = score(doc=2045,freq=1.0), product of:
             0.06319632 = queryWeight, product of:
               1.3927665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.018177936 = queryNorm
             0.19501092 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.024970772 = weight(abstract_txt:retrieval in 2045) [ClassicSimilarity], result of:
           0.024970772 = score(doc=2045,freq=1.0), product of:
             0.09193899 = queryWeight, product of:
               1.4548323 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018177936 = queryNorm
             0.27160156 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.10923426 = weight(abstract_txt:classical in 2045) [ClassicSimilarity], result of:
           0.10923426 = score(doc=2045,freq=1.0), product of:
             0.21482618 = queryWeight, product of:
               1.8157707 = boost
               6.5085106 = idf(docFreq=179, maxDocs=44421)
               0.018177936 = queryNorm
             0.5084774 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5085106 = idf(docFreq=179, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.094877295 = weight(abstract_txt:measures in 2045) [ClassicSimilarity], result of:
           0.094877295 = score(doc=2045,freq=1.0), product of:
             0.22386521 = queryWeight, product of:
               2.2701595 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018177936 = queryNorm
             0.4238144 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.10015067 = weight(abstract_txt:precision in 2045) [ClassicSimilarity], result of:
           0.10015067 = score(doc=2045,freq=1.0), product of:
             0.2320853 = queryWeight, product of:
               2.3114626 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018177936 = queryNorm
             0.43152526 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.11303053 = weight(abstract_txt:recall in 2045) [ClassicSimilarity], result of:
           0.11303053 = score(doc=2045,freq=1.0), product of:
             0.2515797 = queryWeight, product of:
               2.406583 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018177936 = queryNorm
             0.44928318 = fieldWeight in 2045, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
         0.38585213 = weight(abstract_txt:measure in 2045) [ClassicSimilarity], result of:
           0.38585213 = score(doc=2045,freq=3.0), product of:
             0.52453864 = queryWeight, product of:
               5.3081136 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.018177936 = queryNorm
             0.73560286 = fieldWeight in 2045, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=2045)
       0.36 = coord(9/25)
   

4. Ahlgren, P.; Grönqvist, L.: Evaluation of retrieval effectiveness with incomplete relevance data : theoretical and experimental comparison of three measures (2008) 0.31

   0.30870697 = sum of:
     0.30870697 = product of:
       0.8575193 = sum of:
         0.08758243 = weight(abstract_txt:stable in 3032) [ClassicSimilarity], result of:
           0.08758243 = score(doc=3032,freq=1.0), product of:
             0.13031523 = queryWeight, product of:
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.018177936 = queryNorm
             0.67208135 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.017786806 = weight(abstract_txt:that in 3032) [ClassicSimilarity], result of:
           0.017786806 = score(doc=3032,freq=2.0), product of:
             0.056727346 = queryWeight, product of:
               1.3195585 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018177936 = queryNorm
             0.31354907 = fieldWeight in 3032, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.014788766 = weight(abstract_txt:with in 3032) [ClassicSimilarity], result of:
           0.014788766 = score(doc=3032,freq=1.0), product of:
             0.06319632 = queryWeight, product of:
               1.3927665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.018177936 = queryNorm
             0.23401311 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.059765168 = weight(abstract_txt:compared in 3032) [ClassicSimilarity], result of:
           0.059765168 = score(doc=3032,freq=1.0), product of:
             0.1272602 = queryWeight, product of:
               1.3975383 = boost
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.018177936 = queryNorm
             0.4696297 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.06292552 = weight(abstract_txt:effectiveness in 3032) [ClassicSimilarity], result of:
           0.06292552 = score(doc=3032,freq=1.0), product of:
             0.13170785 = queryWeight, product of:
               1.4217501 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018177936 = queryNorm
             0.4777659 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.02996493 = weight(abstract_txt:retrieval in 3032) [ClassicSimilarity], result of:
           0.02996493 = score(doc=3032,freq=1.0), product of:
             0.09193899 = queryWeight, product of:
               1.4548323 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018177936 = queryNorm
             0.3259219 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.19719876 = weight(abstract_txt:measures in 3032) [ClassicSimilarity], result of:
           0.19719876 = score(doc=3032,freq=3.0), product of:
             0.22386521 = queryWeight, product of:
               2.2701595 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018177936 = queryNorm
             0.88088167 = fieldWeight in 3032, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.12018081 = weight(abstract_txt:precision in 3032) [ClassicSimilarity], result of:
           0.12018081 = score(doc=3032,freq=1.0), product of:
             0.2320853 = queryWeight, product of:
               2.3114626 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018177936 = queryNorm
             0.5178303 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.26732618 = weight(abstract_txt:measure in 3032) [ClassicSimilarity], result of:
           0.26732618 = score(doc=3032,freq=1.0), product of:
             0.52453864 = queryWeight, product of:
               5.3081136 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.018177936 = queryNorm
             0.5096406 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
       0.36 = coord(9/25)
   

5. Wan, T.-L.; Evens, M.; Wan, Y.-W.; Pao, Y.-Y.: Experiments with automatic indexing and a relational thesaurus in a Chinese information retrieval system (1997) 0.30

   0.30418584 = sum of:
     0.30418584 = product of:
       0.9505808 = sum of:
         0.017786806 = weight(abstract_txt:that in 956) [ClassicSimilarity], result of:
           0.017786806 = score(doc=956,freq=2.0), product of:
             0.056727346 = queryWeight, product of:
               1.3195585 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018177936 = queryNorm
             0.31354907 = fieldWeight in 956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.020914473 = weight(abstract_txt:with in 956) [ClassicSimilarity], result of:
           0.020914473 = score(doc=956,freq=2.0), product of:
             0.06319632 = queryWeight, product of:
               1.3927665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.018177936 = queryNorm
             0.33094448 = fieldWeight in 956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.108990185 = weight(abstract_txt:effectiveness in 956) [ClassicSimilarity], result of:
           0.108990185 = score(doc=956,freq=3.0), product of:
             0.13170785 = queryWeight, product of:
               1.4217501 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018177936 = queryNorm
             0.82751477 = fieldWeight in 956, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.05992986 = weight(abstract_txt:retrieval in 956) [ClassicSimilarity], result of:
           0.05992986 = score(doc=956,freq=4.0), product of:
             0.09193899 = queryWeight, product of:
               1.4548323 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018177936 = queryNorm
             0.6518438 = fieldWeight in 956, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.11385276 = weight(abstract_txt:measures in 956) [ClassicSimilarity], result of:
           0.11385276 = score(doc=956,freq=1.0), product of:
             0.22386521 = queryWeight, product of:
               2.2701595 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018177936 = queryNorm
             0.5085773 = fieldWeight in 956, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.16996132 = weight(abstract_txt:precision in 956) [ClassicSimilarity], result of:
           0.16996132 = score(doc=956,freq=2.0), product of:
             0.2320853 = queryWeight, product of:
               2.3114626 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.018177936 = queryNorm
             0.73232263 = fieldWeight in 956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.19181918 = weight(abstract_txt:recall in 956) [ClassicSimilarity], result of:
           0.19181918 = score(doc=956,freq=2.0), product of:
             0.2515797 = queryWeight, product of:
               2.406583 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.018177936 = queryNorm
             0.76245886 = fieldWeight in 956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
         0.26732618 = weight(abstract_txt:measure in 956) [ClassicSimilarity], result of:
           0.26732618 = score(doc=956,freq=1.0), product of:
             0.52453864 = queryWeight, product of:
               5.3081136 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.018177936 = queryNorm
             0.5096406 = fieldWeight in 956, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.09375 = fieldNorm(doc=956)
       0.32 = coord(8/25)