Document (#27264)

Author

Della Mea, V.
Mizzaro, S.

Title

Measuring retrieval effectiveness : a new proposal and a first experimental validation

Source

Journal of the American Society for Information Science and Technology. 55(2004) no.6, S.530-543

Year

2004

Abstract

Most common effectiveness measures for information retrieval systems are based an the assumptions of binary relevance (either a document is relevant to a given query or it is not) and binary retrieval (either a document is retrieved or it is not). In this article, these assumptions are questioned, and a new measure named ADM (average distance measure) is proposed, discussed from a conceptual point of view, and experimentally validated an Text Retrieval Conference (TREC) data. Both conceptual analysis and experimental evidence demonstrate ADM's adequacy in measuring the effectiveness of information retrieval systems. Some potential problems about precision and recall are also highlighted and discussed.

Theme

Retrievalstudien

Similar documents (author)

1. Della Mea, V.; Demartini, G.; Di Gaspero, L.; Mizzaro, S.: Measuring retrieval effectiveness with Average Distance Measure (ADM) (2006) 4.18

   4.1820073 = sum of:
     4.1820073 = sum of:
       1.9855297 = weight(author_txt:mizzaro in 899) [ClassicSimilarity], result of:
         1.9855297 = score(doc=899,freq=1.0), product of:
           0.68293065 = queryWeight, product of:
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.073405206 = queryNorm
           2.9073665 = fieldWeight in 899, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.3125 = fieldNorm(doc=899)
       2.1964777 = weight(author_txt:della in 899) [ClassicSimilarity], result of:
         2.1964777 = score(doc=899,freq=1.0), product of:
           0.7304832 = queryWeight, product of:
             1.0342292 = boost
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.073405206 = queryNorm
           3.0068831 = fieldWeight in 899, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.3125 = fieldNorm(doc=899)
   

2. Mizzaro, S.: Relevance: the whole history (1997) 1.99

   1.9855297 = sum of:
     1.9855297 = product of:
       3.9710593 = sum of:
         3.9710593 = weight(author_txt:mizzaro in 2003) [ClassicSimilarity], result of:
           3.9710593 = score(doc=2003,freq=1.0), product of:
             0.68293065 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.073405206 = queryNorm
             5.814733 = fieldWeight in 2003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=2003)
       0.5 = coord(1/2)
   

3. Mizzaro, S.: How many relevances in information retrieval? (1998) 1.99

   1.9855297 = sum of:
     1.9855297 = product of:
       3.9710593 = sum of:
         3.9710593 = weight(author_txt:mizzaro in 4799) [ClassicSimilarity], result of:
           3.9710593 = score(doc=4799,freq=1.0), product of:
             0.68293065 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.073405206 = queryNorm
             5.814733 = fieldWeight in 4799, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=4799)
       0.5 = coord(1/2)
   

4. Mizzaro, S.: Quality control in scholarly publishing : a new proposal (2003) 1.99

   1.9855297 = sum of:
     1.9855297 = product of:
       3.9710593 = sum of:
         3.9710593 = weight(author_txt:mizzaro in 2810) [ClassicSimilarity], result of:
           3.9710593 = score(doc=2810,freq=1.0), product of:
             0.68293065 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.073405206 = queryNorm
             5.814733 = fieldWeight in 2810, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=2810)
       0.5 = coord(1/2)
   

5. Mizzaro, S.: Readersourcing - a manifesto (2012) 1.99

   1.9855297 = sum of:
     1.9855297 = product of:
       3.9710593 = sum of:
         3.9710593 = weight(author_txt:mizzaro in 1356) [ClassicSimilarity], result of:
           3.9710593 = score(doc=1356,freq=1.0), product of:
             0.68293065 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.073405206 = queryNorm
             5.814733 = fieldWeight in 1356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=1356)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Della Mea, V.; Demartini, G.; Di Gaspero, L.; Mizzaro, S.: Measuring retrieval effectiveness with Average Distance Measure (ADM) (2006) 1.44

   1.4407191 = sum of:
     1.4407191 = product of:
       2.2511237 = sum of:
         0.05862882 = weight(abstract_txt:retrieved in 899) [ClassicSimilarity], result of:
           0.05862882 = score(doc=899,freq=1.0), product of:
             0.10961829 = queryWeight, product of:
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019214371 = queryNorm
             0.53484523 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.06492634 = weight(abstract_txt:average in 899) [ClassicSimilarity], result of:
           0.06492634 = score(doc=899,freq=1.0), product of:
             0.11733373 = queryWeight, product of:
               1.0345939 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.019214371 = queryNorm
             0.55334765 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.08532009 = weight(abstract_txt:distance in 899) [ClassicSimilarity], result of:
           0.08532009 = score(doc=899,freq=1.0), product of:
             0.1407699 = queryWeight, product of:
               1.1332178 = boost
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.019214371 = queryNorm
             0.60609615 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.09976907 = weight(abstract_txt:named in 899) [ClassicSimilarity], result of:
           0.09976907 = score(doc=899,freq=1.0), product of:
             0.15624504 = queryWeight, product of:
               1.1938826 = boost
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.019214371 = queryNorm
             0.63854235 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.03544848 = weight(abstract_txt:systems in 899) [ClassicSimilarity], result of:
           0.03544848 = score(doc=899,freq=2.0), product of:
             0.078380376 = queryWeight, product of:
               1.1958512 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.019214371 = queryNorm
             0.4522622 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.16721478 = weight(abstract_txt:adequacy in 899) [ClassicSimilarity], result of:
           0.16721478 = score(doc=899,freq=1.0), product of:
             0.22045775 = queryWeight, product of:
               1.4181467 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.019214371 = queryNorm
             0.758489 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.07071592 = weight(abstract_txt:document in 899) [ClassicSimilarity], result of:
           0.07071592 = score(doc=899,freq=2.0), product of:
             0.12420919 = queryWeight, product of:
               1.5053946 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019214371 = queryNorm
             0.5693292 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.10394988 = weight(abstract_txt:conceptual in 899) [ClassicSimilarity], result of:
           0.10394988 = score(doc=899,freq=2.0), product of:
             0.16058005 = queryWeight, product of:
               1.7116671 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.019214371 = queryNorm
             0.64733994 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.14039363 = weight(abstract_txt:experimental in 899) [ClassicSimilarity], result of:
           0.14039363 = score(doc=899,freq=2.0), product of:
             0.19620371 = queryWeight, product of:
               1.892026 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.019214371 = queryNorm
             0.71555036 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.14347088 = weight(abstract_txt:measure in 899) [ClassicSimilarity], result of:
           0.14347088 = score(doc=899,freq=2.0), product of:
             0.19906037 = queryWeight, product of:
               1.9057498 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019214371 = queryNorm
             0.7207406 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.15599874 = weight(abstract_txt:either in 899) [ClassicSimilarity], result of:
           0.15599874 = score(doc=899,freq=2.0), product of:
             0.21048589 = queryWeight, product of:
               1.9596791 = boost
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.019214371 = queryNorm
             0.7411363 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.2468569 = weight(abstract_txt:assumptions in 899) [ClassicSimilarity], result of:
           0.2468569 = score(doc=899,freq=2.0), product of:
             0.28582865 = queryWeight, product of:
               2.2836332 = boost
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.019214371 = queryNorm
             0.8636534 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.18019217 = weight(abstract_txt:measuring in 899) [ClassicSimilarity], result of:
           0.18019217 = score(doc=899,freq=1.0), product of:
             0.2919507 = queryWeight, product of:
               2.3079598 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.019214371 = queryNorm
             0.6172007 = fieldWeight in 899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.34842247 = weight(abstract_txt:binary in 899) [ClassicSimilarity], result of:
           0.34842247 = score(doc=899,freq=2.0), product of:
             0.3596497 = queryWeight, product of:
               2.561612 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.019214371 = queryNorm
             0.9687829 = fieldWeight in 899, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.2171471 = weight(abstract_txt:effectiveness in 899) [ClassicSimilarity], result of:
           0.2171471 = score(doc=899,freq=3.0), product of:
             0.26240873 = queryWeight, product of:
               2.6798363 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019214371 = queryNorm
             0.82751477 = fieldWeight in 899, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
         0.13266836 = weight(abstract_txt:retrieval in 899) [ClassicSimilarity], result of:
           0.13266836 = score(doc=899,freq=4.0), product of:
             0.20352784 = queryWeight, product of:
               3.0468802 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019214371 = queryNorm
             0.6518438 = fieldWeight in 899, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=899)
       0.64 = coord(16/25)
   

2. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.24

   0.24317661 = sum of:
     0.24317661 = product of:
       0.7599269 = sum of:
         0.04885735 = weight(abstract_txt:retrieved in 5514) [ClassicSimilarity], result of:
           0.04885735 = score(doc=5514,freq=1.0), product of:
             0.10961829 = queryWeight, product of:
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019214371 = queryNorm
             0.44570434 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.08667831 = weight(abstract_txt:recall in 5514) [ClassicSimilarity], result of:
           0.08667831 = score(doc=5514,freq=3.0), product of:
             0.111385755 = queryWeight, product of:
               1.0080297 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.019214371 = queryNorm
             0.7781813 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.07110008 = weight(abstract_txt:distance in 5514) [ClassicSimilarity], result of:
           0.07110008 = score(doc=5514,freq=1.0), product of:
             0.1407699 = queryWeight, product of:
               1.1332178 = boost
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.019214371 = queryNorm
             0.5050801 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.041669756 = weight(abstract_txt:document in 5514) [ClassicSimilarity], result of:
           0.041669756 = score(doc=5514,freq=1.0), product of:
             0.12420919 = queryWeight, product of:
               1.5053946 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019214371 = queryNorm
             0.33548045 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.14642937 = weight(abstract_txt:measure in 5514) [ClassicSimilarity], result of:
           0.14642937 = score(doc=5514,freq=3.0), product of:
             0.19906037 = queryWeight, product of:
               1.9057498 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019214371 = queryNorm
             0.73560286 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.15016015 = weight(abstract_txt:measuring in 5514) [ClassicSimilarity], result of:
           0.15016015 = score(doc=5514,freq=1.0), product of:
             0.2919507 = queryWeight, product of:
               2.3079598 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.019214371 = queryNorm
             0.5143339 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.10447495 = weight(abstract_txt:effectiveness in 5514) [ClassicSimilarity], result of:
           0.10447495 = score(doc=5514,freq=1.0), product of:
             0.26240873 = queryWeight, product of:
               2.6798363 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019214371 = queryNorm
             0.39813823 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.11055695 = weight(abstract_txt:retrieval in 5514) [ClassicSimilarity], result of:
           0.11055695 = score(doc=5514,freq=4.0), product of:
             0.20352784 = queryWeight, product of:
               3.0468802 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019214371 = queryNorm
             0.5432031 = fieldWeight in 5514, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
       0.32 = coord(8/25)
   

3. Lam-Adesina, A.M.; Jones, G.J.F.: Examining and improving the effectiveness of relevance feedback for retrieval of scanned text documents (2006) 0.19

   0.19217157 = sum of:
     0.19217157 = product of:
       0.60053617 = sum of:
         0.05688006 = weight(abstract_txt:distance in 1977) [ClassicSimilarity], result of:
           0.05688006 = score(doc=1977,freq=1.0), product of:
             0.1407699 = queryWeight, product of:
               1.1332178 = boost
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.019214371 = queryNorm
             0.4040641 = fieldWeight in 1977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.02363232 = weight(abstract_txt:systems in 1977) [ClassicSimilarity], result of:
           0.02363232 = score(doc=1977,freq=2.0), product of:
             0.078380376 = queryWeight, product of:
               1.1958512 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.019214371 = queryNorm
             0.30150813 = fieldWeight in 1977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.057739306 = weight(abstract_txt:document in 1977) [ClassicSimilarity], result of:
           0.057739306 = score(doc=1977,freq=3.0), product of:
             0.12420919 = queryWeight, product of:
               1.5053946 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019214371 = queryNorm
             0.46485534 = fieldWeight in 1977, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.13656624 = weight(abstract_txt:experimentally in 1977) [ClassicSimilarity], result of:
           0.13656624 = score(doc=1977,freq=1.0), product of:
             0.2524054 = queryWeight, product of:
               1.5174271 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.019214371 = queryNorm
             0.5410591 = fieldWeight in 1977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.066182196 = weight(abstract_txt:experimental in 1977) [ClassicSimilarity], result of:
           0.066182196 = score(doc=1977,freq=1.0), product of:
             0.19620371 = queryWeight, product of:
               1.892026 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.019214371 = queryNorm
             0.33731368 = fieldWeight in 1977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.06763283 = weight(abstract_txt:measure in 1977) [ClassicSimilarity], result of:
           0.06763283 = score(doc=1977,freq=1.0), product of:
             0.19906037 = queryWeight, product of:
               1.9057498 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019214371 = queryNorm
             0.3397604 = fieldWeight in 1977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.08357996 = weight(abstract_txt:effectiveness in 1977) [ClassicSimilarity], result of:
           0.08357996 = score(doc=1977,freq=1.0), product of:
             0.26240873 = queryWeight, product of:
               2.6798363 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019214371 = queryNorm
             0.3185106 = fieldWeight in 1977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
         0.10832326 = weight(abstract_txt:retrieval in 1977) [ClassicSimilarity], result of:
           0.10832326 = score(doc=1977,freq=6.0), product of:
             0.20352784 = queryWeight, product of:
               3.0468802 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019214371 = queryNorm
             0.53222823 = fieldWeight in 1977, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1977)
       0.32 = coord(8/25)
   

4. Park, G.; Baek, Y.; Lee, H.-K.: Re-ranking algorithm using post-retrieval clustering for content-based image retrieval (2005) 0.17

   0.16903064 = sum of:
     0.16903064 = product of:
       0.5282208 = sum of:
         0.06769873 = weight(abstract_txt:retrieved in 2005) [ClassicSimilarity], result of:
           0.06769873 = score(doc=2005,freq=3.0), product of:
             0.10961829 = queryWeight, product of:
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019214371 = queryNorm
             0.6175861 = fieldWeight in 2005, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.061213143 = weight(abstract_txt:average in 2005) [ClassicSimilarity], result of:
           0.061213143 = score(doc=2005,freq=2.0), product of:
             0.11733373 = queryWeight, product of:
               1.0345939 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.019214371 = queryNorm
             0.52170116 = fieldWeight in 2005, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.05688006 = weight(abstract_txt:distance in 2005) [ClassicSimilarity], result of:
           0.05688006 = score(doc=2005,freq=1.0), product of:
             0.1407699 = queryWeight, product of:
               1.1332178 = boost
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.019214371 = queryNorm
             0.4040641 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4650254 = idf(docFreq=187, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.016710574 = weight(abstract_txt:systems in 2005) [ClassicSimilarity], result of:
           0.016710574 = score(doc=2005,freq=1.0), product of:
             0.078380376 = queryWeight, product of:
               1.1958512 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.019214371 = queryNorm
             0.21319844 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.066182196 = weight(abstract_txt:experimental in 2005) [ClassicSimilarity], result of:
           0.066182196 = score(doc=2005,freq=1.0), product of:
             0.19620371 = queryWeight, product of:
               1.892026 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.019214371 = queryNorm
             0.33731368 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.06763283 = weight(abstract_txt:measure in 2005) [ClassicSimilarity], result of:
           0.06763283 = score(doc=2005,freq=1.0), product of:
             0.19906037 = queryWeight, product of:
               1.9057498 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019214371 = queryNorm
             0.3397604 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.08357996 = weight(abstract_txt:effectiveness in 2005) [ClassicSimilarity], result of:
           0.08357996 = score(doc=2005,freq=1.0), product of:
             0.26240873 = queryWeight, product of:
               2.6798363 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019214371 = queryNorm
             0.3185106 = fieldWeight in 2005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
         0.10832326 = weight(abstract_txt:retrieval in 2005) [ClassicSimilarity], result of:
           0.10832326 = score(doc=2005,freq=6.0), product of:
             0.20352784 = queryWeight, product of:
               3.0468802 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019214371 = queryNorm
             0.53222823 = fieldWeight in 2005, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2005)
       0.32 = coord(8/25)
   

5. Ahlgren, P.; Grönqvist, L.: Evaluation of retrieval effectiveness with incomplete relevance data : theoretical and experimental comparison of three measures (2008) 0.16

   0.15892854 = sum of:
     0.15892854 = product of:
       0.6622023 = sum of:
         0.06492634 = weight(abstract_txt:average in 3032) [ClassicSimilarity], result of:
           0.06492634 = score(doc=3032,freq=1.0), product of:
             0.11733373 = queryWeight, product of:
               1.0345939 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.019214371 = queryNorm
             0.55334765 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.20484936 = weight(abstract_txt:experimentally in 3032) [ClassicSimilarity], result of:
           0.20484936 = score(doc=3032,freq=1.0), product of:
             0.2524054 = queryWeight, product of:
               1.5174271 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.019214371 = queryNorm
             0.81158864 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.099273294 = weight(abstract_txt:experimental in 3032) [ClassicSimilarity], result of:
           0.099273294 = score(doc=3032,freq=1.0), product of:
             0.19620371 = queryWeight, product of:
               1.892026 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.019214371 = queryNorm
             0.50597054 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.101449236 = weight(abstract_txt:measure in 3032) [ClassicSimilarity], result of:
           0.101449236 = score(doc=3032,freq=1.0), product of:
             0.19906037 = queryWeight, product of:
               1.9057498 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019214371 = queryNorm
             0.5096406 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.12536994 = weight(abstract_txt:effectiveness in 3032) [ClassicSimilarity], result of:
           0.12536994 = score(doc=3032,freq=1.0), product of:
             0.26240873 = queryWeight, product of:
               2.6798363 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019214371 = queryNorm
             0.4777659 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
         0.06633418 = weight(abstract_txt:retrieval in 3032) [ClassicSimilarity], result of:
           0.06633418 = score(doc=3032,freq=1.0), product of:
             0.20352784 = queryWeight, product of:
               3.0468802 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019214371 = queryNorm
             0.3259219 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=3032)
       0.24 = coord(6/25)