Document (#24537)

Author

Smith, J.R.

Title

Quantitative assessment of image retrieval effectiveness

Source

Journal of the American Society for Information Science and technology. 52(2001) no.11, S.969-979

Year

2001

Abstract

Content-based retrieval (CBR) promises to greatly improve capabilities for searching for images based on semantic features and visual appearance. However, developing a framework for evaluating image retrieval effectiveness remains a significant challenge. Difficulties include determining how matching at different description levels affects relevance, designing meaningful benchmark queries of large image collections, and developing suitable quantitative metrics for measuring retrieval effectiveness. This article studies the problems of developing a framework and testbed for quantitative assessment of image retrieval effectiveness. In order to better harness the extensive research on CBR and improve capabilities of image retrieval systems, this article advocates the establishment of common image retrieval testbeds consisting of standardized image collections, benchmark queries, relevance assessments, and quantitative evaluation methods

Form

Bilder

Similar documents (author)

1. Smith, M.P.; Smith, M.: ¬The use of genetic programming to build Boolean queries for text retrieval through relevance feedback (1997) 4.56

   4.5639806 = sum of:
     4.5639806 = weight(author_txt:smith in 1761) [ClassicSimilarity], result of:
       4.5639806 = fieldWeight in 1761, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.5 = fieldNorm(doc=1761)
   

2. Smith, E.H.: Enhancing subject accessibiliy to the online catalog (1991) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 1068) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 1068, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=1068)
   

3. Smith, L.C.: UNISIST revisited: campatibility in the context of collaboratories (1992) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2112) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2112, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2112)
   

4. Smith, M.M.: Knowledge management : a guide to resources on the Internet (2004) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2804) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2804, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2804)
   

5. Smith, L.C.: Citation analysis (1981) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2832) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2832, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2832)
   

Similar documents (content)

1. Yoon, J.W.: Utilizing quantitative users' reactions to represent affective meanings of an image (2010) 0.22

   0.22145374 = sum of:
     0.22145374 = product of:
       0.92272395 = sum of:
         0.037916508 = weight(abstract_txt:improve in 571) [ClassicSimilarity], result of:
           0.037916508 = score(doc=571,freq=1.0), product of:
             0.12237526 = queryWeight, product of:
               1.4620419 = boost
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.016884146 = queryNorm
             0.30983803 = fieldWeight in 571, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
         0.059030607 = weight(abstract_txt:assessment in 571) [ClassicSimilarity], result of:
           0.059030607 = score(doc=571,freq=1.0), product of:
             0.16438401 = queryWeight, product of:
               1.6945046 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.016884146 = queryNorm
             0.3591019 = fieldWeight in 571, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
         0.082380764 = weight(abstract_txt:effectiveness in 571) [ClassicSimilarity], result of:
           0.082380764 = score(doc=571,freq=1.0), product of:
             0.25864372 = queryWeight, product of:
               3.0059307 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016884146 = queryNorm
             0.3185106 = fieldWeight in 571, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
         0.18561551 = weight(abstract_txt:quantitative in 571) [ClassicSimilarity], result of:
           0.18561551 = score(doc=571,freq=2.0), product of:
             0.35281813 = queryWeight, product of:
               3.5107787 = boost
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.016884146 = queryNorm
             0.526094 = fieldWeight in 571, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
         0.07927195 = weight(abstract_txt:retrieval in 571) [ClassicSimilarity], result of:
           0.07927195 = score(doc=571,freq=3.0), product of:
             0.21063799 = queryWeight, product of:
               3.58852 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.016884146 = queryNorm
             0.37634215 = fieldWeight in 571, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
         0.47850862 = weight(abstract_txt:image in 571) [ClassicSimilarity], result of:
           0.47850862 = score(doc=571,freq=8.0), product of:
             0.50357085 = queryWeight, product of:
               5.548522 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.016884146 = queryNorm
             0.95023096 = fieldWeight in 571, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=571)
       0.24 = coord(6/25)
   

2. Ostermann, F.O.; Tomko, M.; Purves, R.: User evaluation of automatically generated keywords and toponyms for geo-referenced images (2013) 0.18

   0.18288931 = sum of:
     0.18288931 = product of:
       0.6531761 = sum of:
         0.055373438 = weight(abstract_txt:standardized in 1663) [ClassicSimilarity], result of:
           0.055373438 = score(doc=1663,freq=1.0), product of:
             0.12502563 = queryWeight, product of:
               1.0449548 = boost
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.016884146 = queryNorm
             0.4428967 = fieldWeight in 1663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.029563287 = weight(abstract_txt:article in 1663) [ClassicSimilarity], result of:
           0.029563287 = score(doc=1663,freq=3.0), product of:
             0.071879126 = queryWeight, product of:
               1.1205065 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.016884146 = queryNorm
             0.4112917 = fieldWeight in 1663, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.037916508 = weight(abstract_txt:improve in 1663) [ClassicSimilarity], result of:
           0.037916508 = score(doc=1663,freq=1.0), product of:
             0.12237526 = queryWeight, product of:
               1.4620419 = boost
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.016884146 = queryNorm
             0.30983803 = fieldWeight in 1663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.04132213 = weight(abstract_txt:queries in 1663) [ClassicSimilarity], result of:
           0.04132213 = score(doc=1663,freq=1.0), product of:
             0.12959747 = queryWeight, product of:
               1.5045661 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016884146 = queryNorm
             0.31884983 = fieldWeight in 1663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.13125 = weight(abstract_txt:quantitative in 1663) [ClassicSimilarity], result of:
           0.13125 = score(doc=1663,freq=1.0), product of:
             0.35281813 = queryWeight, product of:
               3.5107787 = boost
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.016884146 = queryNorm
             0.37200466 = fieldWeight in 1663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.06472528 = weight(abstract_txt:retrieval in 1663) [ClassicSimilarity], result of:
           0.06472528 = score(doc=1663,freq=2.0), product of:
             0.21063799 = queryWeight, product of:
               3.58852 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.016884146 = queryNorm
             0.3072821 = fieldWeight in 1663, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
         0.2930255 = weight(abstract_txt:image in 1663) [ClassicSimilarity], result of:
           0.2930255 = score(doc=1663,freq=3.0), product of:
             0.50357085 = queryWeight, product of:
               5.548522 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.016884146 = queryNorm
             0.58189523 = fieldWeight in 1663, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=1663)
       0.28 = coord(7/25)
   

3. Sun, A.; Bhowmick, S.S.; Nguyen, K.T.N.; Bai, G.: Tag-based social image retrieval : an empirical evaluation (2011) 0.16

   0.16183195 = sum of:
     0.16183195 = product of:
       0.5779712 = sum of:
         0.014934826 = weight(abstract_txt:article in 938) [ClassicSimilarity], result of:
           0.014934826 = score(doc=938,freq=1.0), product of:
             0.071879126 = queryWeight, product of:
               1.1205065 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.016884146 = queryNorm
             0.20777695 = fieldWeight in 938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.03614505 = weight(abstract_txt:framework in 938) [ClassicSimilarity], result of:
           0.03614505 = score(doc=938,freq=2.0), product of:
             0.10283917 = queryWeight, product of:
               1.3402699 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.016884146 = queryNorm
             0.3514716 = fieldWeight in 938, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.032620408 = weight(abstract_txt:relevance in 938) [ClassicSimilarity], result of:
           0.032620408 = score(doc=938,freq=1.0), product of:
             0.121002845 = queryWeight, product of:
               1.4538205 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016884146 = queryNorm
             0.2695838 = fieldWeight in 938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.05113353 = weight(abstract_txt:queries in 938) [ClassicSimilarity], result of:
           0.05113353 = score(doc=938,freq=2.0), product of:
             0.12959747 = queryWeight, product of:
               1.5045661 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016884146 = queryNorm
             0.39455652 = fieldWeight in 938, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.07208317 = weight(abstract_txt:effectiveness in 938) [ClassicSimilarity], result of:
           0.07208317 = score(doc=938,freq=1.0), product of:
             0.25864372 = queryWeight, product of:
               3.0059307 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016884146 = queryNorm
             0.27869678 = fieldWeight in 938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.040046725 = weight(abstract_txt:retrieval in 938) [ClassicSimilarity], result of:
           0.040046725 = score(doc=938,freq=1.0), product of:
             0.21063799 = queryWeight, product of:
               3.58852 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.016884146 = queryNorm
             0.1901211 = fieldWeight in 938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
         0.3310075 = weight(abstract_txt:image in 938) [ClassicSimilarity], result of:
           0.3310075 = score(doc=938,freq=5.0), product of:
             0.50357085 = queryWeight, product of:
               5.548522 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.016884146 = queryNorm
             0.6573206 = fieldWeight in 938, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0546875 = fieldNorm(doc=938)
       0.28 = coord(7/25)
   

4. Bodoff, D.; Kambil, A.: Partial coordination : II. A preliminary evaluation and failure analysis (1998) 0.16

   0.15637001 = sum of:
     0.15637001 = product of:
       0.55846435 = sum of:
         0.030172905 = weight(abstract_txt:article in 3323) [ClassicSimilarity], result of:
           0.030172905 = score(doc=3323,freq=2.0), product of:
             0.071879126 = queryWeight, product of:
               1.1205065 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.016884146 = queryNorm
             0.41977283 = fieldWeight in 3323, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.14148764 = weight(abstract_txt:testbed in 3323) [ClassicSimilarity], result of:
           0.14148764 = score(doc=3323,freq=1.0), product of:
             0.20137416 = queryWeight, product of:
               1.326172 = boost
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.016884146 = queryNorm
             0.70261073 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.036512014 = weight(abstract_txt:framework in 3323) [ClassicSimilarity], result of:
           0.036512014 = score(doc=3323,freq=1.0), product of:
             0.10283917 = queryWeight, product of:
               1.3402699 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.016884146 = queryNorm
             0.35503995 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.040324856 = weight(abstract_txt:collections in 3323) [ClassicSimilarity], result of:
           0.040324856 = score(doc=3323,freq=1.0), product of:
             0.10987948 = queryWeight, product of:
               1.3853875 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.016884146 = queryNorm
             0.3669917 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.07906641 = weight(abstract_txt:developing in 3323) [ClassicSimilarity], result of:
           0.07906641 = score(doc=3323,freq=1.0), product of:
             0.19704245 = queryWeight, product of:
               2.272158 = boost
               5.136203 = idf(docFreq=709, maxDocs=44421)
               0.016884146 = queryNorm
             0.40126586 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.136203 = idf(docFreq=709, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.10297595 = weight(abstract_txt:effectiveness in 3323) [ClassicSimilarity], result of:
           0.10297595 = score(doc=3323,freq=1.0), product of:
             0.25864372 = queryWeight, product of:
               3.0059307 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016884146 = queryNorm
             0.39813823 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.12792458 = weight(abstract_txt:retrieval in 3323) [ClassicSimilarity], result of:
           0.12792458 = score(doc=3323,freq=5.0), product of:
             0.21063799 = queryWeight, product of:
               3.58852 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.016884146 = queryNorm
             0.6073196 = fieldWeight in 3323, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
       0.28 = coord(7/25)
   

5. McLean, S.; Spring, M.B.; Rasmussen, E.; Williams, J.G.: Online image databases : usabiblity and performance (1995) 0.15

   0.15012376 = sum of:
     0.15012376 = product of:
       0.7506188 = sum of:
         0.05687476 = weight(abstract_txt:improve in 1260) [ClassicSimilarity], result of:
           0.05687476 = score(doc=1260,freq=1.0), product of:
             0.12237526 = queryWeight, product of:
               1.4620419 = boost
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.016884146 = queryNorm
             0.46475703 = fieldWeight in 1260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.09375 = fieldNorm(doc=1260)
         0.061983198 = weight(abstract_txt:queries in 1260) [ClassicSimilarity], result of:
           0.061983198 = score(doc=1260,freq=1.0), product of:
             0.12959747 = queryWeight, product of:
               1.5045661 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016884146 = queryNorm
             0.47827476 = fieldWeight in 1260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.09375 = fieldNorm(doc=1260)
         0.12357114 = weight(abstract_txt:effectiveness in 1260) [ClassicSimilarity], result of:
           0.12357114 = score(doc=1260,freq=1.0), product of:
             0.25864372 = queryWeight, product of:
               3.0059307 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016884146 = queryNorm
             0.4777659 = fieldWeight in 1260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=1260)
         0.068651535 = weight(abstract_txt:retrieval in 1260) [ClassicSimilarity], result of:
           0.068651535 = score(doc=1260,freq=1.0), product of:
             0.21063799 = queryWeight, product of:
               3.58852 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.016884146 = queryNorm
             0.3259219 = fieldWeight in 1260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=1260)
         0.4395382 = weight(abstract_txt:image in 1260) [ClassicSimilarity], result of:
           0.4395382 = score(doc=1260,freq=3.0), product of:
             0.50357085 = queryWeight, product of:
               5.548522 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.016884146 = queryNorm
             0.87284285 = fieldWeight in 1260, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.09375 = fieldNorm(doc=1260)
       0.2 = coord(5/25)