Document (#24536)

Author

Müller, W.
Marchand-Maillet, S.
Müller, H.

Title

Evaluating image browsers using structured annotation

Source

Journal of the American Society for Information Science and technology. 52(2001) no.11, S.961-968

Year

2001

Abstract

In this article we address the problem of benchmarking image browsers. Image browsers are systems that help the user in finding an image from scratch, as opposed to query by example (OBE), where an example image is needed. The existence of different search paradigms for image browsers makes it difficult to compare image browsers. Currently, the only admissible way of evaluation is by conducting large-scale user studies. This makes it difficult to use such an evaluation as a tool for improving browsing systems. As a solution, we propose an automatic image browser benchmark that uses structured text annotation of the image collection for the simulation of the user's needs. We apply such a benchmark on an example system

Form

Bilder

Similar documents (author)

1. Müller, C.: Sacherschließung - Zentrale Dienstleistung und Nutzung von Fremdleistungen. Bericht über ein dbi-Kolloquium (1984) 4.29

   4.2858 = sum of:
     4.2858 = weight(author_txt:müller in 554) [ClassicSimilarity], result of:
       4.2858 = score(doc=554,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.1458304 = queryNorm
         4.2858005 = fieldWeight in 554, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.625 = fieldNorm(doc=554)
   

2. Müller, E.: Suhler Erfahrungen mit der Schlagwortgebung (1991) 4.29

   4.2858 = sum of:
     4.2858 = weight(author_txt:müller in 3262) [ClassicSimilarity], result of:
       4.2858 = score(doc=3262,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.1458304 = queryNorm
         4.2858005 = fieldWeight in 3262, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.625 = fieldNorm(doc=3262)
   

3. Müller, W.: ¬Ein Weg zu einem VD 17 : Untersuchungen über eine Verzeichnung der deutschen Drucke des 17. Jahrhunderts (1990) 4.29

   4.2858 = sum of:
     4.2858 = weight(author_txt:müller in 4329) [ClassicSimilarity], result of:
       4.2858 = score(doc=4329,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.1458304 = queryNorm
         4.2858005 = fieldWeight in 4329, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.625 = fieldNorm(doc=4329)
   

4. Müller, G.: Zur Effizienz von Online-Literaturrecherchen : eine Analyse möglicher Faktoren, die die Recherchequalität beeinflussen (1988) 4.29

   4.2858 = sum of:
     4.2858 = weight(author_txt:müller in 4390) [ClassicSimilarity], result of:
       4.2858 = score(doc=4390,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.1458304 = queryNorm
         4.2858005 = fieldWeight in 4390, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.625 = fieldNorm(doc=4390)
   

5. Müller, G.: Prinzipien der Nachlaßerschließung in Bibliotheken und Literaturarchiven (1990) 4.29

   4.2858 = sum of:
     4.2858 = weight(author_txt:müller in 5022) [ClassicSimilarity], result of:
       4.2858 = score(doc=5022,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.1458304 = queryNorm
         4.2858005 = fieldWeight in 5022, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.8572807 = idf(docFreq=126, maxDocs=44421)
           0.625 = fieldNorm(doc=5022)
   

Similar documents (content)

1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.20

   0.20410442 = sum of:
     0.20410442 = product of:
       0.6378263 = sum of:
         0.032898396 = weight(abstract_txt:user's in 3592) [ClassicSimilarity], result of:
           0.032898396 = score(doc=3592,freq=2.0), product of:
             0.07304161 = queryWeight, product of:
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.012542062 = queryNorm
             0.45040625 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.04214161 = weight(abstract_txt:apply in 3592) [ClassicSimilarity], result of:
           0.04214161 = score(doc=3592,freq=3.0), product of:
             0.07525998 = queryWeight, product of:
               1.0150721 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.012542062 = queryNorm
             0.5599471 = fieldWeight in 3592, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.009349699 = weight(abstract_txt:systems in 3592) [ClassicSimilarity], result of:
           0.009349699 = score(doc=3592,freq=1.0), product of:
             0.050119366 = queryWeight, product of:
               1.1714739 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.012542062 = queryNorm
             0.18654864 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.009430804 = weight(abstract_txt:such in 3592) [ClassicSimilarity], result of:
           0.009430804 = score(doc=3592,freq=1.0), product of:
             0.05040879 = queryWeight, product of:
               1.1748515 = boost
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.012542062 = queryNorm
             0.1870865 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.04057252 = weight(abstract_txt:conducting in 3592) [ClassicSimilarity], result of:
           0.04057252 = score(doc=3592,freq=1.0), product of:
             0.10583236 = queryWeight, product of:
               1.2037162 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.012542062 = queryNorm
             0.38336593 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.016613131 = weight(abstract_txt:user in 3592) [ClassicSimilarity], result of:
           0.016613131 = score(doc=3592,freq=2.0), product of:
             0.0583577 = queryWeight, product of:
               1.2640927 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.012542062 = queryNorm
             0.28467762 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.021174474 = weight(abstract_txt:evaluation in 3592) [ClassicSimilarity], result of:
           0.021174474 = score(doc=3592,freq=1.0), product of:
             0.08643352 = queryWeight, product of:
               1.5384059 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.012542062 = queryNorm
             0.24497987 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.46564573 = weight(abstract_txt:image in 3592) [ClassicSimilarity], result of:
           0.46564573 = score(doc=3592,freq=8.0), product of:
             0.56003916 = queryWeight, product of:
               8.30702 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.012542062 = queryNorm
             0.8314521 = fieldWeight in 3592, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
       0.32 = coord(8/25)
   

2. Vert, S.: Extensions of Web browsers useful to knowledge workers (2012) 0.20

   0.19776398 = sum of:
     0.19776398 = product of:
       0.8240166 = sum of:
         0.035478294 = weight(abstract_txt:solution in 1103) [ClassicSimilarity], result of:
           0.035478294 = score(doc=1103,freq=1.0), product of:
             0.07629645 = queryWeight, product of:
               1.0220379 = boost
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.012542062 = queryNorm
             0.46500582 = fieldWeight in 1103, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9520745 = idf(docFreq=313, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
         0.090885155 = weight(abstract_txt:browser in 1103) [ClassicSimilarity], result of:
           0.090885155 = score(doc=1103,freq=3.0), product of:
             0.099041544 = queryWeight, product of:
               1.1644572 = boost
               6.7814865 = idf(docFreq=136, maxDocs=44421)
               0.012542062 = queryNorm
             0.9176468 = fieldWeight in 1103, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7814865 = idf(docFreq=136, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
         0.013472576 = weight(abstract_txt:such in 1103) [ClassicSimilarity], result of:
           0.013472576 = score(doc=1103,freq=1.0), product of:
             0.05040879 = queryWeight, product of:
               1.1748515 = boost
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.012542062 = queryNorm
             0.2672664 = fieldWeight in 1103, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
         0.0167818 = weight(abstract_txt:user in 1103) [ClassicSimilarity], result of:
           0.0167818 = score(doc=1103,freq=1.0), product of:
             0.0583577 = queryWeight, product of:
               1.2640927 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.012542062 = queryNorm
             0.28756785 = fieldWeight in 1103, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
         0.06761494 = weight(abstract_txt:example in 1103) [ClassicSimilarity], result of:
           0.06761494 = score(doc=1103,freq=1.0), product of:
             0.16914716 = queryWeight, product of:
               2.635772 = boost
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.012542062 = queryNorm
             0.39974034 = fieldWeight in 1103, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
         0.5997838 = weight(abstract_txt:browsers in 1103) [ClassicSimilarity], result of:
           0.5997838 = score(doc=1103,freq=3.0), product of:
             0.5958568 = queryWeight, product of:
               6.3866158 = boost
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.012542062 = queryNorm
             1.0065905 = fieldWeight in 1103, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.078125 = fieldNorm(doc=1103)
       0.24 = coord(6/25)
   

3. Beard, D.V.: Computer human interaction for image information systems (1991) 0.18

   0.17627458 = sum of:
     0.17627458 = product of:
       0.88137287 = sum of:
         0.022667095 = weight(abstract_txt:systems in 4814) [ClassicSimilarity], result of:
           0.022667095 = score(doc=4814,freq=2.0), product of:
             0.050119366 = queryWeight, product of:
               1.1714739 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.012542062 = queryNorm
             0.4522622 = fieldWeight in 4814, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=4814)
         0.020138158 = weight(abstract_txt:user in 4814) [ClassicSimilarity], result of:
           0.020138158 = score(doc=4814,freq=1.0), product of:
             0.0583577 = queryWeight, product of:
               1.2640927 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.012542062 = queryNorm
             0.34508142 = fieldWeight in 4814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.09375 = fieldNorm(doc=4814)
         0.06612501 = weight(abstract_txt:difficult in 4814) [ClassicSimilarity], result of:
           0.06612501 = score(doc=4814,freq=1.0), product of:
             0.12892254 = queryWeight, product of:
               1.8788593 = boost
               5.4709864 = idf(docFreq=507, maxDocs=44421)
               0.012542062 = queryNorm
             0.512905 = fieldWeight in 4814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4709864 = idf(docFreq=507, maxDocs=44421)
               0.09375 = fieldNorm(doc=4814)
         0.08113793 = weight(abstract_txt:example in 4814) [ClassicSimilarity], result of:
           0.08113793 = score(doc=4814,freq=1.0), product of:
             0.16914716 = queryWeight, product of:
               2.635772 = boost
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.012542062 = queryNorm
             0.4796884 = fieldWeight in 4814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.09375 = fieldNorm(doc=4814)
         0.6913047 = weight(abstract_txt:image in 4814) [ClassicSimilarity], result of:
           0.6913047 = score(doc=4814,freq=6.0), product of:
             0.56003916 = queryWeight, product of:
               8.30702 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.012542062 = queryNorm
             1.2343863 = fieldWeight in 4814, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.09375 = fieldNorm(doc=4814)
       0.2 = coord(5/25)
   

4. Smith, J.R.: Quantitative assessment of image retrieval effectiveness (2001) 0.17

   0.16721426 = sum of:
     0.16721426 = product of:
       0.8360713 = sum of:
         0.033474438 = weight(abstract_txt:evaluating in 536) [ClassicSimilarity], result of:
           0.033474438 = score(doc=536,freq=1.0), product of:
             0.073395826 = queryWeight, product of:
               1.0024219 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.012542062 = queryNorm
             0.45608097 = fieldWeight in 536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.078125 = fieldNorm(doc=536)
         0.013356714 = weight(abstract_txt:systems in 536) [ClassicSimilarity], result of:
           0.013356714 = score(doc=536,freq=1.0), product of:
             0.050119366 = queryWeight, product of:
               1.1714739 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.012542062 = queryNorm
             0.26649806 = fieldWeight in 536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=536)
         0.030249247 = weight(abstract_txt:evaluation in 536) [ClassicSimilarity], result of:
           0.030249247 = score(doc=536,freq=1.0), product of:
             0.08643352 = queryWeight, product of:
               1.5384059 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.012542062 = queryNorm
             0.34997123 = fieldWeight in 536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=536)
         0.18290369 = weight(abstract_txt:benchmark in 536) [ClassicSimilarity], result of:
           0.18290369 = score(doc=536,freq=2.0), product of:
             0.2276901 = queryWeight, product of:
               2.4969044 = boost
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.012542062 = queryNorm
             0.80330104 = fieldWeight in 536, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.078125 = fieldNorm(doc=536)
         0.57608724 = weight(abstract_txt:image in 536) [ClassicSimilarity], result of:
           0.57608724 = score(doc=536,freq=6.0), product of:
             0.56003916 = queryWeight, product of:
               8.30702 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.012542062 = queryNorm
             1.0286553 = fieldWeight in 536, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.078125 = fieldNorm(doc=536)
       0.2 = coord(5/25)
   

5. Subramanyam Rallabandi, V.P.; Sett, S.K.: Knowledge-based image retrieval system (2008) 0.16

   0.15674874 = sum of:
     0.15674874 = product of:
       0.6531198 = sum of:
         0.05247257 = weight(abstract_txt:browser in 266) [ClassicSimilarity], result of:
           0.05247257 = score(doc=266,freq=1.0), product of:
             0.099041544 = queryWeight, product of:
               1.1644572 = boost
               6.7814865 = idf(docFreq=136, maxDocs=44421)
               0.012542062 = queryNorm
             0.52980363 = fieldWeight in 266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7814865 = idf(docFreq=136, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
         0.013356714 = weight(abstract_txt:systems in 266) [ClassicSimilarity], result of:
           0.013356714 = score(doc=266,freq=1.0), product of:
             0.050119366 = queryWeight, product of:
               1.1714739 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.012542062 = queryNorm
             0.26649806 = fieldWeight in 266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
         0.0190531 = weight(abstract_txt:such in 266) [ClassicSimilarity], result of:
           0.0190531 = score(doc=266,freq=2.0), product of:
             0.05040879 = queryWeight, product of:
               1.1748515 = boost
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.012542062 = queryNorm
             0.37797177 = fieldWeight in 266, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
         0.030249247 = weight(abstract_txt:evaluation in 266) [ClassicSimilarity], result of:
           0.030249247 = score(doc=266,freq=1.0), product of:
             0.08643352 = queryWeight, product of:
               1.5384059 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.012542062 = queryNorm
             0.34997123 = fieldWeight in 266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
         0.06761494 = weight(abstract_txt:example in 266) [ClassicSimilarity], result of:
           0.06761494 = score(doc=266,freq=1.0), product of:
             0.16914716 = queryWeight, product of:
               2.635772 = boost
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.012542062 = queryNorm
             0.39974034 = fieldWeight in 266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1166763 = idf(docFreq=723, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
         0.47037324 = weight(abstract_txt:image in 266) [ClassicSimilarity], result of:
           0.47037324 = score(doc=266,freq=4.0), product of:
             0.56003916 = queryWeight, product of:
               8.30702 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.012542062 = queryNorm
             0.83989346 = fieldWeight in 266, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.078125 = fieldNorm(doc=266)
       0.24 = coord(6/25)