Document (#31973)

Author

Rowe, N.C.

Title

Precise and efficient retrieval of captioned images : the MARIE project

Source

Library trends. 48(1999) no.2, S.475-495

Year

1999

Abstract

The MARIE project has explored knowledge-based information retrieval of captioned images of the kind found in picture libraries and on the Internet. It exploits the idea that images are easier to understand with context, especially descriptive text near them, but it also does image analysis. The MARIE approach has five parts: (1) find the images and captions; (2) parse and interpret the captions; (3) segment the images into regions of homogeneous characteristics and classify them; (4) correlate caption interpretation with image interpretation using the idea of focus; and (5) optimize query execution at run time. MARIE emphasizes domain-independent methods for portability at the expense of some performance, although some domain specification is still required. Experiments show MARIE prototypes are more accurate than simpler methods, although the task is very challenging and more work is needed. Its processing is illustrated in detail on part of an Internet World Wide Web page.

Form

Bilder

Object

MARIE

Similar documents (author)

1. Rowe, G.R.: Multimedia technology as the catalyst for a new form of literacy (1992) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 6392) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 6392, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=6392)
   

2. Rowe, N.C.: Inferring depictions in natural-language captions for efficient access to picture data (1994) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 7296) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 7296, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=7296)
   

3. Rowe, N.C.: Using local optimality criteria for efficient information retrieval with redundant information filters (1996) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 5594) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 5594, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=5594)
   

4. Rowe, D.E.: Is (Was) mathematics an art or a science? (2002) 5.94

   5.937289 = sum of:
     5.937289 = weight(author_txt:rowe in 6885) [ClassicSimilarity], result of:
       5.937289 = fieldWeight in 6885, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.625 = fieldNorm(doc=6885)
   

5. Rowe, N.C.; Guglielma, E.J.: Exploiting captions in retrieval of multimedia data (1993) 4.75

   4.749831 = sum of:
     4.749831 = weight(author_txt:rowe in 5815) [ClassicSimilarity], result of:
       4.749831 = fieldWeight in 5815, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.499662 = idf(docFreq=8, maxDocs=44218)
         0.5 = fieldNorm(doc=5815)
   

Similar documents (content)

1. Rowe, N.C.; Guglielma, E.J.: Exploiting captions in retrieval of multimedia data (1993) 0.21

   0.20952983 = sum of:
     0.20952983 = product of:
       1.3095615 = sum of:
         0.06558439 = weight(abstract_txt:exploits in 5815) [ClassicSimilarity], result of:
           0.06558439 = score(doc=5815,freq=1.0), product of:
             0.1054727 = queryWeight, product of:
               1.0677254 = boost
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.012411095 = queryNorm
             0.6218139 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9592175 = idf(docFreq=41, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.087212354 = weight(abstract_txt:caption in 5815) [ClassicSimilarity], result of:
           0.087212354 = score(doc=5815,freq=1.0), product of:
             0.12754352 = queryWeight, product of:
               1.174137 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.012411095 = queryNorm
             0.683785 = fieldWeight in 5815, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.36826983 = weight(abstract_txt:captions in 5815) [ClassicSimilarity], result of:
           0.36826983 = score(doc=5815,freq=6.0), product of:
             0.23103446 = queryWeight, product of:
               2.234822 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.012411095 = queryNorm
             1.5940039 = fieldWeight in 5815, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
         0.78849494 = weight(abstract_txt:marie in 5815) [ClassicSimilarity], result of:
           0.78849494 = score(doc=5815,freq=2.0), product of:
             0.7512521 = queryWeight, product of:
               6.3718777 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.012411095 = queryNorm
             1.0495744 = fieldWeight in 5815, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.078125 = fieldNorm(doc=5815)
       0.16 = coord(4/25)
   

2. Apostolova, E.; You, D.; Xue, Z.; Antani, S.; Demner-Fushman, D.; Thoma, G.R.: Image retrieval from scientific publications : text and image content processing to separate multipanel figures (2013) 0.11

   0.11241201 = sum of:
     0.11241201 = product of:
       0.4683834 = sum of:
         0.050688926 = weight(abstract_txt:segment in 740) [ClassicSimilarity], result of:
           0.050688926 = score(doc=740,freq=1.0), product of:
             0.10307543 = queryWeight, product of:
               1.0555216 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.012411095 = queryNorm
             0.49176535 = fieldWeight in 740, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
         0.016475653 = weight(abstract_txt:them in 740) [ClassicSimilarity], result of:
           0.016475653 = score(doc=740,freq=1.0), product of:
             0.061392907 = queryWeight, product of:
               1.1520296 = boost
               4.293826 = idf(docFreq=1640, maxDocs=44218)
               0.012411095 = queryNorm
             0.26836413 = fieldWeight in 740, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.293826 = idf(docFreq=1640, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
         0.09866951 = weight(abstract_txt:caption in 740) [ClassicSimilarity], result of:
           0.09866951 = score(doc=740,freq=2.0), product of:
             0.12754352 = queryWeight, product of:
               1.174137 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.012411095 = queryNorm
             0.7736144 = fieldWeight in 740, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
         0.064611584 = weight(abstract_txt:image in 740) [ClassicSimilarity], result of:
           0.064611584 = score(doc=740,freq=4.0), product of:
             0.09617821 = queryWeight, product of:
               1.4419258 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.012411095 = queryNorm
             0.67179024 = fieldWeight in 740, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
         0.12027642 = weight(abstract_txt:captions in 740) [ClassicSimilarity], result of:
           0.12027642 = score(doc=740,freq=1.0), product of:
             0.23103446 = queryWeight, product of:
               2.234822 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.012411095 = queryNorm
             0.5205995 = fieldWeight in 740, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
         0.11766133 = weight(abstract_txt:images in 740) [ClassicSimilarity], result of:
           0.11766133 = score(doc=740,freq=2.0), product of:
             0.24525371 = queryWeight, product of:
               3.6406786 = boost
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.012411095 = queryNorm
             0.4797535 = fieldWeight in 740, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.0625 = fieldNorm(doc=740)
       0.24 = coord(6/25)
   

3. Ostermann, F.O.; Tomko, M.; Purves, R.: User evaluation of automatically generated keywords and toponyms for geo-referenced images (2013) 0.10

   0.10335695 = sum of:
     0.10335695 = product of:
       0.5167847 = sum of:
         0.020986909 = weight(abstract_txt:methods in 663) [ClassicSimilarity], result of:
           0.020986909 = score(doc=663,freq=2.0), product of:
             0.05725922 = queryWeight, product of:
               1.1125698 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.012411095 = queryNorm
             0.36652455 = fieldWeight in 663, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.017467877 = weight(abstract_txt:project in 663) [ClassicSimilarity], result of:
           0.017467877 = score(doc=663,freq=1.0), product of:
             0.06383368 = queryWeight, product of:
               1.1747068 = boost
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.012411095 = queryNorm
             0.27364674 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.055955272 = weight(abstract_txt:image in 663) [ClassicSimilarity], result of:
           0.055955272 = score(doc=663,freq=3.0), product of:
             0.09617821 = queryWeight, product of:
               1.4419258 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.012411095 = queryNorm
             0.5817874 = fieldWeight in 663, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.20225047 = weight(abstract_txt:captioned in 663) [ClassicSimilarity], result of:
           0.20225047 = score(doc=663,freq=1.0), product of:
             0.32670024 = queryWeight, product of:
               2.6575367 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.012411095 = queryNorm
             0.6190705 = fieldWeight in 663, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
         0.22012417 = weight(abstract_txt:images in 663) [ClassicSimilarity], result of:
           0.22012417 = score(doc=663,freq=7.0), product of:
             0.24525371 = queryWeight, product of:
               3.6406786 = boost
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.012411095 = queryNorm
             0.8975366 = fieldWeight in 663, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.0625 = fieldNorm(doc=663)
       0.2 = coord(5/25)
   

4. Guglielmo, E.J.; Rowe, N.C.: Natural-language retrieval of images based on descriptive captions (1996) 0.09

   0.08718063 = sum of:
     0.08718063 = product of:
       0.54487896 = sum of:
         0.06976988 = weight(abstract_txt:caption in 6624) [ClassicSimilarity], result of:
           0.06976988 = score(doc=6624,freq=1.0), product of:
             0.12754352 = queryWeight, product of:
               1.174137 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.012411095 = queryNorm
             0.547028 = fieldWeight in 6624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=6624)
         0.032305792 = weight(abstract_txt:image in 6624) [ClassicSimilarity], result of:
           0.032305792 = score(doc=6624,freq=1.0), product of:
             0.09617821 = queryWeight, product of:
               1.4419258 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.012411095 = queryNorm
             0.33589512 = fieldWeight in 6624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=6624)
         0.24055284 = weight(abstract_txt:captions in 6624) [ClassicSimilarity], result of:
           0.24055284 = score(doc=6624,freq=4.0), product of:
             0.23103446 = queryWeight, product of:
               2.234822 = boost
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.012411095 = queryNorm
             1.041199 = fieldWeight in 6624, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.329592 = idf(docFreq=28, maxDocs=44218)
               0.0625 = fieldNorm(doc=6624)
         0.20225047 = weight(abstract_txt:captioned in 6624) [ClassicSimilarity], result of:
           0.20225047 = score(doc=6624,freq=1.0), product of:
             0.32670024 = queryWeight, product of:
               2.6575367 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.012411095 = queryNorm
             0.6190705 = fieldWeight in 6624, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.0625 = fieldNorm(doc=6624)
       0.16 = coord(4/25)
   

5. Rabitti, F.; Savino, P.: Automatic image indexation to support content-based retrieval (1992) 0.08

   0.0822088 = sum of:
     0.0822088 = product of:
       0.41104397 = sum of:
         0.050688926 = weight(abstract_txt:simpler in 3032) [ClassicSimilarity], result of:
           0.050688926 = score(doc=3032,freq=1.0), product of:
             0.10307543 = queryWeight, product of:
               1.0555216 = boost
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.012411095 = queryNorm
             0.49176535 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8682456 = idf(docFreq=45, maxDocs=44218)
               0.0625 = fieldNorm(doc=3032)
         0.022102024 = weight(abstract_txt:domain in 3032) [ClassicSimilarity], result of:
           0.022102024 = score(doc=3032,freq=1.0), product of:
             0.07467544 = queryWeight, product of:
               1.2705549 = boost
               4.7355914 = idf(docFreq=1054, maxDocs=44218)
               0.012411095 = queryNorm
             0.29597446 = fieldWeight in 3032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7355914 = idf(docFreq=1054, maxDocs=44218)
               0.0625 = fieldNorm(doc=3032)
         0.072237946 = weight(abstract_txt:image in 3032) [ClassicSimilarity], result of:
           0.072237946 = score(doc=3032,freq=5.0), product of:
             0.09617821 = queryWeight, product of:
               1.4419258 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.012411095 = queryNorm
             0.7510843 = fieldWeight in 3032, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=3032)
         0.06221968 = weight(abstract_txt:interpretation in 3032) [ClassicSimilarity], result of:
           0.06221968 = score(doc=3032,freq=2.0), product of:
             0.118167564 = queryWeight, product of:
               1.598283 = boost
               5.957094 = idf(docFreq=310, maxDocs=44218)
               0.012411095 = queryNorm
             0.5265377 = fieldWeight in 3032, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.957094 = idf(docFreq=310, maxDocs=44218)
               0.0625 = fieldNorm(doc=3032)
         0.2037954 = weight(abstract_txt:images in 3032) [ClassicSimilarity], result of:
           0.2037954 = score(doc=3032,freq=6.0), product of:
             0.24525371 = queryWeight, product of:
               3.6406786 = boost
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.012411095 = queryNorm
             0.8309575 = fieldWeight in 3032, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.427791 = idf(docFreq=527, maxDocs=44218)
               0.0625 = fieldNorm(doc=3032)
       0.2 = coord(5/25)