Document (#15693)

Author

Guglielmo, E.J.
Rowe, N.C.

Title

Natural-language retrieval of images based on descriptive captions

Source

ACM transactions on information systems. 14(1996) no.3, S.237-267

Year

1996

Abstract

Describes a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally requires captions to explain its features and significance. Such descriptive captions often rely on long nominal compunds (strings of consecutive nouns) which create problems of ambiguous word sense. Presents a system in which captions and user queries are parsed and interpreted to produce a logical form, using a detailed theory of the meaning of nominal compounds. A fine-grain match can then compare the logical form of the query to the logical forms for each caption. To improve system efficiency, the system performs a coarse-grain match with index files, using nouns and verbs extracted from the query. Experiments with randomly selected queries and captions from an existing image library show an increase of 30% in precision and 50% in recall over the keyphrase approach currently used. Processing times have a median of 7 seconds as compared to 8 minutes for the existing system

Theme

Retrievalstudien

Form

Bilder

Similar documents (author)

1. Rowe, G.R.: Multimedia technology as the catalyst for a new form of literacy (1992) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:rowe in 6391) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 6391, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=6391)
   

2. Rowe, N.C.: Inferring depictions in natural-language captions for efficient access to picture data (1994) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:rowe in 7295) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 7295, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=7295)
   

3. Rowe, N.C.: Using local optimality criteria for efficient information retrieval with redundant information filters (1996) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:rowe in 5662) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 5662, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=5662)
   

4. Rowe, D.E.: Is (Was) mathematics an art or a science? (2002) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:rowe in 885) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 885, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=885)
   

5. Rowe, N.C.: Precise and efficient retrieval of captioned images : the MARIE project (1999) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:rowe in 972) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 972, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=972)
   

Similar documents (content)

1. Rowe, N.C.; Guglielma, E.J.: Exploiting captions in retrieval of multimedia data (1993) 0.45

   0.45007575 = sum of:
     0.45007575 = product of:
       1.4064867 = sum of:
         0.021653635 = weight(abstract_txt:language in 5814) [ClassicSimilarity], result of:
           0.021653635 = score(doc=5814,freq=1.0), product of:
             0.06645106 = queryWeight, product of:
               1.1105143 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014346264 = queryNorm
             0.3258584 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.10019693 = weight(abstract_txt:caption in 5814) [ClassicSimilarity], result of:
           0.10019693 = score(doc=5814,freq=1.0), product of:
             0.14645615 = queryWeight, product of:
               1.1657677 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.014346264 = queryNorm
             0.6841428 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.03207203 = weight(abstract_txt:query in 5814) [ClassicSimilarity], result of:
           0.03207203 = score(doc=5814,freq=1.0), product of:
             0.086344026 = queryWeight, product of:
               1.2658707 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.014346264 = queryNorm
             0.37144467 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.03887771 = weight(abstract_txt:natural in 5814) [ClassicSimilarity], result of:
           0.03887771 = score(doc=5814,freq=1.0), product of:
             0.09816314 = queryWeight, product of:
               1.3497317 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.014346264 = queryNorm
             0.396052 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.068626724 = weight(abstract_txt:queries in 5814) [ClassicSimilarity], result of:
           0.068626724 = score(doc=5814,freq=3.0), product of:
             0.09941146 = queryWeight, product of:
               1.3582866 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.014346264 = queryNorm
             0.69033015 = fieldWeight in 5814, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.058603443 = weight(abstract_txt:descriptive in 5814) [ClassicSimilarity], result of:
           0.058603443 = score(doc=5814,freq=1.0), product of:
             0.12905161 = queryWeight, product of:
               1.5475864 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.014346264 = queryNorm
             0.45410857 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         0.028623076 = weight(abstract_txt:system in 5814) [ClassicSimilarity], result of:
           0.028623076 = score(doc=5814,freq=1.0), product of:
             0.108627275 = queryWeight, product of:
               2.244981 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.014346264 = queryNorm
             0.26349807 = fieldWeight in 5814, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
         1.0578332 = weight(abstract_txt:captions in 5814) [ClassicSimilarity], result of:
           1.0578332 = score(doc=5814,freq=6.0), product of:
             0.66326797 = queryWeight, product of:
               5.5473776 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.014346264 = queryNorm
             1.5948806 = fieldWeight in 5814, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.078125 = fieldNorm(doc=5814)
       0.32 = coord(8/25)
   

2. Rowe, N.C.: Inferring depictions in natural-language captions for efficient access to picture data (1994) 0.28

   0.28136846 = sum of:
     0.28136846 = product of:
       1.1723686 = sum of:
         0.025984362 = weight(abstract_txt:language in 7295) [ClassicSimilarity], result of:
           0.025984362 = score(doc=7295,freq=1.0), product of:
             0.06645106 = queryWeight, product of:
               1.1105143 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014346264 = queryNorm
             0.39103007 = fieldWeight in 7295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
         0.120236315 = weight(abstract_txt:caption in 7295) [ClassicSimilarity], result of:
           0.120236315 = score(doc=7295,freq=1.0), product of:
             0.14645615 = queryWeight, product of:
               1.1657677 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.014346264 = queryNorm
             0.8209714 = fieldWeight in 7295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
         0.046653252 = weight(abstract_txt:natural in 7295) [ClassicSimilarity], result of:
           0.046653252 = score(doc=7295,freq=1.0), product of:
             0.09816314 = queryWeight, product of:
               1.3497317 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.014346264 = queryNorm
             0.4752624 = fieldWeight in 7295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
         0.04754599 = weight(abstract_txt:queries in 7295) [ClassicSimilarity], result of:
           0.04754599 = score(doc=7295,freq=1.0), product of:
             0.09941146 = queryWeight, product of:
               1.3582866 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.014346264 = queryNorm
             0.47827476 = fieldWeight in 7295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
         0.03434769 = weight(abstract_txt:system in 7295) [ClassicSimilarity], result of:
           0.03434769 = score(doc=7295,freq=1.0), product of:
             0.108627275 = queryWeight, product of:
               2.244981 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.014346264 = queryNorm
             0.31619766 = fieldWeight in 7295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
         0.89760107 = weight(abstract_txt:captions in 7295) [ClassicSimilarity], result of:
           0.89760107 = score(doc=7295,freq=3.0), product of:
             0.66326797 = queryWeight, product of:
               5.5473776 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.014346264 = queryNorm
             1.3533008 = fieldWeight in 7295, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.09375 = fieldNorm(doc=7295)
       0.24 = coord(6/25)
   

3. Rowe, N.C.: Precise and efficient retrieval of captioned images : the MARIE project (1999) 0.19

   0.18936253 = sum of:
     0.18936253 = product of:
       0.9468126 = sum of:
         0.10019693 = weight(abstract_txt:caption in 972) [ClassicSimilarity], result of:
           0.10019693 = score(doc=972,freq=1.0), product of:
             0.14645615 = queryWeight, product of:
               1.1657677 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.014346264 = queryNorm
             0.6841428 = fieldWeight in 972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.078125 = fieldNorm(doc=972)
         0.03207203 = weight(abstract_txt:query in 972) [ClassicSimilarity], result of:
           0.03207203 = score(doc=972,freq=1.0), product of:
             0.086344026 = queryWeight, product of:
               1.2658707 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.014346264 = queryNorm
             0.37144467 = fieldWeight in 972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.078125 = fieldNorm(doc=972)
         0.14520003 = weight(abstract_txt:captioned in 972) [ClassicSimilarity], result of:
           0.14520003 = score(doc=972,freq=1.0), product of:
             0.18754946 = queryWeight, product of:
               1.3192166 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.014346264 = queryNorm
             0.7741959 = fieldWeight in 972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.078125 = fieldNorm(doc=972)
         0.058603443 = weight(abstract_txt:descriptive in 972) [ClassicSimilarity], result of:
           0.058603443 = score(doc=972,freq=1.0), product of:
             0.12905161 = queryWeight, product of:
               1.5475864 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.014346264 = queryNorm
             0.45410857 = fieldWeight in 972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.078125 = fieldNorm(doc=972)
         0.6107402 = weight(abstract_txt:captions in 972) [ClassicSimilarity], result of:
           0.6107402 = score(doc=972,freq=2.0), product of:
             0.66326797 = queryWeight, product of:
               5.5473776 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.014346264 = queryNorm
             0.9208046 = fieldWeight in 972, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.078125 = fieldNorm(doc=972)
       0.2 = coord(5/25)
   

4. Jones, I.; Cunliffe, D.; Tudhope, D.: Natural language processing and knowledge organization systems as an aid to retrieval (2004) 0.11

   0.10911225 = sum of:
     0.10911225 = product of:
       0.45463437 = sum of:
         0.06324386 = weight(abstract_txt:ambiguous in 3677) [ClassicSimilarity], result of:
           0.06324386 = score(doc=3677,freq=1.0), product of:
             0.10776645 = queryWeight, product of:
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.014346264 = queryNorm
             0.58686036 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
         0.021653635 = weight(abstract_txt:language in 3677) [ClassicSimilarity], result of:
           0.021653635 = score(doc=3677,freq=1.0), product of:
             0.06645106 = queryWeight, product of:
               1.1105143 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014346264 = queryNorm
             0.3258584 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
         0.089811444 = weight(abstract_txt:compounds in 3677) [ClassicSimilarity], result of:
           0.089811444 = score(doc=3677,freq=1.0), product of:
             0.13615255 = queryWeight, product of:
               1.1240125 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.014346264 = queryNorm
             0.65963835 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
         0.03887771 = weight(abstract_txt:natural in 3677) [ClassicSimilarity], result of:
           0.03887771 = score(doc=3677,freq=1.0), product of:
             0.09816314 = queryWeight, product of:
               1.3497317 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.014346264 = queryNorm
             0.396052 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
         0.028623076 = weight(abstract_txt:system in 3677) [ClassicSimilarity], result of:
           0.028623076 = score(doc=3677,freq=1.0), product of:
             0.108627275 = queryWeight, product of:
               2.244981 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.014346264 = queryNorm
             0.26349807 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
         0.21242464 = weight(abstract_txt:nominal in 3677) [ClassicSimilarity], result of:
           0.21242464 = score(doc=3677,freq=1.0), product of:
             0.30452147 = queryWeight, product of:
               2.37729 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.014346264 = queryNorm
             0.69756866 = fieldWeight in 3677, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.078125 = fieldNorm(doc=3677)
       0.24 = coord(6/25)
   

5. Green, R.: Relational aspects of subject authority control : the contributions of classificatory structure (2015) 0.11

   0.105302215 = sum of:
     0.105302215 = product of:
       0.5265111 = sum of:
         0.024498293 = weight(abstract_txt:language in 3282) [ClassicSimilarity], result of:
           0.024498293 = score(doc=3282,freq=2.0), product of:
             0.06645106 = queryWeight, product of:
               1.1105143 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014346264 = queryNorm
             0.3686667 = fieldWeight in 3282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=3282)
         0.08015754 = weight(abstract_txt:caption in 3282) [ClassicSimilarity], result of:
           0.08015754 = score(doc=3282,freq=1.0), product of:
             0.14645615 = queryWeight, product of:
               1.1657677 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.014346264 = queryNorm
             0.5473143 = fieldWeight in 3282, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.0625 = fieldNorm(doc=3282)
         0.043985106 = weight(abstract_txt:natural in 3282) [ClassicSimilarity], result of:
           0.043985106 = score(doc=3282,freq=2.0), product of:
             0.09816314 = queryWeight, product of:
               1.3497317 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.014346264 = queryNorm
             0.44808167 = fieldWeight in 3282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.0625 = fieldNorm(doc=3282)
         0.03238331 = weight(abstract_txt:system in 3282) [ClassicSimilarity], result of:
           0.03238331 = score(doc=3282,freq=2.0), product of:
             0.108627275 = queryWeight, product of:
               2.244981 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.014346264 = queryNorm
             0.298114 = fieldWeight in 3282, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=3282)
         0.34548685 = weight(abstract_txt:captions in 3282) [ClassicSimilarity], result of:
           0.34548685 = score(doc=3282,freq=1.0), product of:
             0.66326797 = queryWeight, product of:
               5.5473776 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.014346264 = queryNorm
             0.52088577 = fieldWeight in 3282, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.0625 = fieldNorm(doc=3282)
       0.2 = coord(5/25)