Document (#37133)

Author

Town, C.

Title

Ontological inference for image and video analysis

Source

Journal machine vision and spplications archive. 17(2006) no.2, S.94-115

Year

2006

Abstract

This paper presents an approach to designing and implementing extensible computational models for perceiving systems based on a knowledge-driven joint inference approach. These models can integrate different sources of information both horizontally (multi-modal and temporal fusion) and vertically (bottom-up, top-down) by incorporating prior hierarchical knowledge expressed as an extensible ontology.Two implementations of this approach are presented. The first consists of a content-based image retrieval system that allows users to search image databases using an ontological query language. Queries are parsed using a probabilistic grammar and Bayesian networks to map high-level concepts onto low-level image descriptors, thereby bridging the 'semantic gap' between users and the retrieval system. The second application extends the notion of ontological languages to video event detection. It is shown how effective high-level state and event recognition mechanisms can be learned from a set of annotated training sequences by incorporating syntactic and semantic constraints represented by an ontology.

Content

Vgl.: doi:10.1007/s00138-006-0017-3.

Theme

Wissensrepräsentation

Form

Bilder
Videos

Similar documents (content)

1. AAAI 1997 Spring symposium series reports (1997) 0.15

   0.15088527 = sum of:
     0.15088527 = product of:
       0.75442636 = sum of:
         0.030263036 = weight(abstract_txt:knowledge in 3742) [ClassicSimilarity], result of:
           0.030263036 = score(doc=3742,freq=1.0), product of:
             0.06826776 = queryWeight, product of:
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.019249916 = queryNorm
             0.44329908 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.125 = fieldNorm(doc=3742)
         0.06704389 = weight(abstract_txt:models in 3742) [ClassicSimilarity], result of:
           0.06704389 = score(doc=3742,freq=1.0), product of:
             0.116014816 = queryWeight, product of:
               1.3036137 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019249916 = queryNorm
             0.57789075 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.125 = fieldNorm(doc=3742)
         0.15594828 = weight(abstract_txt:video in 3742) [ClassicSimilarity], result of:
           0.15594828 = score(doc=3742,freq=1.0), product of:
             0.20367032 = queryWeight, product of:
               1.7272533 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.019249916 = queryNorm
             0.7656898 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.125 = fieldNorm(doc=3742)
         0.29040805 = weight(abstract_txt:ontological in 3742) [ClassicSimilarity], result of:
           0.29040805 = score(doc=3742,freq=1.0), product of:
             0.35289338 = queryWeight, product of:
               2.784579 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.019249916 = queryNorm
             0.8229342 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.125 = fieldNorm(doc=3742)
         0.21076307 = weight(abstract_txt:image in 3742) [ClassicSimilarity], result of:
           0.21076307 = score(doc=3742,freq=1.0), product of:
             0.3136753 = queryWeight, product of:
               3.0314286 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.019249916 = queryNorm
             0.67191476 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.125 = fieldNorm(doc=3742)
       0.2 = coord(5/25)
   

2. Wang, X.; Erdelez, S.; Allen, C.; Anderson, B.; Cao, H.; Shyu, C.-R.: Role of domain knowledge in developing user-centered medical-image indexing (2012) 0.15

   0.15051207 = sum of:
     0.15051207 = product of:
       0.6271336 = sum of:
         0.026208559 = weight(abstract_txt:knowledge in 977) [ClassicSimilarity], result of:
           0.026208559 = score(doc=977,freq=3.0), product of:
             0.06826776 = queryWeight, product of:
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.019249916 = queryNorm
             0.38390827 = fieldWeight in 977, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
         0.03080126 = weight(abstract_txt:users in 977) [ClassicSimilarity], result of:
           0.03080126 = score(doc=977,freq=4.0), product of:
             0.0690748 = queryWeight, product of:
               1.0058935 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019249916 = queryNorm
             0.44591168 = fieldWeight in 977, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
         0.042981323 = weight(abstract_txt:semantic in 977) [ClassicSimilarity], result of:
           0.042981323 = score(doc=977,freq=2.0), product of:
             0.10867688 = queryWeight, product of:
               1.2617135 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.019249916 = queryNorm
             0.39549646 = fieldWeight in 977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
         0.054744214 = weight(abstract_txt:high in 977) [ClassicSimilarity], result of:
           0.054744214 = score(doc=977,freq=2.0), product of:
             0.12769566 = queryWeight, product of:
               1.3676666 = boost
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.019249916 = queryNorm
             0.42870846 = fieldWeight in 977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
         0.09243972 = weight(abstract_txt:level in 977) [ClassicSimilarity], result of:
           0.09243972 = score(doc=977,freq=4.0), product of:
             0.16451676 = queryWeight, product of:
               1.901266 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.019249916 = queryNorm
             0.5618863 = fieldWeight in 977, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
         0.37995854 = weight(abstract_txt:image in 977) [ClassicSimilarity], result of:
           0.37995854 = score(doc=977,freq=13.0), product of:
             0.3136753 = queryWeight, product of:
               3.0314286 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.019249916 = queryNorm
             1.2113116 = fieldWeight in 977, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=977)
       0.24 = coord(6/25)
   

3. Nie, J.-Y.; Brisebois, M.: ¬An inferential approach to information retrieval and its implementation using a manual thesaurus (1996) 0.15

   0.14726238 = sum of:
     0.14726238 = product of:
       0.73631185 = sum of:
         0.026480157 = weight(abstract_txt:knowledge in 775) [ClassicSimilarity], result of:
           0.026480157 = score(doc=775,freq=1.0), product of:
             0.06826776 = queryWeight, product of:
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.019249916 = queryNorm
             0.3878867 = fieldWeight in 775, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.109375 = fieldNorm(doc=775)
         0.19934274 = weight(abstract_txt:modal in 775) [ClassicSimilarity], result of:
           0.19934274 = score(doc=775,freq=1.0), product of:
             0.20812564 = queryWeight, product of:
               1.2346389 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.019249916 = queryNorm
             0.95780003 = fieldWeight in 775, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.109375 = fieldNorm(doc=775)
         0.04662991 = weight(abstract_txt:approach in 775) [ClassicSimilarity], result of:
           0.04662991 = score(doc=775,freq=1.0), product of:
             0.113957286 = queryWeight, product of:
               1.5823729 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.019249916 = queryNorm
             0.40918761 = fieldWeight in 775, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.109375 = fieldNorm(doc=775)
         0.1863619 = weight(abstract_txt:incorporating in 775) [ClassicSimilarity], result of:
           0.1863619 = score(doc=775,freq=1.0), product of:
             0.250711 = queryWeight, product of:
               1.9163678 = boost
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.019249916 = queryNorm
             0.7433336 = fieldWeight in 775, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.109375 = fieldNorm(doc=775)
         0.27749717 = weight(abstract_txt:inference in 775) [ClassicSimilarity], result of:
           0.27749717 = score(doc=775,freq=2.0), product of:
             0.2594763 = queryWeight, product of:
               1.9495798 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.019249916 = queryNorm
             1.069451 = fieldWeight in 775, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.109375 = fieldNorm(doc=775)
       0.2 = coord(5/25)
   

4. Zhu, B.; Chen, H.: Validating a geographical image retrieval system (2000) 0.14

   0.1410496 = sum of:
     0.1410496 = product of:
       0.5877066 = sum of:
         0.018914398 = weight(abstract_txt:knowledge in 5769) [ClassicSimilarity], result of:
           0.018914398 = score(doc=5769,freq=1.0), product of:
             0.06826776 = queryWeight, product of:
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.019249916 = queryNorm
             0.27706194 = fieldWeight in 5769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
         0.01925079 = weight(abstract_txt:users in 5769) [ClassicSimilarity], result of:
           0.01925079 = score(doc=5769,freq=1.0), product of:
             0.0690748 = queryWeight, product of:
               1.0058935 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019249916 = queryNorm
             0.2786948 = fieldWeight in 5769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
         0.041902434 = weight(abstract_txt:models in 5769) [ClassicSimilarity], result of:
           0.041902434 = score(doc=5769,freq=1.0), product of:
             0.116014816 = queryWeight, product of:
               1.3036137 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019249916 = queryNorm
             0.36118174 = fieldWeight in 5769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
         0.03330708 = weight(abstract_txt:approach in 5769) [ClassicSimilarity], result of:
           0.03330708 = score(doc=5769,freq=1.0), product of:
             0.113957286 = queryWeight, product of:
               1.5823729 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.019249916 = queryNorm
             0.29227686 = fieldWeight in 5769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
         0.057774823 = weight(abstract_txt:level in 5769) [ClassicSimilarity], result of:
           0.057774823 = score(doc=5769,freq=1.0), product of:
             0.16451676 = queryWeight, product of:
               1.901266 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.019249916 = queryNorm
             0.35117894 = fieldWeight in 5769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
         0.4165571 = weight(abstract_txt:image in 5769) [ClassicSimilarity], result of:
           0.4165571 = score(doc=5769,freq=10.0), product of:
             0.3136753 = queryWeight, product of:
               3.0314286 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.019249916 = queryNorm
             1.3279881 = fieldWeight in 5769, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.078125 = fieldNorm(doc=5769)
       0.24 = coord(6/25)
   

5. Schank, R.C.; Fano, A.: Memory and expectations in learning, language, and visual understanding (1995) 0.13

   0.12678061 = sum of:
     0.12678061 = product of:
       0.52825254 = sum of:
         0.018914398 = weight(abstract_txt:knowledge in 3950) [ClassicSimilarity], result of:
           0.018914398 = score(doc=3950,freq=1.0), product of:
             0.06826776 = queryWeight, product of:
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.019249916 = queryNorm
             0.27706194 = fieldWeight in 3950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
         0.041902434 = weight(abstract_txt:models in 3950) [ClassicSimilarity], result of:
           0.041902434 = score(doc=3950,freq=1.0), product of:
             0.116014816 = queryWeight, product of:
               1.3036137 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019249916 = queryNorm
             0.36118174 = fieldWeight in 3950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
         0.048387505 = weight(abstract_txt:high in 3950) [ClassicSimilarity], result of:
           0.048387505 = score(doc=3950,freq=1.0), product of:
             0.12769566 = queryWeight, product of:
               1.3676666 = boost
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.019249916 = queryNorm
             0.37892833 = fieldWeight in 3950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
         0.057774823 = weight(abstract_txt:level in 3950) [ClassicSimilarity], result of:
           0.057774823 = score(doc=3950,freq=1.0), product of:
             0.16451676 = queryWeight, product of:
               1.901266 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.019249916 = queryNorm
             0.35117894 = fieldWeight in 3950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
         0.13311565 = weight(abstract_txt:incorporating in 3950) [ClassicSimilarity], result of:
           0.13311565 = score(doc=3950,freq=1.0), product of:
             0.250711 = queryWeight, product of:
               1.9163678 = boost
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.019249916 = queryNorm
             0.5309526 = fieldWeight in 3950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
         0.22815773 = weight(abstract_txt:image in 3950) [ClassicSimilarity], result of:
           0.22815773 = score(doc=3950,freq=3.0), product of:
             0.3136753 = queryWeight, product of:
               3.0314286 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.019249916 = queryNorm
             0.72736907 = fieldWeight in 3950, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.078125 = fieldNorm(doc=3950)
       0.24 = coord(6/25)