Document (#11313)

Author

Srihari, R.K.

Title

Computational models for integrating linguistic and visual information : a survey

Source

Artificial intelligence review. 8(1994/95) nos.5/6, S.349-369

Year

1994/95

Abstract

Surveys research in developing computational models for integrating linguistic and visual information. It begins with a discussion of systems which have been actually implemented and continues with computationally motivated theories of human cognition. Since existing research spans several disciplines (eg natural language understanding, computer vision, knowledge representation), as well as several application areas, categorizes existing research based on inputs and objectives. Outlines some key issues related to integrating information from 2 such diverse sources and relates it to existing research. Throughout, the key issue addressed is the correspondence problem, ie how to associate visual events with words and vice verse

Theme

Information

Similar documents (content)

1. Partridge, D.: Language and vision : a single perception mechanism? (1995) 0.12

   0.11557801 = sum of:
     0.11557801 = product of:
       0.57789004 = sum of:
         0.012913258 = weight(abstract_txt:information in 3952) [ClassicSimilarity], result of:
           0.012913258 = score(doc=3952,freq=1.0), product of:
             0.056943834 = queryWeight, product of:
               1.139423 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020660646 = queryNorm
             0.22677183 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=3952)
         0.057236314 = weight(abstract_txt:several in 3952) [ClassicSimilarity], result of:
           0.057236314 = score(doc=3952,freq=1.0), product of:
             0.1342271 = queryWeight, product of:
               1.4283547 = boost
               4.548416 = idf(docFreq=1277, maxDocs=44421)
               0.020660646 = queryNorm
             0.426414 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.548416 = idf(docFreq=1277, maxDocs=44421)
               0.09375 = fieldNorm(doc=3952)
         0.06010329 = weight(abstract_txt:models in 3952) [ClassicSimilarity], result of:
           0.06010329 = score(doc=3952,freq=1.0), product of:
             0.13867278 = queryWeight, product of:
               1.4518161 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020660646 = queryNorm
             0.43341807 = fieldWeight in 3952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.09375 = fieldNorm(doc=3952)
         0.16893321 = weight(abstract_txt:linguistic in 3952) [ClassicSimilarity], result of:
           0.16893321 = score(doc=3952,freq=2.0), product of:
             0.21920937 = queryWeight, product of:
               1.8253474 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.020660646 = queryNorm
             0.77064776 = fieldWeight in 3952, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.09375 = fieldNorm(doc=3952)
         0.278704 = weight(abstract_txt:visual in 3952) [ClassicSimilarity], result of:
           0.278704 = score(doc=3952,freq=3.0), product of:
             0.30606326 = queryWeight, product of:
               2.6416008 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.020660646 = queryNorm
             0.91060907 = fieldWeight in 3952, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.09375 = fieldNorm(doc=3952)
       0.2 = coord(5/25)
   

2. Multilingual information management : current levels and future abilities. A report Commissioned by the US National Science Foundation and also delivered to the European Commission's Language Engineering Office and the US Defense Advanced Research Projects Agency, April 1999 (1999) 0.11

   0.10511893 = sum of:
     0.10511893 = product of:
       0.37542474 = sum of:
         0.04614486 = weight(abstract_txt:vision in 68) [ClassicSimilarity], result of:
           0.04614486 = score(doc=68,freq=1.0), product of:
             0.1321864 = queryWeight, product of:
               1.0022923 = boost
               6.3833475 = idf(docFreq=203, maxDocs=44421)
               0.020660646 = queryNorm
             0.34908932 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3833475 = idf(docFreq=203, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.021305786 = weight(abstract_txt:information in 68) [ClassicSimilarity], result of:
           0.021305786 = score(doc=68,freq=8.0), product of:
             0.056943834 = queryWeight, product of:
               1.139423 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020660646 = queryNorm
             0.37415442 = fieldWeight in 68, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.016555253 = weight(abstract_txt:with in 68) [ClassicSimilarity], result of:
           0.016555253 = score(doc=68,freq=4.0), product of:
             0.060638558 = queryWeight, product of:
               1.175807 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020660646 = queryNorm
             0.2730153 = fieldWeight in 68, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.035060253 = weight(abstract_txt:models in 68) [ClassicSimilarity], result of:
           0.035060253 = score(doc=68,freq=1.0), product of:
             0.13867278 = queryWeight, product of:
               1.4518161 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020660646 = queryNorm
             0.2528272 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.031654954 = weight(abstract_txt:research in 68) [ClassicSimilarity], result of:
           0.031654954 = score(doc=68,freq=2.0), product of:
             0.12954152 = queryWeight, product of:
               1.9844286 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.020660646 = queryNorm
             0.24436146 = fieldWeight in 68, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.09083409 = weight(abstract_txt:computational in 68) [ClassicSimilarity], result of:
           0.09083409 = score(doc=68,freq=1.0), product of:
             0.26158556 = queryWeight, product of:
               1.9939896 = boost
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.020660646 = queryNorm
             0.34724426 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
         0.13386954 = weight(abstract_txt:integrating in 68) [ClassicSimilarity], result of:
           0.13386954 = score(doc=68,freq=1.0), product of:
             0.3877926 = queryWeight, product of:
               2.973455 = boost
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.020660646 = queryNorm
             0.34520915 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.0546875 = fieldNorm(doc=68)
       0.28 = coord(7/25)
   

3. Beverley, C.A.; Bath, P.A.; Barber, R.: Can two established information models explain the information behaviour of visually impaired people seeking health and social care information? (2007) 0.10

   0.09995643 = sum of:
     0.09995643 = product of:
       0.35698724 = sum of:
         0.027223537 = weight(abstract_txt:information in 863) [ClassicSimilarity], result of:
           0.027223537 = score(doc=863,freq=10.0), product of:
             0.056943834 = queryWeight, product of:
               1.139423 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020660646 = queryNorm
             0.478077 = fieldWeight in 863, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.013378665 = weight(abstract_txt:with in 863) [ClassicSimilarity], result of:
           0.013378665 = score(doc=863,freq=2.0), product of:
             0.060638558 = queryWeight, product of:
               1.175807 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020660646 = queryNorm
             0.22062966 = fieldWeight in 863, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.038157545 = weight(abstract_txt:several in 863) [ClassicSimilarity], result of:
           0.038157545 = score(doc=863,freq=1.0), product of:
             0.1342271 = queryWeight, product of:
               1.4283547 = boost
               4.548416 = idf(docFreq=1277, maxDocs=44421)
               0.020660646 = queryNorm
             0.284276 = fieldWeight in 863, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.548416 = idf(docFreq=1277, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.04006886 = weight(abstract_txt:models in 863) [ClassicSimilarity], result of:
           0.04006886 = score(doc=863,freq=1.0), product of:
             0.13867278 = queryWeight, product of:
               1.4518161 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020660646 = queryNorm
             0.28894538 = fieldWeight in 863, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.025581064 = weight(abstract_txt:research in 863) [ClassicSimilarity], result of:
           0.025581064 = score(doc=863,freq=1.0), product of:
             0.12954152 = queryWeight, product of:
               1.9844286 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.020660646 = queryNorm
             0.19747387 = fieldWeight in 863, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.060870305 = weight(abstract_txt:existing in 863) [ClassicSimilarity], result of:
           0.060870305 = score(doc=863,freq=1.0), product of:
             0.20977512 = queryWeight, product of:
               2.1869488 = boost
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.020660646 = queryNorm
             0.29016933 = fieldWeight in 863, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
         0.15170725 = weight(abstract_txt:visual in 863) [ClassicSimilarity], result of:
           0.15170725 = score(doc=863,freq=2.0), product of:
             0.30606326 = queryWeight, product of:
               2.6416008 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.020660646 = queryNorm
             0.49567282 = fieldWeight in 863, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.0625 = fieldNorm(doc=863)
       0.28 = coord(7/25)
   

4. Luhmann, J.; Burghardt, M.: Digital humanities - A discipline in its own right? : an analysis of the role and position of digital humanities in the academic landscape (2022) 0.10

   0.09903248 = sum of:
     0.09903248 = product of:
       0.3536874 = sum of:
         0.008608839 = weight(abstract_txt:information in 1461) [ClassicSimilarity], result of:
           0.008608839 = score(doc=1461,freq=1.0), product of:
             0.056943834 = queryWeight, product of:
               1.139423 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020660646 = queryNorm
             0.15118122 = fieldWeight in 1461, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.016385451 = weight(abstract_txt:with in 1461) [ClassicSimilarity], result of:
           0.016385451 = score(doc=1461,freq=3.0), product of:
             0.060638558 = queryWeight, product of:
               1.175807 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020660646 = queryNorm
             0.27021506 = fieldWeight in 1461, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.04006886 = weight(abstract_txt:models in 1461) [ClassicSimilarity], result of:
           0.04006886 = score(doc=1461,freq=1.0), product of:
             0.13867278 = queryWeight, product of:
               1.4518161 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020660646 = queryNorm
             0.28894538 = fieldWeight in 1461, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.07963588 = weight(abstract_txt:linguistic in 1461) [ClassicSimilarity], result of:
           0.07963588 = score(doc=1461,freq=1.0), product of:
             0.21920937 = queryWeight, product of:
               1.8253474 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.020660646 = queryNorm
             0.36328685 = fieldWeight in 1461, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.0443077 = weight(abstract_txt:research in 1461) [ClassicSimilarity], result of:
           0.0443077 = score(doc=1461,freq=3.0), product of:
             0.12954152 = queryWeight, product of:
               1.9844286 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.020660646 = queryNorm
             0.34203476 = fieldWeight in 1461, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.103810385 = weight(abstract_txt:computational in 1461) [ClassicSimilarity], result of:
           0.103810385 = score(doc=1461,freq=1.0), product of:
             0.26158556 = queryWeight, product of:
               1.9939896 = boost
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.020660646 = queryNorm
             0.3968506 = fieldWeight in 1461, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
         0.060870305 = weight(abstract_txt:existing in 1461) [ClassicSimilarity], result of:
           0.060870305 = score(doc=1461,freq=1.0), product of:
             0.20977512 = queryWeight, product of:
               2.1869488 = boost
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.020660646 = queryNorm
             0.29016933 = fieldWeight in 1461, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0625 = fieldNorm(doc=1461)
       0.28 = coord(7/25)
   

5. Zhang, P.; Soergel, D.: Towards a comprehensive model of the cognitive process and mechanisms of individual sensemaking (2014) 0.10

   0.09661633 = sum of:
     0.09661633 = product of:
       0.40256804 = sum of:
         0.072454475 = weight(abstract_txt:cognition in 2344) [ClassicSimilarity], result of:
           0.072454475 = score(doc=2344,freq=1.0), product of:
             0.16336289 = queryWeight, product of:
               1.1142373 = boost
               7.0962973 = idf(docFreq=99, maxDocs=44421)
               0.020660646 = queryNorm
             0.44351858 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0962973 = idf(docFreq=99, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.012174736 = weight(abstract_txt:information in 2344) [ClassicSimilarity], result of:
           0.012174736 = score(doc=2344,freq=2.0), product of:
             0.056943834 = queryWeight, product of:
               1.139423 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.020660646 = queryNorm
             0.21380253 = fieldWeight in 2344, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.009460145 = weight(abstract_txt:with in 2344) [ClassicSimilarity], result of:
           0.009460145 = score(doc=2344,freq=1.0), product of:
             0.060638558 = queryWeight, product of:
               1.175807 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020660646 = queryNorm
             0.15600874 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.0694013 = weight(abstract_txt:models in 2344) [ClassicSimilarity], result of:
           0.0694013 = score(doc=2344,freq=3.0), product of:
             0.13867278 = queryWeight, product of:
               1.4518161 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020660646 = queryNorm
             0.5004681 = fieldWeight in 2344, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.086083606 = weight(abstract_txt:existing in 2344) [ClassicSimilarity], result of:
           0.086083606 = score(doc=2344,freq=2.0), product of:
             0.20977512 = queryWeight, product of:
               2.1869488 = boost
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.020660646 = queryNorm
             0.41036138 = fieldWeight in 2344, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
         0.15299377 = weight(abstract_txt:integrating in 2344) [ClassicSimilarity], result of:
           0.15299377 = score(doc=2344,freq=1.0), product of:
             0.3877926 = queryWeight, product of:
               2.973455 = boost
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.020660646 = queryNorm
             0.39452475 = fieldWeight in 2344, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.0625 = fieldNorm(doc=2344)
       0.24 = coord(6/25)