Document (#41686)

Author

Kim, H.H.
Kim, Y.H.

Title

Video summarization using event-related potential responses to shot boundaries in real-time video watching

Source

Journal of the Association for Information Science and Technology. 70(2019) no.2, S.164-175

Year

2019

Abstract

Our aim was to develop an event-related potential (ERP)-based method to construct a video skim consisting of key shots to bridge the semantic gap between the topic inferred from a whole video and that from its summary. Mayer's cognitive model was examined, wherein the topic integration process of a user evoked by a visual stimulus can be associated with long-latency ERP components. We determined that long-latency ERP components are suitable for measuring a user's neuronal response through a literature review. We hypothesized that N300 is specific to the categorization of all shots regardless of topic relevance, N400 is specific for the semantic mismatching process for topic-irrelevant shots, and P600 is specific for the context updating process for topic-relevant shots. In our experiment, the N400 component led to more negative ERP signals in response to topic-irrelevant shots than to topic-relevant shots and showed a fronto-central scalp pattern. P600 elicited more positive ERP signals for topic-relevant shots than for topic-irrelevant shots and showed a fronto-central scalp pattern. We used discriminant and artificial neural network (ANN) analyses to decode video shot relevance and observed that the ANN produced particularly high success rates: 91.3% from the training set and 100% from the test set.

Content

Vgl.: https://onlinelibrary.wiley.com/doi/10.1002/asi.24103.

Theme

Automatisches Abstracting

Form

Videos

Similar documents (content)

1. Kim, H.H.; Kim, Y.H.: ERP/MMR algorithm for classifying topic-relevant and topic-irrelevant visual shots of documentary videos (2019) 0.84

   0.8404046 = sum of:
     0.8404046 = product of:
       1.5007225 = sum of:
         0.05789875 = weight(abstract_txt:discriminant in 358) [ClassicSimilarity], result of:
           0.05789875 = score(doc=358,freq=1.0), product of:
             0.103006445 = queryWeight, product of:
               1.0049564 = boost
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.011397049 = queryNorm
             0.5620886 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.015644573 = weight(abstract_txt:potential in 358) [ClassicSimilarity], result of:
           0.015644573 = score(doc=358,freq=1.0), product of:
             0.054242212 = queryWeight, product of:
               1.0313325 = boost
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.011397049 = queryNorm
             0.28842062 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.007294124 = weight(abstract_txt:that in 358) [ClassicSimilarity], result of:
           0.007294124 = score(doc=358,freq=3.0), product of:
             0.028491367 = queryWeight, product of:
               1.0570649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011397049 = queryNorm
             0.25601172 = fieldWeight in 358, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.042640954 = weight(abstract_txt:relevance in 358) [ClassicSimilarity], result of:
           0.042640954 = score(doc=358,freq=5.0), product of:
             0.06189509 = queryWeight, product of:
               1.1016867 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011397049 = queryNorm
             0.68892306 = fieldWeight in 358, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.027807394 = weight(abstract_txt:components in 358) [ClassicSimilarity], result of:
           0.027807394 = score(doc=358,freq=1.0), product of:
             0.079591826 = queryWeight, product of:
               1.2492929 = boost
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.011397049 = queryNorm
             0.349375 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.030954367 = weight(abstract_txt:showed in 358) [ClassicSimilarity], result of:
           0.030954367 = score(doc=358,freq=1.0), product of:
             0.08548886 = queryWeight, product of:
               1.2947466 = boost
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.011397049 = queryNorm
             0.36208653 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.035442095 = weight(abstract_txt:process in 358) [ClassicSimilarity], result of:
           0.035442095 = score(doc=358,freq=5.0), product of:
             0.06263469 = queryWeight, product of:
               1.3573227 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.011397049 = queryNorm
             0.5658541 = fieldWeight in 358, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.023698961 = weight(abstract_txt:relevant in 358) [ClassicSimilarity], result of:
           0.023698961 = score(doc=358,freq=1.0), product of:
             0.08189893 = queryWeight, product of:
               1.5520823 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011397049 = queryNorm
             0.2893684 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.05441486 = weight(abstract_txt:event in 358) [ClassicSimilarity], result of:
           0.05441486 = score(doc=358,freq=1.0), product of:
             0.12452024 = queryWeight, product of:
               1.5626078 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.011397049 = queryNorm
             0.4369961 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.17601886 = weight(abstract_txt:shot in 358) [ClassicSimilarity], result of:
           0.17601886 = score(doc=358,freq=3.0), product of:
             0.18884 = queryWeight, product of:
               1.9243187 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.011397049 = queryNorm
             0.93210584 = fieldWeight in 358, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.09773962 = weight(abstract_txt:irrelevant in 358) [ClassicSimilarity], result of:
           0.09773962 = score(doc=358,freq=1.0), product of:
             0.210623 = queryWeight, product of:
               2.4890208 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.011397049 = queryNorm
             0.46405008 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.24201506 = weight(abstract_txt:video in 358) [ClassicSimilarity], result of:
           0.24201506 = score(doc=358,freq=7.0), product of:
             0.23892991 = queryWeight, product of:
               3.4224355 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.011397049 = queryNorm
             1.0129124 = fieldWeight in 358, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.26153576 = weight(abstract_txt:topic in 358) [ClassicSimilarity], result of:
           0.26153576 = score(doc=358,freq=8.0), product of:
             0.29274523 = queryWeight, product of:
               5.0825443 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.011397049 = queryNorm
             0.89339036 = fieldWeight in 358, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
         0.4276172 = weight(abstract_txt:shots in 358) [ClassicSimilarity], result of:
           0.4276172 = score(doc=358,freq=1.0), product of:
             0.78130096 = queryWeight, product of:
               7.828331 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.011397049 = queryNorm
             0.5473143 = fieldWeight in 358, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.0625 = fieldNorm(doc=358)
       0.56 = coord(14/25)
   

2. Chua, T.-S.; Ruan, L.-Q.: ¬A video retrieval and sequencing system (1995) 0.35

   0.3478845 = sum of:
     0.3478845 = product of:
       1.4495188 = sum of:
         0.019812733 = weight(abstract_txt:process in 3906) [ClassicSimilarity], result of:
           0.019812733 = score(doc=3906,freq=1.0), product of:
             0.06263469 = queryWeight, product of:
               1.3573227 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.011397049 = queryNorm
             0.31632203 = fieldWeight in 3906, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
         0.02382711 = weight(abstract_txt:specific in 3906) [ClassicSimilarity], result of:
           0.02382711 = score(doc=3906,freq=1.0), product of:
             0.07083256 = queryWeight, product of:
               1.4434179 = boost
               4.305746 = idf(docFreq=1628, maxDocs=44421)
               0.011397049 = queryNorm
             0.3363864 = fieldWeight in 3906, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.305746 = idf(docFreq=1628, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
         0.0296237 = weight(abstract_txt:relevant in 3906) [ClassicSimilarity], result of:
           0.0296237 = score(doc=3906,freq=1.0), product of:
             0.08189893 = queryWeight, product of:
               1.5520823 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011397049 = queryNorm
             0.3617105 = fieldWeight in 3906, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
         0.12703067 = weight(abstract_txt:shot in 3906) [ClassicSimilarity], result of:
           0.12703067 = score(doc=3906,freq=1.0), product of:
             0.18884 = queryWeight, product of:
               1.9243187 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.011397049 = queryNorm
             0.67268944 = fieldWeight in 3906, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
         0.32340625 = weight(abstract_txt:video in 3906) [ClassicSimilarity], result of:
           0.32340625 = score(doc=3906,freq=8.0), product of:
             0.23892991 = queryWeight, product of:
               3.4224355 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.011397049 = queryNorm
             1.3535612 = fieldWeight in 3906, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
         0.9258183 = weight(abstract_txt:shots in 3906) [ClassicSimilarity], result of:
           0.9258183 = score(doc=3906,freq=3.0), product of:
             0.78130096 = queryWeight, product of:
               7.828331 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.011397049 = queryNorm
             1.1849701 = fieldWeight in 3906, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.078125 = fieldNorm(doc=3906)
       0.24 = coord(6/25)
   

3. Kannan, R.; Ghinea, G.; Swaminathan, S.: What do you wish to see? : A summarization system for movies based on user preferences (2015) 0.27

   0.27242938 = sum of:
     0.27242938 = product of:
       0.9729621 = sum of:
         0.013689 = weight(abstract_txt:potential in 3683) [ClassicSimilarity], result of:
           0.013689 = score(doc=3683,freq=1.0), product of:
             0.054242212 = queryWeight, product of:
               1.0313325 = boost
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.011397049 = queryNorm
             0.25236803 = fieldWeight in 3683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.0036848567 = weight(abstract_txt:that in 3683) [ClassicSimilarity], result of:
           0.0036848567 = score(doc=3683,freq=1.0), product of:
             0.028491367 = queryWeight, product of:
               1.0570649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011397049 = queryNorm
             0.1293324 = fieldWeight in 3683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.016685914 = weight(abstract_txt:relevance in 3683) [ClassicSimilarity], result of:
           0.016685914 = score(doc=3683,freq=1.0), product of:
             0.06189509 = queryWeight, product of:
               1.1016867 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011397049 = queryNorm
             0.2695838 = fieldWeight in 3683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.005853375 = weight(abstract_txt:from in 3683) [ClassicSimilarity], result of:
           0.005853375 = score(doc=3683,freq=1.0), product of:
             0.038788572 = queryWeight, product of:
               1.23338 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011397049 = queryNorm
             0.15090463 = fieldWeight in 3683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.08892147 = weight(abstract_txt:shot in 3683) [ClassicSimilarity], result of:
           0.08892147 = score(doc=3683,freq=1.0), product of:
             0.18884 = queryWeight, product of:
               1.9243187 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.011397049 = queryNorm
             0.47088262 = fieldWeight in 3683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.19605461 = weight(abstract_txt:video in 3683) [ClassicSimilarity], result of:
           0.19605461 = score(doc=3683,freq=6.0), product of:
             0.23892991 = queryWeight, product of:
               3.4224355 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.011397049 = queryNorm
             0.8205528 = fieldWeight in 3683, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
         0.64807284 = weight(abstract_txt:shots in 3683) [ClassicSimilarity], result of:
           0.64807284 = score(doc=3683,freq=3.0), product of:
             0.78130096 = queryWeight, product of:
               7.828331 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.011397049 = queryNorm
             0.8294791 = fieldWeight in 3683, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3683)
       0.28 = coord(7/25)
   

4. Turner, J.M.: Comparing user-assigned terms with indexer-assigned terms for storage and retrieval of moving images : research results (1995) 0.25

   0.2543805 = sum of:
     0.2543805 = product of:
       1.5898781 = sum of:
         0.017380016 = weight(abstract_txt:from in 3899) [ClassicSimilarity], result of:
           0.017380016 = score(doc=3899,freq=3.0), product of:
             0.038788572 = queryWeight, product of:
               1.23338 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011397049 = queryNorm
             0.44807053 = fieldWeight in 3899, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.09375 = fieldNorm(doc=3899)
         0.15243682 = weight(abstract_txt:shot in 3899) [ClassicSimilarity], result of:
           0.15243682 = score(doc=3899,freq=1.0), product of:
             0.18884 = queryWeight, product of:
               1.9243187 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.011397049 = queryNorm
             0.8072274 = fieldWeight in 3899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.09375 = fieldNorm(doc=3899)
         0.13720964 = weight(abstract_txt:video in 3899) [ClassicSimilarity], result of:
           0.13720964 = score(doc=3899,freq=1.0), product of:
             0.23892991 = queryWeight, product of:
               3.4224355 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.011397049 = queryNorm
             0.5742673 = fieldWeight in 3899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.09375 = fieldNorm(doc=3899)
         1.2828516 = weight(abstract_txt:shots in 3899) [ClassicSimilarity], result of:
           1.2828516 = score(doc=3899,freq=4.0), product of:
             0.78130096 = queryWeight, product of:
               7.828331 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.011397049 = queryNorm
             1.6419429 = fieldWeight in 3899, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.09375 = fieldNorm(doc=3899)
       0.16 = coord(4/25)
   

5. Turner, J.M.: Cross-language transfer of indexing concepts for storage and retrieval of moving images : preliminary results (1996) 0.17

   0.1686802 = sum of:
     0.1686802 = product of:
       0.843401 = sum of:
         0.033187147 = weight(abstract_txt:potential in 469) [ClassicSimilarity], result of:
           0.033187147 = score(doc=469,freq=2.0), product of:
             0.054242212 = queryWeight, product of:
               1.0313325 = boost
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.011397049 = queryNorm
             0.6118325 = fieldWeight in 469, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.61473 = idf(docFreq=1195, maxDocs=44421)
               0.09375 = fieldNorm(doc=469)
         0.006316897 = weight(abstract_txt:that in 469) [ClassicSimilarity], result of:
           0.006316897 = score(doc=469,freq=1.0), product of:
             0.028491367 = queryWeight, product of:
               1.0570649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011397049 = queryNorm
             0.22171268 = fieldWeight in 469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=469)
         0.010034356 = weight(abstract_txt:from in 469) [ClassicSimilarity], result of:
           0.010034356 = score(doc=469,freq=1.0), product of:
             0.038788572 = queryWeight, product of:
               1.23338 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011397049 = queryNorm
             0.25869364 = fieldWeight in 469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.09375 = fieldNorm(doc=469)
         0.15243682 = weight(abstract_txt:shot in 469) [ClassicSimilarity], result of:
           0.15243682 = score(doc=469,freq=1.0), product of:
             0.18884 = queryWeight, product of:
               1.9243187 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.011397049 = queryNorm
             0.8072274 = fieldWeight in 469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.09375 = fieldNorm(doc=469)
         0.6414258 = weight(abstract_txt:shots in 469) [ClassicSimilarity], result of:
           0.6414258 = score(doc=469,freq=1.0), product of:
             0.78130096 = queryWeight, product of:
               7.828331 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.011397049 = queryNorm
             0.8209714 = fieldWeight in 469, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.09375 = fieldNorm(doc=469)
       0.2 = coord(5/25)