Document (#41578)

Author

Li, H.
Wu, H.
Li, D.
Lin, S.
Su, Z.
Luo, X.

Title

PSI: A probabilistic semantic interpretable framework for fine-grained image ranking

Source

Journal of the Association for Information Science and Technology. 69(2018) no.12, S.1488-1501

Year

2018

Abstract

Image Ranking is one of the key problems in information science research area. However, most current methods focus on increasing the performance, leaving the semantic gap problem, which refers to the learned ranking models are hard to be understood, remaining intact. Therefore, in this article, we aim at learning an interpretable ranking model to tackle the semantic gap in fine-grained image ranking. We propose to combine attribute-based representation and online passive-aggressive (PA) learning based ranking models to achieve this goal. Besides, considering the highly localized instances in fine-grained image ranking, we introduce a supervised constrained clustering method to gather class-balanced training instances for local PA-based models, and incorporate the learned local models into a unified probabilistic framework. Extensive experiments on the benchmark demonstrate that the proposed framework outperforms state-of-the-art methods in terms of accuracy and speed.

Content

https://onlinelibrary.wiley.com/doi/10.1002/asi.24068.

Theme

Retrievalalgorithmen

Form

Bilder

Similar documents (content)

1. Chen, Z.; Huang, Y.; Tian, J.; Liu, X.; Fu, K.; Huang, T.: Joint model for subsentence-level sentiment analysis with Markov logic (2015) 0.19

   0.18853046 = sum of:
     0.18853046 = product of:
       0.6733231 = sum of:
         0.055484667 = weight(abstract_txt:tackle in 3210) [ClassicSimilarity], result of:
           0.055484667 = score(doc=3210,freq=1.0), product of:
             0.11745377 = queryWeight, product of:
               1.0395676 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.014948176 = queryNorm
             0.4723958 = fieldWeight in 3210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.027404923 = weight(abstract_txt:learning in 3210) [ClassicSimilarity], result of:
           0.027404923 = score(doc=3210,freq=1.0), product of:
             0.092465706 = queryWeight, product of:
               1.3044415 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.014948176 = queryNorm
             0.29637933 = fieldWeight in 3210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.03658404 = weight(abstract_txt:local in 3210) [ClassicSimilarity], result of:
           0.03658404 = score(doc=3210,freq=1.0), product of:
             0.112104416 = queryWeight, product of:
               1.4363015 = boost
               5.221423 = idf(docFreq=651, maxDocs=44421)
               0.014948176 = queryNorm
             0.32633895 = fieldWeight in 3210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.221423 = idf(docFreq=651, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.036180764 = weight(abstract_txt:framework in 3210) [ClassicSimilarity], result of:
           0.036180764 = score(doc=3210,freq=1.0), product of:
             0.12738273 = queryWeight, product of:
               1.8751463 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.014948176 = queryNorm
             0.28403196 = fieldWeight in 3210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.050788123 = weight(abstract_txt:models in 3210) [ClassicSimilarity], result of:
           0.050788123 = score(doc=3210,freq=1.0), product of:
             0.17577067 = queryWeight, product of:
               2.5434456 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.014948176 = queryNorm
             0.28894538 = fieldWeight in 3210, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.20085514 = weight(abstract_txt:fine in 3210) [ClassicSimilarity], result of:
           0.20085514 = score(doc=3210,freq=2.0), product of:
             0.316984 = queryWeight, product of:
               2.9580026 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.014948176 = queryNorm
             0.6336444 = fieldWeight in 3210, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
         0.26602545 = weight(abstract_txt:grained in 3210) [ClassicSimilarity], result of:
           0.26602545 = score(doc=3210,freq=2.0), product of:
             0.38229403 = queryWeight, product of:
               3.2484684 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.014948176 = queryNorm
             0.6958661 = fieldWeight in 3210, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0625 = fieldNorm(doc=3210)
       0.28 = coord(7/25)
   

2. Li, M.; Li, H.; Zhou, Z.-H.: Semi-supervised document retrieval (2009) 0.18

   0.1835293 = sum of:
     0.1835293 = product of:
       0.57352906 = sum of:
         0.049387246 = weight(abstract_txt:benchmark in 218) [ClassicSimilarity], result of:
           0.049387246 = score(doc=218,freq=1.0), product of:
             0.10868297 = queryWeight, product of:
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.014948176 = queryNorm
             0.45441568 = fieldWeight in 218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.0926738 = weight(abstract_txt:supervised in 218) [ClassicSimilarity], result of:
           0.0926738 = score(doc=218,freq=3.0), product of:
             0.11464344 = queryWeight, product of:
               1.0270554 = boost
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.014948176 = queryNorm
             0.8083655 = fieldWeight in 218, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.03656355 = weight(abstract_txt:methods in 218) [ClassicSimilarity], result of:
           0.03656355 = score(doc=218,freq=4.0), product of:
             0.07059499 = queryWeight, product of:
               1.1397804 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.014948176 = queryNorm
             0.5179341 = fieldWeight in 218, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.07250661 = weight(abstract_txt:learning in 218) [ClassicSimilarity], result of:
           0.07250661 = score(doc=218,freq=7.0), product of:
             0.092465706 = queryWeight, product of:
               1.3044415 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.014948176 = queryNorm
             0.78414595 = fieldWeight in 218, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.012432454 = weight(abstract_txt:based in 218) [ClassicSimilarity], result of:
           0.012432454 = score(doc=218,freq=1.0), product of:
             0.062492795 = queryWeight, product of:
               1.3133935 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.014948176 = queryNorm
             0.1989422 = fieldWeight in 218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.036180764 = weight(abstract_txt:framework in 218) [ClassicSimilarity], result of:
           0.036180764 = score(doc=218,freq=1.0), product of:
             0.12738273 = queryWeight, product of:
               1.8751463 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.014948176 = queryNorm
             0.28403196 = fieldWeight in 218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.050788123 = weight(abstract_txt:models in 218) [ClassicSimilarity], result of:
           0.050788123 = score(doc=218,freq=1.0), product of:
             0.17577067 = queryWeight, product of:
               2.5434456 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.014948176 = queryNorm
             0.28894538 = fieldWeight in 218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
         0.22299652 = weight(abstract_txt:ranking in 218) [ClassicSimilarity], result of:
           0.22299652 = score(doc=218,freq=2.0), product of:
             0.4507887 = queryWeight, product of:
               5.388337 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.014948176 = queryNorm
             0.4946808 = fieldWeight in 218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=218)
       0.32 = coord(8/25)
   

3. Tan, X.; Luo, X.; Wang, X.; Wang, H.; Hou, X.: Representation and display of digital images of cultural heritage : a semantic enrichment approach (2021) 0.16

   0.16344717 = sum of:
     0.16344717 = product of:
       0.6810299 = sum of:
         0.018281775 = weight(abstract_txt:methods in 1456) [ClassicSimilarity], result of:
           0.018281775 = score(doc=1456,freq=1.0), product of:
             0.07059499 = queryWeight, product of:
               1.1397804 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.014948176 = queryNorm
             0.25896704 = fieldWeight in 1456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
         0.012432454 = weight(abstract_txt:based in 1456) [ClassicSimilarity], result of:
           0.012432454 = score(doc=1456,freq=1.0), product of:
             0.062492795 = queryWeight, product of:
               1.3133935 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.014948176 = queryNorm
             0.1989422 = fieldWeight in 1456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
         0.10360488 = weight(abstract_txt:semantic in 1456) [ClassicSimilarity], result of:
           0.10360488 = score(doc=1456,freq=9.0), product of:
             0.12348987 = queryWeight, product of:
               1.8462715 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.014948176 = queryNorm
             0.8389747 = fieldWeight in 1456, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
         0.07983024 = weight(abstract_txt:image in 1456) [ClassicSimilarity], result of:
           0.07983024 = score(doc=1456,freq=1.0), product of:
             0.23762013 = queryWeight, product of:
               2.9572692 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.014948176 = queryNorm
             0.33595738 = fieldWeight in 1456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
         0.20085514 = weight(abstract_txt:fine in 1456) [ClassicSimilarity], result of:
           0.20085514 = score(doc=1456,freq=2.0), product of:
             0.316984 = queryWeight, product of:
               2.9580026 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.014948176 = queryNorm
             0.6336444 = fieldWeight in 1456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
         0.26602545 = weight(abstract_txt:grained in 1456) [ClassicSimilarity], result of:
           0.26602545 = score(doc=1456,freq=2.0), product of:
             0.38229403 = queryWeight, product of:
               3.2484684 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.014948176 = queryNorm
             0.6958661 = fieldWeight in 1456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0625 = fieldNorm(doc=1456)
       0.24 = coord(6/25)
   

4. Li, W.; Zheng, Y.; Zhan, Y.; Feng, R.; Zhang, T.; Fan, W.: Cross-modal retrieval with dual multi-angle self-attention (2021) 0.16

   0.16320954 = sum of:
     0.16320954 = product of:
       0.68003976 = sum of:
         0.049387246 = weight(abstract_txt:benchmark in 1068) [ClassicSimilarity], result of:
           0.049387246 = score(doc=1068,freq=1.0), product of:
             0.10868297 = queryWeight, product of:
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.014948176 = queryNorm
             0.45441568 = fieldWeight in 1068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.270651 = idf(docFreq=83, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
         0.018281775 = weight(abstract_txt:methods in 1068) [ClassicSimilarity], result of:
           0.018281775 = score(doc=1068,freq=1.0), product of:
             0.07059499 = queryWeight, product of:
               1.1397804 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.014948176 = queryNorm
             0.25896704 = fieldWeight in 1068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
         0.034534957 = weight(abstract_txt:semantic in 1068) [ClassicSimilarity], result of:
           0.034534957 = score(doc=1068,freq=1.0), product of:
             0.12348987 = queryWeight, product of:
               1.8462715 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.014948176 = queryNorm
             0.27965823 = fieldWeight in 1068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
         0.051167328 = weight(abstract_txt:framework in 1068) [ClassicSimilarity], result of:
           0.051167328 = score(doc=1068,freq=2.0), product of:
             0.12738273 = queryWeight, product of:
               1.8751463 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.014948176 = queryNorm
             0.40168184 = fieldWeight in 1068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
         0.20085514 = weight(abstract_txt:fine in 1068) [ClassicSimilarity], result of:
           0.20085514 = score(doc=1068,freq=2.0), product of:
             0.316984 = queryWeight, product of:
               2.9580026 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.014948176 = queryNorm
             0.6336444 = fieldWeight in 1068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
         0.3258133 = weight(abstract_txt:grained in 1068) [ClassicSimilarity], result of:
           0.3258133 = score(doc=1068,freq=3.0), product of:
             0.38229403 = queryWeight, product of:
               3.2484684 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.014948176 = queryNorm
             0.8522584 = fieldWeight in 1068, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0625 = fieldNorm(doc=1068)
       0.24 = coord(6/25)
   

5. Wunner, T.; Buitelaar, P.; O'Riain, S.: Semantic, terminological and linguistic interpretation of XBRL (2010) 0.15

   0.15072772 = sum of:
     0.15072772 = product of:
       0.75363857 = sum of:
         0.015540567 = weight(abstract_txt:based in 2122) [ClassicSimilarity], result of:
           0.015540567 = score(doc=2122,freq=1.0), product of:
             0.062492795 = queryWeight, product of:
               1.3133935 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.014948176 = queryNorm
             0.24867775 = fieldWeight in 2122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.078125 = fieldNorm(doc=2122)
         0.086337395 = weight(abstract_txt:semantic in 2122) [ClassicSimilarity], result of:
           0.086337395 = score(doc=2122,freq=4.0), product of:
             0.12348987 = queryWeight, product of:
               1.8462715 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.014948176 = queryNorm
             0.69914556 = fieldWeight in 2122, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.078125 = fieldNorm(doc=2122)
         0.23909259 = weight(abstract_txt:interpretable in 2122) [ClassicSimilarity], result of:
           0.23909259 = score(doc=2122,freq=1.0), product of:
             0.33770102 = queryWeight, product of:
               2.4928746 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.014948176 = queryNorm
             0.7080008 = fieldWeight in 2122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=2122)
         0.17753254 = weight(abstract_txt:fine in 2122) [ClassicSimilarity], result of:
           0.17753254 = score(doc=2122,freq=1.0), product of:
             0.316984 = queryWeight, product of:
               2.9580026 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.014948176 = queryNorm
             0.56006783 = fieldWeight in 2122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.078125 = fieldNorm(doc=2122)
         0.23513551 = weight(abstract_txt:grained in 2122) [ClassicSimilarity], result of:
           0.23513551 = score(doc=2122,freq=1.0), product of:
             0.38229403 = queryWeight, product of:
               3.2484684 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.014948176 = queryNorm
             0.61506456 = fieldWeight in 2122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.078125 = fieldNorm(doc=2122)
       0.2 = coord(5/25)