Document (#37098)

Author

Lassalle, E.
Lassalle, E.

Title

Semantic models in information retrieval

Source

Next generation search engines: advanced models for information retrieval. Eds.: C. Jouis, u.a

Imprint

Hershey, PA : IGI Publishing

Year

2012

Pages

S.138-173

Abstract

Robertson and Spärck Jones pioneered experimental probabilistic models (Binary Independence Model) with both a typology generalizing the Boolean model, a frequency counting to calculate elementary weightings, and their combination into a global probabilistic estimation. However, this model did not consider indexing terms dependencies. An extension to mixture models (e.g., using a 2-Poisson law) made it possible to take into account these dependencies from a macroscopic point of view (BM25), as well as a shallow linguistic processing of co-references. New approaches (language models, for example "bag of words" models, probabilistic dependencies between requests and documents, and consequently Bayesian inference using Dirichlet prior conjugate) furnished new solutions for documents structuring (categorization) and for index smoothing. Presently, in these probabilistic models the main issues have been addressed from a formal point of view only. Thus, linguistic properties are neglected in the indexing language. The authors examine how a linguistic and semantic modeling can be integrated in indexing languages and set up a hybrid model that makes it possible to deal with different information retrieval problems in a unified way.

Footnote

Vgl.: http://www.igi-global.com/book/next-generation-search-engines/64424.

Theme

Semantic Web
Wissensrepräsentation

Similar documents (content)

1. Lhadj, L.S.; Boughanem, M.; Amrouche, K.: Enhancing information retrieval through concept-based language modeling and semantic smoothing (2016) 0.26

   0.26048923 = sum of:
     0.26048923 = product of:
       0.72358114 = sum of:
         0.019613303 = weight(abstract_txt:documents in 4221) [ClassicSimilarity], result of:
           0.019613303 = score(doc=4221,freq=1.0), product of:
             0.0761068 = queryWeight, product of:
               1.0050803 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018364344 = queryNorm
             0.25770763 = fieldWeight in 4221, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.035163026 = weight(abstract_txt:language in 4221) [ClassicSimilarity], result of:
           0.035163026 = score(doc=4221,freq=3.0), product of:
             0.07787655 = queryWeight, product of:
               1.0166991 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018364344 = queryNorm
             0.45152265 = fieldWeight in 4221, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.043412253 = weight(abstract_txt:semantic in 4221) [ClassicSimilarity], result of:
           0.043412253 = score(doc=4221,freq=3.0), product of:
             0.08962396 = queryWeight, product of:
               1.0906894 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.018364344 = queryNorm
             0.48438224 = fieldWeight in 4221, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.11264923 = weight(abstract_txt:smoothing in 4221) [ClassicSimilarity], result of:
           0.11264923 = score(doc=4221,freq=1.0), product of:
             0.19373071 = queryWeight, product of:
               1.1338962 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.018364344 = queryNorm
             0.5814733 = fieldWeight in 4221, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.035247754 = weight(abstract_txt:view in 4221) [ClassicSimilarity], result of:
           0.035247754 = score(doc=4221,freq=1.0), product of:
             0.11249778 = queryWeight, product of:
               1.2219714 = boost
               5.013113 = idf(docFreq=802, maxDocs=44421)
               0.018364344 = queryNorm
             0.31331956 = fieldWeight in 4221, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.013113 = idf(docFreq=802, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.03944521 = weight(abstract_txt:point in 4221) [ClassicSimilarity], result of:
           0.03944521 = score(doc=4221,freq=1.0), product of:
             0.12126045 = queryWeight, product of:
               1.26867 = boost
               5.204693 = idf(docFreq=662, maxDocs=44421)
               0.018364344 = queryNorm
             0.3252933 = fieldWeight in 4221, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.204693 = idf(docFreq=662, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.070701495 = weight(abstract_txt:model in 4221) [ClassicSimilarity], result of:
           0.070701495 = score(doc=4221,freq=4.0), product of:
             0.14201428 = queryWeight, product of:
               1.9416461 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.018364344 = queryNorm
             0.49784777 = fieldWeight in 4221, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.20147903 = weight(abstract_txt:dependencies in 4221) [ClassicSimilarity], result of:
           0.20147903 = score(doc=4221,freq=1.0), product of:
             0.41169283 = queryWeight, product of:
               2.863 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.018364344 = queryNorm
             0.48939165 = fieldWeight in 4221, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
         0.16586983 = weight(abstract_txt:models in 4221) [ClassicSimilarity], result of:
           0.16586983 = score(doc=4221,freq=4.0), product of:
             0.2870263 = queryWeight, product of:
               3.3807302 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.018364344 = queryNorm
             0.57789075 = fieldWeight in 4221, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=4221)
       0.36 = coord(9/25)
   

2. Vilares, J.; Alonso, M.A.; Vilares, M.: Extraction of complex index terms in non-English IR : a shallow parsing based approach (2008) 0.20

   0.20272762 = sum of:
     0.20272762 = product of:
       0.7240272 = sum of:
         0.0277374 = weight(abstract_txt:documents in 3107) [ClassicSimilarity], result of:
           0.0277374 = score(doc=3107,freq=2.0), product of:
             0.0761068 = queryWeight, product of:
               1.0050803 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018364344 = queryNorm
             0.3644536 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.08097787 = weight(abstract_txt:shallow in 3107) [ClassicSimilarity], result of:
           0.08097787 = score(doc=3107,freq=1.0), product of:
             0.15546186 = queryWeight, product of:
               1.015748 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.018364344 = queryNorm
             0.52088577 = fieldWeight in 3107, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.028710492 = weight(abstract_txt:language in 3107) [ClassicSimilarity], result of:
           0.028710492 = score(doc=3107,freq=2.0), product of:
             0.07787655 = queryWeight, product of:
               1.0166991 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018364344 = queryNorm
             0.3686667 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.027644973 = weight(abstract_txt:possible in 3107) [ClassicSimilarity], result of:
           0.027644973 = score(doc=3107,freq=1.0), product of:
             0.09567543 = queryWeight, product of:
               1.1269101 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.018364344 = queryNorm
             0.28894538 = fieldWeight in 3107, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.03944521 = weight(abstract_txt:point in 3107) [ClassicSimilarity], result of:
           0.03944521 = score(doc=3107,freq=1.0), product of:
             0.12126045 = queryWeight, product of:
               1.26867 = boost
               5.204693 = idf(docFreq=662, maxDocs=44421)
               0.018364344 = queryNorm
             0.3252933 = fieldWeight in 3107, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.204693 = idf(docFreq=662, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.1165532 = weight(abstract_txt:linguistic in 3107) [ClassicSimilarity], result of:
           0.1165532 = score(doc=3107,freq=2.0), product of:
             0.22686085 = queryWeight, product of:
               2.1252718 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.018364344 = queryNorm
             0.51376516 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.40295807 = weight(abstract_txt:dependencies in 3107) [ClassicSimilarity], result of:
           0.40295807 = score(doc=3107,freq=4.0), product of:
             0.41169283 = queryWeight, product of:
               2.863 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.018364344 = queryNorm
             0.9787833 = fieldWeight in 3107, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
       0.28 = coord(7/25)
   

3. Bodoff, D.; Wong, S.P.-S.: Documents and queries as random variables : history and implications (2006) 0.19

   0.18571505 = sum of:
     0.18571505 = product of:
       0.7738127 = sum of:
         0.042464044 = weight(abstract_txt:documents in 318) [ClassicSimilarity], result of:
           0.042464044 = score(doc=318,freq=3.0), product of:
             0.0761068 = queryWeight, product of:
               1.0050803 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018364344 = queryNorm
             0.55795336 = fieldWeight in 318, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.035888113 = weight(abstract_txt:language in 318) [ClassicSimilarity], result of:
           0.035888113 = score(doc=318,freq=2.0), product of:
             0.07787655 = queryWeight, product of:
               1.0166991 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018364344 = queryNorm
             0.46083337 = fieldWeight in 318, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.044059694 = weight(abstract_txt:view in 318) [ClassicSimilarity], result of:
           0.044059694 = score(doc=318,freq=1.0), product of:
             0.11249778 = queryWeight, product of:
               1.2219714 = boost
               5.013113 = idf(docFreq=802, maxDocs=44421)
               0.018364344 = queryNorm
             0.39164945 = fieldWeight in 318, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.013113 = idf(docFreq=802, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.044188432 = weight(abstract_txt:model in 318) [ClassicSimilarity], result of:
           0.044188432 = score(doc=318,freq=1.0), product of:
             0.14201428 = queryWeight, product of:
               1.9416461 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.018364344 = queryNorm
             0.31115484 = fieldWeight in 318, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.37540227 = weight(abstract_txt:probabilistic in 318) [ClassicSimilarity], result of:
           0.37540227 = score(doc=318,freq=3.0), product of:
             0.4099685 = queryWeight, product of:
               3.2989771 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.018364344 = queryNorm
             0.91568565 = fieldWeight in 318, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.23181015 = weight(abstract_txt:models in 318) [ClassicSimilarity], result of:
           0.23181015 = score(doc=318,freq=5.0), product of:
             0.2870263 = queryWeight, product of:
               3.3807302 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.018364344 = queryNorm
             0.8076269 = fieldWeight in 318, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
       0.24 = coord(6/25)
   

4. Lee, C.; Lee, G.G.: Probabilistic information retrieval model for a dependence structured indexing system (2005) 0.19

   0.18523735 = sum of:
     0.18523735 = product of:
       0.7718223 = sum of:
         0.024516629 = weight(abstract_txt:documents in 2004) [ClassicSimilarity], result of:
           0.024516629 = score(doc=2004,freq=1.0), product of:
             0.0761068 = queryWeight, product of:
               1.0050803 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018364344 = queryNorm
             0.32213452 = fieldWeight in 2004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
         0.11961312 = weight(abstract_txt:poisson in 2004) [ClassicSimilarity], result of:
           0.11961312 = score(doc=2004,freq=1.0), product of:
             0.17376362 = queryWeight, product of:
               1.0738744 = boost
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.018364344 = queryNorm
             0.6883669 = fieldWeight in 2004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
         0.04318875 = weight(abstract_txt:indexing in 2004) [ClassicSimilarity], result of:
           0.04318875 = score(doc=2004,freq=1.0), product of:
             0.1270751 = queryWeight, product of:
               1.5906144 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.018364344 = queryNorm
             0.33986792 = fieldWeight in 2004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
         0.06249188 = weight(abstract_txt:model in 2004) [ClassicSimilarity], result of:
           0.06249188 = score(doc=2004,freq=2.0), product of:
             0.14201428 = queryWeight, product of:
               1.9416461 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.018364344 = queryNorm
             0.4400394 = fieldWeight in 2004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
         0.37540227 = weight(abstract_txt:probabilistic in 2004) [ClassicSimilarity], result of:
           0.37540227 = score(doc=2004,freq=3.0), product of:
             0.4099685 = queryWeight, product of:
               3.2989771 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.018364344 = queryNorm
             0.91568565 = fieldWeight in 2004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
         0.1466096 = weight(abstract_txt:models in 2004) [ClassicSimilarity], result of:
           0.1466096 = score(doc=2004,freq=2.0), product of:
             0.2870263 = queryWeight, product of:
               3.3807302 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.018364344 = queryNorm
             0.5107881 = fieldWeight in 2004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=2004)
       0.24 = coord(6/25)
   

5. Cho, B.-H.; Lee, C.; Lee, G.G.: Exploring term dependences in probabilistic information retrieval model (2003) 0.16

   0.16442944 = sum of:
     0.16442944 = product of:
       0.68512267 = sum of:
         0.024516629 = weight(abstract_txt:documents in 2077) [ClassicSimilarity], result of:
           0.024516629 = score(doc=2077,freq=1.0), product of:
             0.0761068 = queryWeight, product of:
               1.0050803 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018364344 = queryNorm
             0.32213452 = fieldWeight in 2077, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
         0.02537673 = weight(abstract_txt:language in 2077) [ClassicSimilarity], result of:
           0.02537673 = score(doc=2077,freq=1.0), product of:
             0.07787655 = queryWeight, product of:
               1.0166991 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.018364344 = queryNorm
             0.3258584 = fieldWeight in 2077, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
         0.11961312 = weight(abstract_txt:poisson in 2077) [ClassicSimilarity], result of:
           0.11961312 = score(doc=2077,freq=1.0), product of:
             0.17376362 = queryWeight, product of:
               1.0738744 = boost
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.018364344 = queryNorm
             0.6883669 = fieldWeight in 2077, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
         0.06249188 = weight(abstract_txt:model in 2077) [ClassicSimilarity], result of:
           0.06249188 = score(doc=2077,freq=2.0), product of:
             0.14201428 = queryWeight, product of:
               1.9416461 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.018364344 = queryNorm
             0.4400394 = fieldWeight in 2077, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
         0.30651468 = weight(abstract_txt:probabilistic in 2077) [ClassicSimilarity], result of:
           0.30651468 = score(doc=2077,freq=2.0), product of:
             0.4099685 = queryWeight, product of:
               3.2989771 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.018364344 = queryNorm
             0.7476542 = fieldWeight in 2077, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
         0.1466096 = weight(abstract_txt:models in 2077) [ClassicSimilarity], result of:
           0.1466096 = score(doc=2077,freq=2.0), product of:
             0.2870263 = queryWeight, product of:
               3.3807302 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.018364344 = queryNorm
             0.5107881 = fieldWeight in 2077, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=2077)
       0.24 = coord(6/25)