Document (#13554)

Author: Taghva, K.
Borsack, J.
Condit, A.
Title: Evaluation of model-based retrieval effectiveness with OCR text
Source: ACM transactions on information systems. 14(1996) no.1, S.64-93
Year: 1996
Abstract: Reports on experiments with retrieval from OCR-generated text using systems based on standard models of retrieval. Shows that average precision and recall is not affected by OCR errors across systems for several collections. Both the actual and the simulation experiments include full text and abstract length documents. The ranking and feedback methods associated with the retrieval models are generally not robust enough to deal with OCR errors. OCR errors and garbage strings generated from the mistranslation of graphic objects increase the size of the index significantly. Describes the problems of applying OCR text within an information retrieval environment and offers solutions

Similar documents (content)

Tagheva, K.; Borsack, J.; Condit, A.: Effects of OCR errors on ranking and feedback using the vector space model (1996) 0.37

0.36887005 = sum of:
  0.36887005 = product of:
    1.1527189 = sum of:
      0.083954684 = weight(abstract_txt:recall in 5019) [ClassicSimilarity], result of:
        0.083954684 = score(doc=5019,freq=1.0), product of:
          0.133474 = queryWeight, product of:
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.023209542 = queryNorm
          0.6289965 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.090768434 = weight(abstract_txt:average in 5019) [ClassicSimilarity], result of:
        0.090768434 = score(doc=5019,freq=1.0), product of:
          0.14060152 = queryWeight, product of:
            1.0263528 = boost
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.023209542 = queryNorm
          0.64557225 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.09248809 = weight(abstract_txt:feedback in 5019) [ClassicSimilarity], result of:
        0.09248809 = score(doc=5019,freq=1.0), product of:
          0.14237179 = queryWeight, product of:
            1.0327938 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.023209542 = queryNorm
          0.6496237 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.12296747 = weight(abstract_txt:affected in 5019) [ClassicSimilarity], result of:
        0.12296747 = score(doc=5019,freq=1.0), product of:
          0.17214467 = queryWeight, product of:
            1.1356603 = boost
            6.5309834 = idf(docFreq=175, maxDocs=44421)
            0.023209542 = queryNorm
          0.7143263 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.5309834 = idf(docFreq=175, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.027461305 = weight(abstract_txt:with in 5019) [ClassicSimilarity], result of:
        0.027461305 = score(doc=5019,freq=1.0), product of:
          0.10058523 = queryWeight, product of:
            1.7361959 = boost
            2.4961398 = idf(docFreq=9949, maxDocs=44421)
            0.023209542 = queryNorm
          0.2730153 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4961398 = idf(docFreq=9949, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.11650459 = weight(abstract_txt:text in 5019) [ClassicSimilarity], result of:
        0.11650459 = score(doc=5019,freq=1.0), product of:
          0.26360205 = queryWeight, product of:
            2.810645 = boost
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.023209542 = queryNorm
          0.44197148 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.0927366 = weight(abstract_txt:retrieval in 5019) [ClassicSimilarity], result of:
        0.0927366 = score(doc=5019,freq=1.0), product of:
          0.24388824 = queryWeight, product of:
            3.0226097 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.023209542 = queryNorm
          0.3802422 = fieldWeight in 5019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
      0.5258377 = weight(abstract_txt:errors in 5019) [ClassicSimilarity], result of:
        0.5258377 = score(doc=5019,freq=2.0), product of:
          0.5191566 = queryWeight, product of:
            3.4159496 = boost
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.023209542 = queryNorm
          1.0128692 = fieldWeight in 5019, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.109375 = fieldNorm(doc=5019)
    0.32 = coord(8/25)

Losee, R.M.: Determining information retrieval and filtering performance without experimentation (1995) 0.26

0.25613335 = sum of:
  0.25613335 = product of:
    0.71148145 = sum of:
      0.064834595 = weight(abstract_txt:average in 3436) [ClassicSimilarity], result of:
        0.064834595 = score(doc=3436,freq=1.0), product of:
          0.14060152 = queryWeight, product of:
            1.0263528 = boost
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.023209542 = queryNorm
          0.46112302 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.06606292 = weight(abstract_txt:feedback in 3436) [ClassicSimilarity], result of:
        0.06606292 = score(doc=3436,freq=1.0), product of:
          0.14237179 = queryWeight, product of:
            1.0327938 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.023209542 = queryNorm
          0.4640169 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.02033748 = weight(abstract_txt:based in 3436) [ClassicSimilarity], result of:
        0.02033748 = score(doc=3436,freq=1.0), product of:
          0.08178247 = queryWeight, product of:
            1.1069977 = boost
            3.1830752 = idf(docFreq=5005, maxDocs=44421)
            0.023209542 = queryNorm
          0.24867775 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.1830752 = idf(docFreq=5005, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.08829583 = weight(abstract_txt:length in 3436) [ClassicSimilarity], result of:
        0.08829583 = score(doc=3436,freq=1.0), product of:
          0.17274769 = queryWeight, product of:
            1.1376476 = boost
            6.5424123 = idf(docFreq=173, maxDocs=44421)
            0.023209542 = queryNorm
          0.511126 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.5424123 = idf(docFreq=173, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.025030442 = weight(abstract_txt:systems in 3436) [ClassicSimilarity], result of:
        0.025030442 = score(doc=3436,freq=1.0), product of:
          0.09392354 = queryWeight, product of:
            1.1863254 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.023209542 = queryNorm
          0.26649806 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.16891095 = weight(abstract_txt:simulation in 3436) [ClassicSimilarity], result of:
        0.16891095 = score(doc=3436,freq=2.0), product of:
          0.21129084 = queryWeight, product of:
            1.2581776 = boost
            7.2355595 = idf(docFreq=86, maxDocs=44421)
            0.023209542 = queryNorm
          0.79942393 = fieldWeight in 3436, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.2355595 = idf(docFreq=86, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.062310845 = weight(abstract_txt:models in 3436) [ClassicSimilarity], result of:
        0.062310845 = score(doc=3436,freq=1.0), product of:
          0.17251937 = queryWeight, product of:
            1.6078131 = boost
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.023209542 = queryNorm
          0.36118174 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.08321756 = weight(abstract_txt:text in 3436) [ClassicSimilarity], result of:
        0.08321756 = score(doc=3436,freq=1.0), product of:
          0.26360205 = queryWeight, product of:
            2.810645 = boost
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.023209542 = queryNorm
          0.3156939 = fieldWeight in 3436, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
      0.13248086 = weight(abstract_txt:retrieval in 3436) [ClassicSimilarity], result of:
        0.13248086 = score(doc=3436,freq=4.0), product of:
          0.24388824 = queryWeight, product of:
            3.0226097 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.023209542 = queryNorm
          0.5432031 = fieldWeight in 3436, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=3436)
    0.36 = coord(9/25)

Lam-Adesina, A.M.; Jones, G.J.F.: Examining and improving the effectiveness of relevance feedback for retrieval of scanned text documents (2006) 0.24

0.23566937 = sum of:
  0.23566937 = product of:
    0.84167635 = sum of:
      0.105700664 = weight(abstract_txt:feedback in 1977) [ClassicSimilarity], result of:
        0.105700664 = score(doc=1977,freq=4.0), product of:
          0.14237179 = queryWeight, product of:
            1.0327938 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.023209542 = queryNorm
          0.74242705 = fieldWeight in 1977, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.016269984 = weight(abstract_txt:based in 1977) [ClassicSimilarity], result of:
        0.016269984 = score(doc=1977,freq=1.0), product of:
          0.08178247 = queryWeight, product of:
            1.1069977 = boost
            3.1830752 = idf(docFreq=5005, maxDocs=44421)
            0.023209542 = queryNorm
          0.1989422 = fieldWeight in 1977, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.1830752 = idf(docFreq=5005, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.02831871 = weight(abstract_txt:systems in 1977) [ClassicSimilarity], result of:
        0.02831871 = score(doc=1977,freq=2.0), product of:
          0.09392354 = queryWeight, product of:
            1.1863254 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.023209542 = queryNorm
          0.30150813 = fieldWeight in 1977, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.09942311 = weight(abstract_txt:strings in 1977) [ClassicSimilarity], result of:
        0.09942311 = score(doc=1977,freq=1.0), product of:
          0.21696201 = queryWeight, product of:
            1.274951 = boost
            7.33202 = idf(docFreq=78, maxDocs=44421)
            0.023209542 = queryNorm
          0.45825124 = fieldWeight in 1977, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.33202 = idf(docFreq=78, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.094149925 = weight(abstract_txt:text in 1977) [ClassicSimilarity], result of:
        0.094149925 = score(doc=1977,freq=2.0), product of:
          0.26360205 = queryWeight, product of:
            2.810645 = boost
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.023209542 = queryNorm
          0.3571669 = fieldWeight in 1977, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.040882 = idf(docFreq=2122, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.12980421 = weight(abstract_txt:retrieval in 1977) [ClassicSimilarity], result of:
        0.12980421 = score(doc=1977,freq=6.0), product of:
          0.24388824 = queryWeight, product of:
            3.0226097 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.023209542 = queryNorm
          0.53222823 = fieldWeight in 1977, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
      0.36800975 = weight(abstract_txt:errors in 1977) [ClassicSimilarity], result of:
        0.36800975 = score(doc=1977,freq=3.0), product of:
          0.5191566 = queryWeight, product of:
            3.4159496 = boost
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.023209542 = queryNorm
          0.7088608 = fieldWeight in 1977, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.0625 = fieldNorm(doc=1977)
    0.28 = coord(7/25)

Taghva, K.: ¬The effects of noisy data on text retrieval (1994) 0.22

0.22185966 = sum of:
  0.22185966 = product of:
    0.9244153 = sum of:
      0.09035158 = weight(abstract_txt:applying in 7226) [ClassicSimilarity], result of:
        0.09035158 = score(doc=7226,freq=1.0), product of:
          0.14017071 = queryWeight, product of:
            1.0247791 = boost
            5.8933253 = idf(docFreq=332, maxDocs=44421)
            0.023209542 = queryNorm
          0.64458245 = fieldWeight in 7226, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.8933253 = idf(docFreq=332, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
      0.027461305 = weight(abstract_txt:with in 7226) [ClassicSimilarity], result of:
        0.027461305 = score(doc=7226,freq=1.0), product of:
          0.10058523 = queryWeight, product of:
            1.7361959 = boost
            2.4961398 = idf(docFreq=9949, maxDocs=44421)
            0.023209542 = queryNorm
          0.2730153 = fieldWeight in 7226, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4961398 = idf(docFreq=9949, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
      0.13328458 = weight(abstract_txt:experiments in 7226) [ClassicSimilarity], result of:
        0.13328458 = score(doc=7226,freq=1.0), product of:
          0.22885656 = queryWeight, product of:
            1.8518181 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.023209542 = queryNorm
          0.5823935 = fieldWeight in 7226, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
      0.2087578 = weight(abstract_txt:generated in 7226) [ClassicSimilarity], result of:
        0.2087578 = score(doc=7226,freq=2.0), product of:
          0.24497883 = queryWeight, product of:
            1.9159356 = boost
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.023209542 = queryNorm
          0.85214627 = fieldWeight in 7226, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
      0.0927366 = weight(abstract_txt:retrieval in 7226) [ClassicSimilarity], result of:
        0.0927366 = score(doc=7226,freq=1.0), product of:
          0.24388824 = queryWeight, product of:
            3.0226097 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.023209542 = queryNorm
          0.3802422 = fieldWeight in 7226, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
      0.37182343 = weight(abstract_txt:errors in 7226) [ClassicSimilarity], result of:
        0.37182343 = score(doc=7226,freq=1.0), product of:
          0.5191566 = queryWeight, product of:
            3.4159496 = boost
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.023209542 = queryNorm
          0.7162067 = fieldWeight in 7226, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.109375 = fieldNorm(doc=7226)
    0.24 = coord(6/25)

Wien, C.: Sample sizes and composition : their effect on recall and precision in IR experiments with OPACs (2000) 0.20

0.19635026 = sum of:
  0.19635026 = product of:
    0.8181261 = sum of:
      0.07196116 = weight(abstract_txt:recall in 368) [ClassicSimilarity], result of:
        0.07196116 = score(doc=368,freq=1.0), product of:
          0.133474 = queryWeight, product of:
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.023209542 = queryNorm
          0.53913987 = fieldWeight in 368, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
      0.07744421 = weight(abstract_txt:size in 368) [ClassicSimilarity], result of:
        0.07744421 = score(doc=368,freq=1.0), product of:
          0.14017071 = queryWeight, product of:
            1.0247791 = boost
            5.8933253 = idf(docFreq=332, maxDocs=44421)
            0.023209542 = queryNorm
          0.55249923 = fieldWeight in 368, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.8933253 = idf(docFreq=332, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
      0.14905907 = weight(abstract_txt:affected in 368) [ClassicSimilarity], result of:
        0.14905907 = score(doc=368,freq=2.0), product of:
          0.17214467 = queryWeight, product of:
            1.1356603 = boost
            6.5309834 = idf(docFreq=175, maxDocs=44421)
            0.023209542 = queryNorm
          0.8658942 = fieldWeight in 368, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.5309834 = idf(docFreq=175, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
      0.2554572 = weight(abstract_txt:experiments in 368) [ClassicSimilarity], result of:
        0.2554572 = score(doc=368,freq=5.0), product of:
          0.22885656 = queryWeight, product of:
            1.8518181 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.023209542 = queryNorm
          1.1162328 = fieldWeight in 368, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
      0.12652633 = weight(abstract_txt:generated in 368) [ClassicSimilarity], result of:
        0.12652633 = score(doc=368,freq=1.0), product of:
          0.24497883 = queryWeight, product of:
            1.9159356 = boost
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.023209542 = queryNorm
          0.5164786 = fieldWeight in 368, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
      0.13767813 = weight(abstract_txt:retrieval in 368) [ClassicSimilarity], result of:
        0.13767813 = score(doc=368,freq=3.0), product of:
          0.24388824 = queryWeight, product of:
            3.0226097 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.023209542 = queryNorm
          0.5645132 = fieldWeight in 368, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.09375 = fieldNorm(doc=368)
    0.24 = coord(6/25)