Document (#13140)

Author

Pearce, C.
Nicholas, C.

Title

TELLTALE: Experiments in a dynamic hypertext environment for degraded and multilingual data

Source

Journal of the American Society for Information Science. 47(1996) no.4, S.263-275

Year

1996

Abstract

Methods and tools for finding documents relevant to a user's needs in a document corpora can be found in the information retrieval, library science, and hypertext communities. Typically, these systems provide retrieval capabilities for fairly static copora, their algorithms are dependent on the language for which they are written, e.g. English, and they do not perform well when presented with misspelled words or text that has been degraded by OCR techniques. In this article, we present experimentation results for the TELLTALE system. TELLTALE is a dynamic hypertext environment that provides full-text search from a hypertext-style user interface for text corpora that may be garbled by OCR or transmission errors, and that may contain languages other than English. TELLTALE uses several techniques based on n-grams (n character sequences of text). With these results we show that the dynamic linkage mechanisms in TELLTALE are tolerant of garbles in up to 30% of the characters in the body of the texts

Theme

Volltextretrieval
Multilinguale Probleme

Object

TELLTALE
OCR

Similar documents (author)

1. Pearce, T.: Draft IIS guidelines for professional ethics for information professionals (1998) 2.55

   2.5546124 = sum of:
     2.5546124 = product of:
       5.109225 = sum of:
         5.109225 = weight(author_txt:pearce in 3443) [ClassicSimilarity], result of:
           5.109225 = score(doc=3443,freq=1.0), product of:
             0.8379593 = queryWeight, product of:
               1.239143 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.06931854 = queryNorm
             6.0972233 = fieldWeight in 3443, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.625 = fieldNorm(doc=3443)
       0.5 = coord(1/2)
   

2. Pearce, H.J.: Thesaurus of disability index terms (1996) 2.55

   2.5546124 = sum of:
     2.5546124 = product of:
       5.109225 = sum of:
         5.109225 = weight(author_txt:pearce in 4634) [ClassicSimilarity], result of:
           5.109225 = score(doc=4634,freq=1.0), product of:
             0.8379593 = queryWeight, product of:
               1.239143 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.06931854 = queryNorm
             6.0972233 = fieldWeight in 4634, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.625 = fieldNorm(doc=4634)
       0.5 = coord(1/2)
   

3. Calvert, P.J.; Pearce, B.: Expanding the Fiji numbers in the Dewey Decimal Classification (1979) 2.04

   2.04369 = sum of:
     2.04369 = product of:
       4.08738 = sum of:
         4.08738 = weight(author_txt:pearce in 2546) [ClassicSimilarity], result of:
           4.08738 = score(doc=2546,freq=1.0), product of:
             0.8379593 = queryWeight, product of:
               1.239143 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.06931854 = queryNorm
             4.8777785 = fieldWeight in 2546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=2546)
       0.5 = coord(1/2)
   

4. Weibel, S.; Pearce, J.: ¬The changing landscape of networked resource description (1996) 2.04

   2.04369 = sum of:
     2.04369 = product of:
       4.08738 = sum of:
         4.08738 = weight(author_txt:pearce in 5601) [ClassicSimilarity], result of:
           4.08738 = score(doc=5601,freq=1.0), product of:
             0.8379593 = queryWeight, product of:
               1.239143 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.06931854 = queryNorm
             4.8777785 = fieldWeight in 5601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=5601)
       0.5 = coord(1/2)
   

5. Moloney, J.; Pearce, F.: Workshop 3 : Cataloguing standards - can we afford them? (1997) 2.04

   2.04369 = sum of:
     2.04369 = product of:
       4.08738 = sum of:
         4.08738 = weight(author_txt:pearce in 3837) [ClassicSimilarity], result of:
           4.08738 = score(doc=3837,freq=1.0), product of:
             0.8379593 = queryWeight, product of:
               1.239143 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.06931854 = queryNorm
             4.8777785 = fieldWeight in 3837, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=3837)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Intelligent hypertext : Advanced techniques for the World Wide Web (1997) 0.19

   0.19110672 = sum of:
     0.19110672 = product of:
       0.9555336 = sum of:
         0.025738755 = weight(abstract_txt:retrieval in 975) [ClassicSimilarity], result of:
           0.025738755 = score(doc=975,freq=1.0), product of:
             0.067690425 = queryWeight, product of:
               1.0664628 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018257415 = queryNorm
             0.3802422 = fieldWeight in 975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=975)
         0.09876996 = weight(abstract_txt:techniques in 975) [ClassicSimilarity], result of:
           0.09876996 = score(doc=975,freq=3.0), product of:
             0.11503899 = queryWeight, product of:
               1.3902875 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.018257415 = queryNorm
             0.85857815 = fieldWeight in 975, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.109375 = fieldNorm(doc=975)
         0.060929947 = weight(abstract_txt:environment in 975) [ClassicSimilarity], result of:
           0.060929947 = score(doc=975,freq=1.0), product of:
             0.12023274 = queryWeight, product of:
               1.4213252 = boost
               4.6332955 = idf(docFreq=1173, maxDocs=44421)
               0.018257415 = queryNorm
             0.5067667 = fieldWeight in 975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6332955 = idf(docFreq=1173, maxDocs=44421)
               0.109375 = fieldNorm(doc=975)
         0.17595778 = weight(abstract_txt:dynamic in 975) [ClassicSimilarity], result of:
           0.17595778 = score(doc=975,freq=1.0), product of:
             0.27910757 = queryWeight, product of:
               2.6522443 = boost
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.018257415 = queryNorm
             0.63043 = fieldWeight in 975, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.109375 = fieldNorm(doc=975)
         0.5941372 = weight(abstract_txt:hypertext in 975) [ClassicSimilarity], result of:
           0.5941372 = score(doc=975,freq=7.0), product of:
             0.36144096 = queryWeight, product of:
               3.485104 = boost
               5.6804442 = idf(docFreq=411, maxDocs=44421)
               0.018257415 = queryNorm
             1.6438015 = fieldWeight in 975, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.6804442 = idf(docFreq=411, maxDocs=44421)
               0.109375 = fieldNorm(doc=975)
       0.2 = coord(5/25)
   

2. Tagheva, K.; Borsack, J.; Condit, A.: Effects of OCR errors on ranking and feedback using the vector space model (1996) 0.16

   0.15605584 = sum of:
     0.15605584 = product of:
       0.78027916 = sum of:
         0.08488099 = weight(abstract_txt:character in 5019) [ClassicSimilarity], result of:
           0.08488099 = score(doc=5019,freq=1.0), product of:
             0.11903258 = queryWeight, product of:
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.018257415 = queryNorm
             0.7130904 = fieldWeight in 5019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.109375 = fieldNorm(doc=5019)
         0.1216205 = weight(abstract_txt:errors in 5019) [ClassicSimilarity], result of:
           0.1216205 = score(doc=5019,freq=2.0), product of:
             0.12007522 = queryWeight, product of:
               1.0043701 = boost
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.018257415 = queryNorm
             1.0128692 = fieldWeight in 5019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.109375 = fieldNorm(doc=5019)
         0.025738755 = weight(abstract_txt:retrieval in 5019) [ClassicSimilarity], result of:
           0.025738755 = score(doc=5019,freq=1.0), product of:
             0.067690425 = queryWeight, product of:
               1.0664628 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018257415 = queryNorm
             0.3802422 = fieldWeight in 5019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=5019)
         0.0808387 = weight(abstract_txt:text in 5019) [ClassicSimilarity], result of:
           0.0808387 = score(doc=5019,freq=1.0), product of:
             0.1829048 = queryWeight, product of:
               2.479189 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.018257415 = queryNorm
             0.44197148 = fieldWeight in 5019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.109375 = fieldNorm(doc=5019)
         0.4672002 = weight(abstract_txt:degraded in 5019) [ClassicSimilarity], result of:
           0.4672002 = score(doc=5019,freq=1.0), product of:
             0.46752432 = queryWeight, product of:
               2.802749 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.018257415 = queryNorm
             0.9993067 = fieldWeight in 5019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.109375 = fieldNorm(doc=5019)
       0.2 = coord(5/25)
   

3. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.15

   0.15009038 = sum of:
     0.15009038 = product of:
       0.5360371 = sum of:
         0.11880864 = weight(abstract_txt:character in 206) [ClassicSimilarity], result of:
           0.11880864 = score(doc=206,freq=6.0), product of:
             0.11903258 = queryWeight, product of:
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.018257415 = queryNorm
             0.9981187 = fieldWeight in 206, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.020838588 = weight(abstract_txt:results in 206) [ClassicSimilarity], result of:
           0.020838588 = score(doc=206,freq=2.0), product of:
             0.067774 = queryWeight, product of:
               1.0671209 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.018257415 = queryNorm
             0.30747172 = fieldWeight in 206, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.12204635 = weight(abstract_txt:characters in 206) [ClassicSimilarity], result of:
           0.12204635 = score(doc=206,freq=3.0), product of:
             0.15268406 = queryWeight, product of:
               1.132567 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.018257415 = queryNorm
             0.7993392 = fieldWeight in 206, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.018426852 = weight(abstract_txt:they in 206) [ClassicSimilarity], result of:
           0.018426852 = score(doc=206,freq=1.0), product of:
             0.07866744 = queryWeight, product of:
               1.1496869 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.018257415 = queryNorm
             0.23423736 = fieldWeight in 206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.19335355 = weight(abstract_txt:grams in 206) [ClassicSimilarity], result of:
           0.19335355 = score(doc=206,freq=4.0), product of:
             0.18852358 = queryWeight, product of:
               1.2584904 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.018257415 = queryNorm
             1.02562 = fieldWeight in 206, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.016369503 = weight(abstract_txt:that in 206) [ClassicSimilarity], result of:
           0.016369503 = score(doc=206,freq=2.0), product of:
             0.07831072 = queryWeight, product of:
               1.8136885 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018257415 = queryNorm
             0.20903271 = fieldWeight in 206, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.046193544 = weight(abstract_txt:text in 206) [ClassicSimilarity], result of:
           0.046193544 = score(doc=206,freq=1.0), product of:
             0.1829048 = queryWeight, product of:
               2.479189 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.018257415 = queryNorm
             0.25255513 = fieldWeight in 206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
       0.28 = coord(7/25)
   

4. Robertson, A.M.; Willett, P.: Applications of n-grams in textual information systems (1998) 0.15

   0.14613378 = sum of:
     0.14613378 = product of:
       0.6088908 = sum of:
         0.08599868 = weight(abstract_txt:errors in 5715) [ClassicSimilarity], result of:
           0.08599868 = score(doc=5715,freq=1.0), product of:
             0.12007522 = queryWeight, product of:
               1.0043701 = boost
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.018257415 = queryNorm
             0.7162067 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.025738755 = weight(abstract_txt:retrieval in 5715) [ClassicSimilarity], result of:
           0.025738755 = score(doc=5715,freq=1.0), product of:
             0.067690425 = queryWeight, product of:
               1.0664628 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018257415 = queryNorm
             0.3802422 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.12331112 = weight(abstract_txt:characters in 5715) [ClassicSimilarity], result of:
           0.12331112 = score(doc=5715,freq=1.0), product of:
             0.15268406 = queryWeight, product of:
               1.132567 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.018257415 = queryNorm
             0.80762273 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.2392628 = weight(abstract_txt:grams in 5715) [ClassicSimilarity], result of:
           0.2392628 = score(doc=5715,freq=2.0), product of:
             0.18852358 = queryWeight, product of:
               1.2584904 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.018257415 = queryNorm
             1.26914 = fieldWeight in 5715, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.020256225 = weight(abstract_txt:that in 5715) [ClassicSimilarity], result of:
           0.020256225 = score(doc=5715,freq=1.0), product of:
             0.07831072 = queryWeight, product of:
               1.8136885 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018257415 = queryNorm
             0.2586648 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.11432319 = weight(abstract_txt:text in 5715) [ClassicSimilarity], result of:
           0.11432319 = score(doc=5715,freq=2.0), product of:
             0.1829048 = queryWeight, product of:
               2.479189 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.018257415 = queryNorm
             0.6250421 = fieldWeight in 5715, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
       0.24 = coord(6/25)
   

5. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.14

   0.13737279 = sum of:
     0.13737279 = product of:
       0.4906171 = sum of:
         0.06949743 = weight(abstract_txt:errors in 5580) [ClassicSimilarity], result of:
           0.06949743 = score(doc=5580,freq=2.0), product of:
             0.12007522 = queryWeight, product of:
               1.0043701 = boost
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.018257415 = queryNorm
             0.57878244 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.014707861 = weight(abstract_txt:retrieval in 5580) [ClassicSimilarity], result of:
           0.014707861 = score(doc=5580,freq=1.0), product of:
             0.067690425 = queryWeight, product of:
               1.0664628 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018257415 = queryNorm
             0.21728125 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.0704635 = weight(abstract_txt:characters in 5580) [ClassicSimilarity], result of:
           0.0704635 = score(doc=5580,freq=1.0), product of:
             0.15268406 = queryWeight, product of:
               1.132567 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.018257415 = queryNorm
             0.4614987 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.1367216 = weight(abstract_txt:grams in 5580) [ClassicSimilarity], result of:
           0.1367216 = score(doc=5580,freq=2.0), product of:
             0.18852358 = queryWeight, product of:
               1.2584904 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.018257415 = queryNorm
             0.7252228 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.060640603 = weight(abstract_txt:english in 5580) [ClassicSimilarity], result of:
           0.060640603 = score(doc=5580,freq=1.0), product of:
             0.17404835 = queryWeight, product of:
               1.7100824 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018257415 = queryNorm
             0.3484124 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.016369503 = weight(abstract_txt:that in 5580) [ClassicSimilarity], result of:
           0.016369503 = score(doc=5580,freq=2.0), product of:
             0.07831072 = queryWeight, product of:
               1.8136885 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.018257415 = queryNorm
             0.20903271 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.12221663 = weight(abstract_txt:text in 5580) [ClassicSimilarity], result of:
           0.12221663 = score(doc=5580,freq=7.0), product of:
             0.1829048 = queryWeight, product of:
               2.479189 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.018257415 = queryNorm
             0.66819805 = fieldWeight in 5580, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
       0.28 = coord(7/25)