Document (#16043)

Author

Kelledy, F.
Smeaton, A.F.

Title

Signature files and beyond

Source

Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon

Imprint

London : Taylor Graham

Year

1996

Pages

S.124-144

Abstract

Proposes that signature files be used as a viable alternative to other indexing strategies such as inverted files for searching through large volumes of text. Demonstrates through simulation, that search times can be further reduced by enhancing the basic signature file concept using deterministic partitioning algorithms which eliminate the need for an exhaustive search of the entire signature file. Reports research to evaluate the performance of some deterministic partitioning algorithms in a non simulated environment using 276 MB of raw newspaper text (taken from the Wall Street Journal) and real user queries. Presents a selection of results to illustrate trends and highlight important aspects of the performance of these methods under realistic rather than simulated operating conditions. As a result of the research reported here certain aspects of this approach to signature files are shown to be found wanting and require improvement. Suggests lines of future research on the partitioning of signature files

Theme

Retrievalalgorithmen

Similar documents (author)

1. Smeaton, A.F.: Prospects for intelligent, language-based information retrieval (1991) 5.38

   5.3815155 = sum of:
     5.3815155 = weight(author_txt:smeaton in 3699) [ClassicSimilarity], result of:
       5.3815155 = fieldWeight in 3699, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.625 = fieldNorm(doc=3699)
   

2. Smeaton, A.F.: Retrieving information from hypertext : issues and problems (1991) 5.38

   5.3815155 = sum of:
     5.3815155 = weight(author_txt:smeaton in 4277) [ClassicSimilarity], result of:
       5.3815155 = fieldWeight in 4277, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.625 = fieldNorm(doc=4277)
   

3. Smeaton, A.F.: Progress in the application of natural language processing to information retrieval tasks (1992) 5.38

   5.3815155 = sum of:
     5.3815155 = weight(author_txt:smeaton in 7079) [ClassicSimilarity], result of:
       5.3815155 = fieldWeight in 7079, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.625 = fieldNorm(doc=7079)
   

4. Smeaton, A.F.: Information retrieval and hypertext : competing technologies or complementary access methods (1992) 5.38

   5.3815155 = sum of:
     5.3815155 = weight(author_txt:smeaton in 7502) [ClassicSimilarity], result of:
       5.3815155 = fieldWeight in 7502, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.625 = fieldNorm(doc=7502)
   

5. Smeaton, A.F.: Natural language processing used in information retrieval tasks : an overview of achievements to date (1995) 5.38

   5.3815155 = sum of:
     5.3815155 = weight(author_txt:smeaton in 1333) [ClassicSimilarity], result of:
       5.3815155 = fieldWeight in 1333, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.625 = fieldNorm(doc=1333)
   

Similar documents (content)

1. Lam, W.; Wong, K.-F.; Wong, C.-Y.: Chinese document indexing based on new partitioned signature file : model and evaluation (2001) 0.44

   0.44030234 = sum of:
     0.44030234 = product of:
       1.5725083 = sum of:
         0.014076855 = weight(abstract_txt:search in 1303) [ClassicSimilarity], result of:
           0.014076855 = score(doc=1303,freq=2.0), product of:
             0.04357837 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.011576935 = queryNorm
             0.3230239 = fieldWeight in 1303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         0.013455516 = weight(abstract_txt:text in 1303) [ClassicSimilarity], result of:
           0.013455516 = score(doc=1303,freq=1.0), product of:
             0.053277537 = queryWeight, product of:
               1.1388706 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.011576935 = queryNorm
             0.25255513 = fieldWeight in 1303, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         0.02010619 = weight(abstract_txt:performance in 1303) [ClassicSimilarity], result of:
           0.02010619 = score(doc=1303,freq=1.0), product of:
             0.06963546 = queryWeight, product of:
               1.3020196 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.011576935 = queryNorm
             0.28873494 = fieldWeight in 1303, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         0.07936812 = weight(abstract_txt:file in 1303) [ClassicSimilarity], result of:
           0.07936812 = score(doc=1303,freq=5.0), product of:
             0.10171492 = queryWeight, product of:
               1.573601 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.011576935 = queryNorm
             0.7802997 = fieldWeight in 1303, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         0.3079419 = weight(abstract_txt:partitioning in 1303) [ClassicSimilarity], result of:
           0.3079419 = score(doc=1303,freq=2.0), product of:
             0.39019066 = queryWeight, product of:
               3.7747343 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.011576935 = queryNorm
             0.7892088 = fieldWeight in 1303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         0.1352944 = weight(abstract_txt:files in 1303) [ClassicSimilarity], result of:
           0.1352944 = score(doc=1303,freq=2.0), product of:
             0.26736248 = queryWeight, product of:
               4.033876 = boost
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.011576935 = queryNorm
             0.5060336 = fieldWeight in 1303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
         1.0022653 = weight(abstract_txt:signature in 1303) [ClassicSimilarity], result of:
           1.0022653 = score(doc=1303,freq=7.0), product of:
             0.7111155 = queryWeight, product of:
               7.2066426 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.011576935 = queryNorm
             1.409427 = fieldWeight in 1303, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=1303)
       0.28 = coord(7/25)
   

2. Lee, D.L.; Ren, L.: Document ranking on weight-partitioned signature files (1996) 0.31

   0.31313565 = sum of:
     0.31313565 = product of:
       1.5656782 = sum of:
         0.014930759 = weight(abstract_txt:search in 3417) [ClassicSimilarity], result of:
           0.014930759 = score(doc=3417,freq=1.0), product of:
             0.04357837 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.011576935 = queryNorm
             0.34261855 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.09375 = fieldNorm(doc=3417)
         0.030159285 = weight(abstract_txt:performance in 3417) [ClassicSimilarity], result of:
           0.030159285 = score(doc=3417,freq=1.0), product of:
             0.06963546 = queryWeight, product of:
               1.3020196 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.011576935 = queryNorm
             0.43310243 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.09375 = fieldNorm(doc=3417)
         0.106483504 = weight(abstract_txt:file in 3417) [ClassicSimilarity], result of:
           0.106483504 = score(doc=3417,freq=4.0), product of:
             0.10171492 = queryWeight, product of:
               1.573601 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.011576935 = queryNorm
             1.0468819 = fieldWeight in 3417, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.09375 = fieldNorm(doc=3417)
         0.14350139 = weight(abstract_txt:files in 3417) [ClassicSimilarity], result of:
           0.14350139 = score(doc=3417,freq=1.0), product of:
             0.26736248 = queryWeight, product of:
               4.033876 = boost
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.011576935 = queryNorm
             0.5367297 = fieldWeight in 3417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.09375 = fieldNorm(doc=3417)
         1.2706033 = weight(abstract_txt:signature in 3417) [ClassicSimilarity], result of:
           1.2706033 = score(doc=3417,freq=5.0), product of:
             0.7111155 = queryWeight, product of:
               7.2066426 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.011576935 = queryNorm
             1.786775 = fieldWeight in 3417, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.09375 = fieldNorm(doc=3417)
       0.2 = coord(5/25)
   

3. Carterette, B.; Can, F.: Comparing inverted files and signature files for searching a large lexicon (2005) 0.25

   0.2488971 = sum of:
     0.2488971 = product of:
       1.555607 = sum of:
         0.099847466 = weight(abstract_txt:inverted in 2029) [ClassicSimilarity], result of:
           0.099847466 = score(doc=2029,freq=3.0), product of:
             0.096126884 = queryWeight, product of:
               1.0817072 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.011576935 = queryNorm
             1.0387049 = fieldWeight in 2029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.078125 = fieldNorm(doc=2029)
         0.08873626 = weight(abstract_txt:file in 2029) [ClassicSimilarity], result of:
           0.08873626 = score(doc=2029,freq=4.0), product of:
             0.10171492 = queryWeight, product of:
               1.573601 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.011576935 = queryNorm
             0.8724016 = fieldWeight in 2029, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.078125 = fieldNorm(doc=2029)
         0.2071264 = weight(abstract_txt:files in 2029) [ClassicSimilarity], result of:
           0.2071264 = score(doc=2029,freq=3.0), product of:
             0.26736248 = queryWeight, product of:
               4.033876 = boost
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.011576935 = queryNorm
             0.77470255 = fieldWeight in 2029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.078125 = fieldNorm(doc=2029)
         1.1598969 = weight(abstract_txt:signature in 2029) [ClassicSimilarity], result of:
           1.1598969 = score(doc=2029,freq=6.0), product of:
             0.7111155 = queryWeight, product of:
               7.2066426 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.011576935 = queryNorm
             1.6310949 = fieldWeight in 2029, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.078125 = fieldNorm(doc=2029)
       0.16 = coord(4/25)
   

4. MacFarlane, A.; McCann, J.A.; Robertson, S.E.: Parallel methods for the update of partitioned inverted files (2007) 0.15

   0.15171151 = sum of:
     0.15171151 = product of:
       0.7585575 = sum of:
         0.11296452 = weight(abstract_txt:inverted in 1819) [ClassicSimilarity], result of:
           0.11296452 = score(doc=1819,freq=6.0), product of:
             0.096126884 = queryWeight, product of:
               1.0817072 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.011576935 = queryNorm
             1.1751605 = fieldWeight in 1819, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.0625 = fieldNorm(doc=1819)
         0.019028973 = weight(abstract_txt:text in 1819) [ClassicSimilarity], result of:
           0.019028973 = score(doc=1819,freq=2.0), product of:
             0.053277537 = queryWeight, product of:
               1.1388706 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.011576935 = queryNorm
             0.3571669 = fieldWeight in 1819, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=1819)
         0.035494503 = weight(abstract_txt:file in 1819) [ClassicSimilarity], result of:
           0.035494503 = score(doc=1819,freq=1.0), product of:
             0.10171492 = queryWeight, product of:
               1.573601 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.011576935 = queryNorm
             0.34896064 = fieldWeight in 1819, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.0625 = fieldNorm(doc=1819)
         0.37715027 = weight(abstract_txt:partitioning in 1819) [ClassicSimilarity], result of:
           0.37715027 = score(doc=1819,freq=3.0), product of:
             0.39019066 = queryWeight, product of:
               3.7747343 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.011576935 = queryNorm
             0.96657944 = fieldWeight in 1819, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.0625 = fieldNorm(doc=1819)
         0.21391922 = weight(abstract_txt:files in 1819) [ClassicSimilarity], result of:
           0.21391922 = score(doc=1819,freq=5.0), product of:
             0.26736248 = queryWeight, product of:
               4.033876 = boost
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.011576935 = queryNorm
             0.8001094 = fieldWeight in 1819, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.0625 = fieldNorm(doc=1819)
       0.2 = coord(5/25)
   

5. Robertson, A.M.; Willett, P.: Applications of n-grams in textual information systems (1998) 0.15

   0.15109774 = sum of:
     0.15109774 = product of:
       0.9443609 = sum of:
         0.08070575 = weight(abstract_txt:inverted in 5715) [ClassicSimilarity], result of:
           0.08070575 = score(doc=5715,freq=1.0), product of:
             0.096126884 = queryWeight, product of:
               1.0817072 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.011576935 = queryNorm
             0.8395752 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.0333007 = weight(abstract_txt:text in 5715) [ClassicSimilarity], result of:
           0.0333007 = score(doc=5715,freq=2.0), product of:
             0.053277537 = queryWeight, product of:
               1.1388706 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.011576935 = queryNorm
             0.6250421 = fieldWeight in 5715, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.16741827 = weight(abstract_txt:files in 5715) [ClassicSimilarity], result of:
           0.16741827 = score(doc=5715,freq=1.0), product of:
             0.26736248 = queryWeight, product of:
               4.033876 = boost
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.011576935 = queryNorm
             0.62618464 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7251167 = idf(docFreq=393, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.6629362 = weight(abstract_txt:signature in 5715) [ClassicSimilarity], result of:
           0.6629362 = score(doc=5715,freq=1.0), product of:
             0.7111155 = queryWeight, product of:
               7.2066426 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.011576935 = queryNorm
             0.93224835 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
       0.16 = coord(4/25)