Document (#16043)

Author

Kelledy, F.
Smeaton, A.F.

Title

Signature files and beyond

Source

Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon

Imprint

London : Taylor Graham

Year

1996

Pages

S.124-144

Abstract

Proposes that signature files be used as a viable alternative to other indexing strategies such as inverted files for searching through large volumes of text. Demonstrates through simulation, that search times can be further reduced by enhancing the basic signature file concept using deterministic partitioning algorithms which eliminate the need for an exhaustive search of the entire signature file. Reports research to evaluate the performance of some deterministic partitioning algorithms in a non simulated environment using 276 MB of raw newspaper text (taken from the Wall Street Journal) and real user queries. Presents a selection of results to illustrate trends and highlight important aspects of the performance of these methods under realistic rather than simulated operating conditions. As a result of the research reported here certain aspects of this approach to signature files are shown to be found wanting and require improvement. Suggests lines of future research on the partitioning of signature files

Theme

Retrievalalgorithmen

Similar documents (author)

1. Smeaton, A.F.: Prospects for intelligent, language-based information retrieval (1991) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:smeaton in 3700) [ClassicSimilarity], result of:
       5.378652 = score(doc=3700,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 3700, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=3700)
   

2. Smeaton, A.F.: Retrieving information from hypertext : issues and problems (1991) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:smeaton in 4278) [ClassicSimilarity], result of:
       5.378652 = score(doc=4278,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 4278, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=4278)
   

3. Smeaton, A.F.: Progress in the application of natural language processing to information retrieval tasks (1992) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:smeaton in 7080) [ClassicSimilarity], result of:
       5.378652 = score(doc=7080,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 7080, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=7080)
   

4. Smeaton, A.F.: Information retrieval and hypertext : competing technologies or complementary access methods (1992) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:smeaton in 7503) [ClassicSimilarity], result of:
       5.378652 = score(doc=7503,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 7503, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=7503)
   

5. Smeaton, A.F.: Natural language processing used in information retrieval tasks : an overview of achievements to date (1995) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:smeaton in 1265) [ClassicSimilarity], result of:
       5.378652 = score(doc=1265,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 1265, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=1265)
   

Similar documents (content)

1. Lam, W.; Wong, K.-F.; Wong, C.-Y.: Chinese document indexing based on new partitioned signature file : model and evaluation (2001) 0.44

   0.43969056 = sum of:
     0.43969056 = product of:
       1.5703235 = sum of:
         0.014118734 = weight(abstract_txt:search in 303) [ClassicSimilarity], result of:
           0.014118734 = score(doc=303,freq=2.0), product of:
             0.043666743 = queryWeight, product of:
               1.0316408 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.011571039 = queryNorm
             0.3233292 = fieldWeight in 303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         0.013487188 = weight(abstract_txt:text in 303) [ClassicSimilarity], result of:
           0.013487188 = score(doc=303,freq=1.0), product of:
             0.05336353 = queryWeight, product of:
               1.1404477 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.011571039 = queryNorm
             0.25274166 = fieldWeight in 303, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         0.020248467 = weight(abstract_txt:performance in 303) [ClassicSimilarity], result of:
           0.020248467 = score(doc=303,freq=1.0), product of:
             0.069966756 = queryWeight, product of:
               1.3058671 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.011571039 = queryNorm
             0.28940126 = fieldWeight in 303, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         0.07918374 = weight(abstract_txt:file in 303) [ClassicSimilarity], result of:
           0.07918374 = score(doc=303,freq=5.0), product of:
             0.10156194 = queryWeight, product of:
               1.5733256 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.011571039 = queryNorm
             0.7796596 = fieldWeight in 303, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         0.30751017 = weight(abstract_txt:partitioning in 303) [ClassicSimilarity], result of:
           0.30751017 = score(doc=303,freq=2.0), product of:
             0.38984358 = queryWeight, product of:
               3.7752345 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.011571039 = queryNorm
             0.788804 = fieldWeight in 303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         0.13498834 = weight(abstract_txt:files in 303) [ClassicSimilarity], result of:
           0.13498834 = score(doc=303,freq=2.0), product of:
             0.26697123 = queryWeight, product of:
               4.033252 = boost
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.011571039 = queryNorm
             0.50562876 = fieldWeight in 303, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
         1.0007868 = weight(abstract_txt:signature in 303) [ClassicSimilarity], result of:
           1.0007868 = score(doc=303,freq=7.0), product of:
             0.7104482 = queryWeight, product of:
               7.207422 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.011571039 = queryNorm
             1.4086696 = fieldWeight in 303, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.0625 = fieldNorm(doc=303)
       0.28 = coord(7/25)
   

2. Lee, D.L.; Ren, L.: Document ranking on weight-partitioned signature files (1996) 0.31

   0.31269795 = sum of:
     0.31269795 = product of:
       1.5634897 = sum of:
         0.014975178 = weight(abstract_txt:search in 2417) [ClassicSimilarity], result of:
           0.014975178 = score(doc=2417,freq=1.0), product of:
             0.043666743 = queryWeight, product of:
               1.0316408 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.011571039 = queryNorm
             0.34294242 = fieldWeight in 2417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.09375 = fieldNorm(doc=2417)
         0.0303727 = weight(abstract_txt:performance in 2417) [ClassicSimilarity], result of:
           0.0303727 = score(doc=2417,freq=1.0), product of:
             0.069966756 = queryWeight, product of:
               1.3058671 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.011571039 = queryNorm
             0.43410188 = fieldWeight in 2417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.09375 = fieldNorm(doc=2417)
         0.10623614 = weight(abstract_txt:file in 2417) [ClassicSimilarity], result of:
           0.10623614 = score(doc=2417,freq=4.0), product of:
             0.10156194 = queryWeight, product of:
               1.5733256 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.011571039 = queryNorm
             1.0460231 = fieldWeight in 2417, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.09375 = fieldNorm(doc=2417)
         0.14317675 = weight(abstract_txt:files in 2417) [ClassicSimilarity], result of:
           0.14317675 = score(doc=2417,freq=1.0), product of:
             0.26697123 = queryWeight, product of:
               4.033252 = boost
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.011571039 = queryNorm
             0.5363003 = fieldWeight in 2417, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.09375 = fieldNorm(doc=2417)
         1.2687289 = weight(abstract_txt:signature in 2417) [ClassicSimilarity], result of:
           1.2687289 = score(doc=2417,freq=5.0), product of:
             0.7104482 = queryWeight, product of:
               7.207422 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.011571039 = queryNorm
             1.7858148 = fieldWeight in 2417, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.09375 = fieldNorm(doc=2417)
       0.2 = coord(5/25)
   

3. Carterette, B.; Can, F.: Comparing inverted files and signature files for searching a large lexicon (2005) 0.25

   0.24848895 = sum of:
     0.24848895 = product of:
       1.553056 = sum of:
         0.099682406 = weight(abstract_txt:inverted in 1029) [ClassicSimilarity], result of:
           0.099682406 = score(doc=1029,freq=3.0), product of:
             0.09602527 = queryWeight, product of:
               1.0817599 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.011571039 = queryNorm
             1.0380851 = fieldWeight in 1029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.078125 = fieldNorm(doc=1029)
         0.08853012 = weight(abstract_txt:file in 1029) [ClassicSimilarity], result of:
           0.08853012 = score(doc=1029,freq=4.0), product of:
             0.10156194 = queryWeight, product of:
               1.5733256 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.011571039 = queryNorm
             0.871686 = fieldWeight in 1029, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.078125 = fieldNorm(doc=1029)
         0.20665783 = weight(abstract_txt:files in 1029) [ClassicSimilarity], result of:
           0.20665783 = score(doc=1029,freq=3.0), product of:
             0.26697123 = queryWeight, product of:
               4.033252 = boost
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.011571039 = queryNorm
             0.7740828 = fieldWeight in 1029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.078125 = fieldNorm(doc=1029)
         1.1581856 = weight(abstract_txt:signature in 1029) [ClassicSimilarity], result of:
           1.1581856 = score(doc=1029,freq=6.0), product of:
             0.7104482 = queryWeight, product of:
               7.207422 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.011571039 = queryNorm
             1.6302183 = fieldWeight in 1029, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.078125 = fieldNorm(doc=1029)
       0.16 = coord(4/25)
   

4. MacFarlane, A.; McCann, J.A.; Robertson, S.E.: Parallel methods for the update of partitioned inverted files (2007) 0.15

   0.15146407 = sum of:
     0.15146407 = product of:
       0.75732034 = sum of:
         0.11277777 = weight(abstract_txt:inverted in 819) [ClassicSimilarity], result of:
           0.11277777 = score(doc=819,freq=6.0), product of:
             0.09602527 = queryWeight, product of:
               1.0817599 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.011571039 = queryNorm
             1.1744592 = fieldWeight in 819, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.0625 = fieldNorm(doc=819)
         0.019073764 = weight(abstract_txt:text in 819) [ClassicSimilarity], result of:
           0.019073764 = score(doc=819,freq=2.0), product of:
             0.05336353 = queryWeight, product of:
               1.1404477 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.011571039 = queryNorm
             0.3574307 = fieldWeight in 819, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=819)
         0.035412047 = weight(abstract_txt:file in 819) [ClassicSimilarity], result of:
           0.035412047 = score(doc=819,freq=1.0), product of:
             0.10156194 = queryWeight, product of:
               1.5733256 = boost
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.011571039 = queryNorm
             0.3486744 = fieldWeight in 819, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.57879 = idf(docFreq=453, maxDocs=44218)
               0.0625 = fieldNorm(doc=819)
         0.37662148 = weight(abstract_txt:partitioning in 819) [ClassicSimilarity], result of:
           0.37662148 = score(doc=819,freq=3.0), product of:
             0.38984358 = queryWeight, product of:
               3.7752345 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.011571039 = queryNorm
             0.9660836 = fieldWeight in 819, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.0625 = fieldNorm(doc=819)
         0.21343528 = weight(abstract_txt:files in 819) [ClassicSimilarity], result of:
           0.21343528 = score(doc=819,freq=5.0), product of:
             0.26697123 = queryWeight, product of:
               4.033252 = boost
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.011571039 = queryNorm
             0.79946923 = fieldWeight in 819, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.0625 = fieldNorm(doc=819)
       0.2 = coord(5/25)
   

5. Robertson, A.M.; Willett, P.: Applications of n-grams in textual information systems (1998) 0.15

   0.15087187 = sum of:
     0.15087187 = product of:
       0.94294924 = sum of:
         0.08057233 = weight(abstract_txt:inverted in 4715) [ClassicSimilarity], result of:
           0.08057233 = score(doc=4715,freq=1.0), product of:
             0.09602527 = queryWeight, product of:
               1.0817599 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.011571039 = queryNorm
             0.8390742 = fieldWeight in 4715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.109375 = fieldNorm(doc=4715)
         0.03337909 = weight(abstract_txt:text in 4715) [ClassicSimilarity], result of:
           0.03337909 = score(doc=4715,freq=2.0), product of:
             0.05336353 = queryWeight, product of:
               1.1404477 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.011571039 = queryNorm
             0.6255037 = fieldWeight in 4715, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.109375 = fieldNorm(doc=4715)
         0.16703954 = weight(abstract_txt:files in 4715) [ClassicSimilarity], result of:
           0.16703954 = score(doc=4715,freq=1.0), product of:
             0.26697123 = queryWeight, product of:
               4.033252 = boost
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.011571039 = queryNorm
             0.62568367 = fieldWeight in 4715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.720536 = idf(docFreq=393, maxDocs=44218)
               0.109375 = fieldNorm(doc=4715)
         0.6619583 = weight(abstract_txt:signature in 4715) [ClassicSimilarity], result of:
           0.6619583 = score(doc=4715,freq=1.0), product of:
             0.7104482 = queryWeight, product of:
               7.207422 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.011571039 = queryNorm
             0.9317474 = fieldWeight in 4715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.109375 = fieldNorm(doc=4715)
       0.16 = coord(4/25)