Document (#17779)

Author

Selberg, E.
Etzioni, O.

Title

¬The MetaCrawler architecture for resource aggregation on the Web

Source

IEEE expert. 12(1997) no.1, S.11-14

Year

1997

Abstract

2nd part of a 2 part section on search engines for the WWW. The MetaCrawler Softbot ia a parallel WWW search service which has been available since 1994. It provides a single interface search service. Describes the advantages of this type of system, how it operates, its architectural design and future development plans

Theme

Suchmaschinen

Object

MetaCrawler

Similar documents (author)

1. Etzioni, A.: ¬The First Amendment is not an absolute even on the Internet (1997) 6.10

   6.0972233 = sum of:
     6.0972233 = weight(author_txt:etzioni in 2580) [ClassicSimilarity], result of:
       6.0972233 = fieldWeight in 2580, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.625 = fieldNorm(doc=2580)
   

2. Etzioni, O.; Weld, D.S.: Intelligent agents on the Internet : fact, fiction, and forecast (1995) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:etzioni in 2947) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 2947, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=2947)
   

3. Sugiura, A.; Etzioni, O.: Query routing for Web search engines : architecture and experiments (2000) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:etzioni in 5077) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 5077, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=5077)
   

4. Zamir, O.; Etzioni, O.: Grouper : a dynamic clustering interface to Web search results (1999) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:etzioni in 207) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 207, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=207)
   

5. Shakes, J.; Langheinrich, M.; Etzioni, O.: Dynamic Reference Sifting : a case study in the homepage domain (1997) 3.66

   3.6583338 = sum of:
     3.6583338 = weight(author_txt:etzioni in 3677) [ClassicSimilarity], result of:
       3.6583338 = fieldWeight in 3677, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.375 = fieldNorm(doc=3677)
   

Similar documents (content)

1. Lin, Z.; Baoming, Z.: Comparative study of WWW search tools (1998) 0.22

   0.2199885 = sum of:
     0.2199885 = product of:
       1.3749281 = sum of:
         0.034462288 = weight(abstract_txt:development in 4558) [ClassicSimilarity], result of:
           0.034462288 = score(doc=4558,freq=1.0), product of:
             0.057354465 = queryWeight, product of:
               1.004615 = boost
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.014846045 = queryNorm
             0.60086495 = fieldWeight in 4558, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.15625 = fieldNorm(doc=4558)
         0.08969212 = weight(abstract_txt:engines in 4558) [ClassicSimilarity], result of:
           0.08969212 = score(doc=4558,freq=1.0), product of:
             0.1085194 = queryWeight, product of:
               1.381878 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.014846045 = queryNorm
             0.82650775 = fieldWeight in 4558, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.15625 = fieldNorm(doc=4558)
         0.12549567 = weight(abstract_txt:search in 4558) [ClassicSimilarity], result of:
           0.12549567 = score(doc=4558,freq=2.0), product of:
             0.1554011 = queryWeight, product of:
               2.8642023 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014846045 = queryNorm
             0.8075597 = fieldWeight in 4558, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.15625 = fieldNorm(doc=4558)
         1.125278 = weight(abstract_txt:metacrawler in 4558) [ClassicSimilarity], result of:
           1.125278 = score(doc=4558,freq=1.0), product of:
             0.73822325 = queryWeight, product of:
               5.0971203 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.014846045 = queryNorm
             1.5243058 = fieldWeight in 4558, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.15625 = fieldNorm(doc=4558)
       0.16 = coord(4/25)
   

2. Lowery, J.: Online bibliographic services from The British Library's National Bibliographic Service (1997) 0.21

   0.21088457 = sum of:
     0.21088457 = product of:
       0.58579046 = sum of:
         0.02379267 = weight(abstract_txt:describes in 3817) [ClassicSimilarity], result of:
           0.02379267 = score(doc=3817,freq=1.0), product of:
             0.056828726 = queryWeight, product of:
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.014846045 = queryNorm
             0.41867328 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.0417833 = weight(abstract_txt:development in 3817) [ClassicSimilarity], result of:
           0.0417833 = score(doc=3817,freq=3.0), product of:
             0.057354465 = queryWeight, product of:
               1.004615 = boost
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.014846045 = queryNorm
             0.72850996 = fieldWeight in 3817, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.03222595 = weight(abstract_txt:future in 3817) [ClassicSimilarity], result of:
           0.03222595 = score(doc=3817,freq=1.0), product of:
             0.06956802 = queryWeight, product of:
               1.1064222 = boost
               4.23524 = idf(docFreq=1747, maxDocs=44421)
               0.014846045 = queryNorm
             0.46322936 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.23524 = idf(docFreq=1747, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.033833396 = weight(abstract_txt:available in 3817) [ClassicSimilarity], result of:
           0.033833396 = score(doc=3817,freq=1.0), product of:
             0.07186259 = queryWeight, product of:
               1.1245208 = boost
               4.304519 = idf(docFreq=1630, maxDocs=44421)
               0.014846045 = queryNorm
             0.47080678 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.304519 = idf(docFreq=1630, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.049475033 = weight(abstract_txt:since in 3817) [ClassicSimilarity], result of:
           0.049475033 = score(doc=3817,freq=1.0), product of:
             0.09258271 = queryWeight, product of:
               1.2763829 = boost
               4.8858275 = idf(docFreq=911, maxDocs=44421)
               0.014846045 = queryNorm
             0.5343874 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8858275 = idf(docFreq=911, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.10444934 = weight(abstract_txt:1994 in 3817) [ClassicSimilarity], result of:
           0.10444934 = score(doc=3817,freq=1.0), product of:
             0.15236187 = queryWeight, product of:
               1.6373978 = boost
               6.2677455 = idf(docFreq=228, maxDocs=44421)
               0.014846045 = queryNorm
             0.68553466 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2677455 = idf(docFreq=228, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.12307167 = weight(abstract_txt:plans in 3817) [ClassicSimilarity], result of:
           0.12307167 = score(doc=3817,freq=1.0), product of:
             0.1699722 = queryWeight, product of:
               1.729438 = boost
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.014846045 = queryNorm
             0.7240694 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.115041964 = weight(abstract_txt:service in 3817) [ClassicSimilarity], result of:
           0.115041964 = score(doc=3817,freq=2.0), product of:
             0.16249625 = queryWeight, product of:
               2.3914027 = boost
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.014846045 = queryNorm
             0.70796686 = fieldWeight in 3817, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
         0.06211718 = weight(abstract_txt:search in 3817) [ClassicSimilarity], result of:
           0.06211718 = score(doc=3817,freq=1.0), product of:
             0.1554011 = queryWeight, product of:
               2.8642023 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014846045 = queryNorm
             0.39972165 = fieldWeight in 3817, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.109375 = fieldNorm(doc=3817)
       0.36 = coord(9/25)
   

3. Cree, J.S.; LeBruin, R.: ¬The search for the best engine (1998) 0.19

   0.18938835 = sum of:
     0.18938835 = product of:
       1.1836772 = sum of:
         0.03621371 = weight(abstract_txt:provides in 5721) [ClassicSimilarity], result of:
           0.03621371 = score(doc=5721,freq=1.0), product of:
             0.0687902 = queryWeight, product of:
               1.1002195 = boost
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.014846045 = queryNorm
             0.5264371 = fieldWeight in 5721, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.125 = fieldNorm(doc=5721)
         0.12428105 = weight(abstract_txt:engines in 5721) [ClassicSimilarity], result of:
           0.12428105 = score(doc=5721,freq=3.0), product of:
             0.1085194 = queryWeight, product of:
               1.381878 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.014846045 = queryNorm
             1.1452427 = fieldWeight in 5721, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.125 = fieldNorm(doc=5721)
         0.122960135 = weight(abstract_txt:search in 5721) [ClassicSimilarity], result of:
           0.122960135 = score(doc=5721,freq=3.0), product of:
             0.1554011 = queryWeight, product of:
               2.8642023 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014846045 = queryNorm
             0.7912437 = fieldWeight in 5721, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.125 = fieldNorm(doc=5721)
         0.90022236 = weight(abstract_txt:metacrawler in 5721) [ClassicSimilarity], result of:
           0.90022236 = score(doc=5721,freq=1.0), product of:
             0.73822325 = queryWeight, product of:
               5.0971203 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.014846045 = queryNorm
             1.2194446 = fieldWeight in 5721, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.125 = fieldNorm(doc=5721)
       0.16 = coord(4/25)
   

4. Heery, R.; Carpenter, L.; Day, M.: Renardus project developments and the wider digital library context (2001) 0.13

   0.13349661 = sum of:
     0.13349661 = product of:
       0.30340138 = sum of:
         0.011938086 = weight(abstract_txt:development in 2219) [ClassicSimilarity], result of:
           0.011938086 = score(doc=2219,freq=3.0), product of:
             0.057354465 = queryWeight, product of:
               1.004615 = boost
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.014846045 = queryNorm
             0.20814571 = fieldWeight in 2219, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.8455355 = idf(docFreq=2580, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.007290846 = weight(abstract_txt:design in 2219) [ClassicSimilarity], result of:
           0.007290846 = score(doc=2219,freq=1.0), product of:
             0.059543792 = queryWeight, product of:
               1.0236094 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.014846045 = queryNorm
             0.122445114 = fieldWeight in 2219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.009053428 = weight(abstract_txt:provides in 2219) [ClassicSimilarity], result of:
           0.009053428 = score(doc=2219,freq=1.0), product of:
             0.0687902 = queryWeight, product of:
               1.1002195 = boost
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.014846045 = queryNorm
             0.13160928 = fieldWeight in 2219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.013021251 = weight(abstract_txt:future in 2219) [ClassicSimilarity], result of:
           0.013021251 = score(doc=2219,freq=2.0), product of:
             0.06956802 = queryWeight, product of:
               1.1064222 = boost
               4.23524 = idf(docFreq=1747, maxDocs=44421)
               0.014846045 = queryNorm
             0.18717293 = fieldWeight in 2219, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.23524 = idf(docFreq=1747, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.019990932 = weight(abstract_txt:since in 2219) [ClassicSimilarity], result of:
           0.019990932 = score(doc=2219,freq=2.0), product of:
             0.09258271 = queryWeight, product of:
               1.2763829 = boost
               4.8858275 = idf(docFreq=911, maxDocs=44421)
               0.014846045 = queryNorm
             0.21592511 = fieldWeight in 2219, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8858275 = idf(docFreq=911, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.021262499 = weight(abstract_txt:resource in 2219) [ClassicSimilarity], result of:
           0.021262499 = score(doc=2219,freq=2.0), product of:
             0.09646817 = queryWeight, product of:
               1.3028909 = boost
               4.987297 = idf(docFreq=823, maxDocs=44421)
               0.014846045 = queryNorm
             0.22040947 = fieldWeight in 2219, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.987297 = idf(docFreq=823, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.017283699 = weight(abstract_txt:single in 2219) [ClassicSimilarity], result of:
           0.017283699 = score(doc=2219,freq=1.0), product of:
             0.105862536 = queryWeight, product of:
               1.3648571 = boost
               5.2244954 = idf(docFreq=649, maxDocs=44421)
               0.014846045 = queryNorm
             0.16326548 = fieldWeight in 2219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2244954 = idf(docFreq=649, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.08901175 = weight(abstract_txt:architectural in 2219) [ClassicSimilarity], result of:
           0.08901175 = score(doc=2219,freq=2.0), product of:
             0.25057596 = queryWeight, product of:
               2.0998378 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.014846045 = queryNorm
             0.3552286 = fieldWeight in 2219, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.073497616 = weight(abstract_txt:service in 2219) [ClassicSimilarity], result of:
           0.073497616 = score(doc=2219,freq=10.0), product of:
             0.16249625 = queryWeight, product of:
               2.3914027 = boost
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.014846045 = queryNorm
             0.45230347 = fieldWeight in 2219, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.023303496 = weight(abstract_txt:part in 2219) [ClassicSimilarity], result of:
           0.023303496 = score(doc=2219,freq=1.0), product of:
             0.16278282 = queryWeight, product of:
               2.3935103 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.014846045 = queryNorm
             0.14315698 = fieldWeight in 2219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
         0.017747767 = weight(abstract_txt:search in 2219) [ClassicSimilarity], result of:
           0.017747767 = score(doc=2219,freq=1.0), product of:
             0.1554011 = queryWeight, product of:
               2.8642023 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014846045 = queryNorm
             0.11420619 = fieldWeight in 2219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.03125 = fieldNorm(doc=2219)
       0.44 = coord(11/25)
   

5. Kennedy, S.D.: Dilemmas abound with Internet ads (1996) 0.13

   0.131112 = sum of:
     0.131112 = product of:
       0.81945 = sum of:
         0.077675655 = weight(abstract_txt:engines in 20) [ClassicSimilarity], result of:
           0.077675655 = score(doc=20,freq=3.0), product of:
             0.1085194 = queryWeight, product of:
               1.381878 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.014846045 = queryNorm
             0.7157767 = fieldWeight in 20, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.078125 = fieldNorm(doc=20)
         0.07992232 = weight(abstract_txt:parallel in 20) [ClassicSimilarity], result of:
           0.07992232 = score(doc=20,freq=1.0), product of:
             0.15951562 = queryWeight, product of:
               1.6753967 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.014846045 = queryNorm
             0.5010313 = fieldWeight in 20, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.078125 = fieldNorm(doc=20)
         0.09921303 = weight(abstract_txt:search in 20) [ClassicSimilarity], result of:
           0.09921303 = score(doc=20,freq=5.0), product of:
             0.1554011 = queryWeight, product of:
               2.8642023 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014846045 = queryNorm
             0.63843197 = fieldWeight in 20, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=20)
         0.562639 = weight(abstract_txt:metacrawler in 20) [ClassicSimilarity], result of:
           0.562639 = score(doc=20,freq=1.0), product of:
             0.73822325 = queryWeight, product of:
               5.0971203 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.014846045 = queryNorm
             0.7621529 = fieldWeight in 20, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.078125 = fieldNorm(doc=20)
       0.16 = coord(4/25)