Document (#27571)

Author

Can, F.
Nuray, R.
Sevdik, A.B.

Title

Automatic performance evaluation of Web search engines

Source

Information processing and management. 40(2004) no.3, S.495-514

Year

2004

Abstract

Measuring the information retrieval effectiveness of World Wide Web search engines is costly because of human relevance judgments involved. However, both for business enterprises and people it is important to know the most effective Web search engines, since such search engines help their users find higher number of relevant Web pages with less effort. Furthermore, this information can be used for several practical purposes. In this study we introduce automatic Web search engine evaluation method as an efficient and effective assessment tool of such systems. The experiments based on eight Web search engines, 25 queries, and binary user relevance judgments show that our method provides results consistent with human-based evaluations. It is shown that the observed consistencies are statistically significant. This indicates that the new method can be successfully used in the evaluation of Web search engines.

Theme

Suchmaschinen

Similar documents (content)

1. Jones, S.; Paynter, G.W.: Automatic extractionof document keyphrases for use in digital libraries : evaluations and applications (2002) 0.36

   0.36042216 = sum of:
     0.36042216 = product of:
       0.7508795 = sum of:
         0.013467978 = weight(abstract_txt:based in 1601) [ClassicSimilarity], result of:
           0.013467978 = score(doc=1601,freq=1.0), product of:
             0.06769794 = queryWeight, product of:
               1.0392835 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.020464187 = queryNorm
             0.1989422 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.059579514 = weight(abstract_txt:measuring in 1601) [ClassicSimilarity], result of:
           0.059579514 = score(doc=1601,freq=1.0), product of:
             0.14479776 = queryWeight, product of:
               1.0747619 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.020464187 = queryNorm
             0.4114671 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.062355913 = weight(abstract_txt:evaluations in 1601) [ClassicSimilarity], result of:
           0.062355913 = score(doc=1601,freq=1.0), product of:
             0.1492619 = queryWeight, product of:
               1.0912037 = boost
               6.684188 = idf(docFreq=150, maxDocs=44421)
               0.020464187 = queryNorm
             0.41776174 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.684188 = idf(docFreq=150, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.02234644 = weight(abstract_txt:used in 1601) [ClassicSimilarity], result of:
           0.02234644 = score(doc=1601,freq=2.0), product of:
             0.07530713 = queryWeight, product of:
               1.0961359 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.020464187 = queryNorm
             0.29673737 = fieldWeight in 1601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.023434497 = weight(abstract_txt:that in 1601) [ClassicSimilarity], result of:
           0.023434497 = score(doc=1601,freq=8.0), product of:
             0.05605462 = queryWeight, product of:
               1.1582376 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020464187 = queryNorm
             0.41806543 = fieldWeight in 1601, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.017454077 = weight(abstract_txt:this in 1601) [ClassicSimilarity], result of:
           0.017454077 = score(doc=1601,freq=4.0), product of:
             0.058029506 = queryWeight, product of:
               1.1784642 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020464187 = queryNorm
             0.30077934 = fieldWeight in 1601, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.0964869 = weight(abstract_txt:costly in 1601) [ClassicSimilarity], result of:
           0.0964869 = score(doc=1601,freq=1.0), product of:
             0.19968377 = queryWeight, product of:
               1.262126 = boost
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.020464187 = queryNorm
             0.4831985 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.060585633 = weight(abstract_txt:human in 1601) [ClassicSimilarity], result of:
           0.060585633 = score(doc=1601,freq=2.0), product of:
             0.14642334 = queryWeight, product of:
               1.5284508 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.020464187 = queryNorm
             0.41377032 = fieldWeight in 1601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.04727906 = weight(abstract_txt:effective in 1601) [ClassicSimilarity], result of:
           0.04727906 = score(doc=1601,freq=1.0), product of:
             0.15636988 = queryWeight, product of:
               1.5795118 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.020464187 = queryNorm
             0.302354 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.08283326 = weight(abstract_txt:automatic in 1601) [ClassicSimilarity], result of:
           0.08283326 = score(doc=1601,freq=2.0), product of:
             0.18037114 = queryWeight, product of:
               1.6964061 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.020464187 = queryNorm
             0.45923787 = fieldWeight in 1601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.07963334 = weight(abstract_txt:evaluation in 1601) [ClassicSimilarity], result of:
           0.07963334 = score(doc=1601,freq=2.0), product of:
             0.20112108 = queryWeight, product of:
               2.19392 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020464187 = queryNorm
             0.39594725 = fieldWeight in 1601, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
         0.18542299 = weight(abstract_txt:engines in 1601) [ClassicSimilarity], result of:
           0.18542299 = score(doc=1601,freq=1.0), product of:
             0.56086284 = queryWeight, product of:
               5.1812587 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.020464187 = queryNorm
             0.3306031 = fieldWeight in 1601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=1601)
       0.48 = coord(12/25)
   

2. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.31

   0.31413874 = sum of:
     0.31413874 = product of:
       0.7139517 = sum of:
         0.010100983 = weight(abstract_txt:based in 92) [ClassicSimilarity], result of:
           0.010100983 = score(doc=92,freq=1.0), product of:
             0.06769794 = queryWeight, product of:
               1.0392835 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.020464187 = queryNorm
             0.14920665 = fieldWeight in 92, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.012428019 = weight(abstract_txt:that in 92) [ClassicSimilarity], result of:
           0.012428019 = score(doc=92,freq=4.0), product of:
             0.05605462 = queryWeight, product of:
               1.1582376 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020464187 = queryNorm
             0.22171268 = fieldWeight in 92, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.011336755 = weight(abstract_txt:this in 92) [ClassicSimilarity], result of:
           0.011336755 = score(doc=92,freq=3.0), product of:
             0.058029506 = queryWeight, product of:
               1.1784642 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020464187 = queryNorm
             0.19536191 = fieldWeight in 92, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.07236517 = weight(abstract_txt:costly in 92) [ClassicSimilarity], result of:
           0.07236517 = score(doc=92,freq=1.0), product of:
             0.19968377 = queryWeight, product of:
               1.262126 = boost
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.020464187 = queryNorm
             0.36239886 = fieldWeight in 92, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.055651456 = weight(abstract_txt:human in 92) [ClassicSimilarity], result of:
           0.055651456 = score(doc=92,freq=3.0), product of:
             0.14642334 = queryWeight, product of:
               1.5284508 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.020464187 = queryNorm
             0.3800723 = fieldWeight in 92, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.0614173 = weight(abstract_txt:effective in 92) [ClassicSimilarity], result of:
           0.0614173 = score(doc=92,freq=3.0), product of:
             0.15636988 = queryWeight, product of:
               1.5795118 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.020464187 = queryNorm
             0.39276937 = fieldWeight in 92, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.053058505 = weight(abstract_txt:relevance in 92) [ClassicSimilarity], result of:
           0.053058505 = score(doc=92,freq=2.0), product of:
             0.16236524 = queryWeight, product of:
               1.609507 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020464187 = queryNorm
             0.32678488 = fieldWeight in 92, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.09443352 = weight(abstract_txt:evaluation in 92) [ClassicSimilarity], result of:
           0.09443352 = score(doc=92,freq=5.0), product of:
             0.20112108 = queryWeight, product of:
               2.19392 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020464187 = queryNorm
             0.4695357 = fieldWeight in 92, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.085553184 = weight(abstract_txt:method in 92) [ClassicSimilarity], result of:
           0.085553184 = score(doc=92,freq=4.0), product of:
             0.20284653 = queryWeight, product of:
               2.2033107 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.020464187 = queryNorm
             0.42176312 = fieldWeight in 92, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.20409991 = weight(abstract_txt:judgments in 92) [ClassicSimilarity], result of:
           0.20409991 = score(doc=92,freq=4.0), product of:
             0.31637943 = queryWeight, product of:
               2.2467277 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.020464187 = queryNorm
             0.6451112 = fieldWeight in 92, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
         0.053506907 = weight(abstract_txt:search in 92) [ClassicSimilarity], result of:
           0.053506907 = score(doc=92,freq=1.0), product of:
             0.31234097 = queryWeight, product of:
               4.17633 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.020464187 = queryNorm
             0.17130928 = fieldWeight in 92, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.046875 = fieldNorm(doc=92)
       0.44 = coord(11/25)
   

3. Schaer, P.; Mayr, P.; Sünkler, S.; Lewandowski, D.: How relevant is the long tail? : a relevance assessment study on million short (2016) 0.29

   0.29433903 = sum of:
     0.29433903 = product of:
       0.91980946 = sum of:
         0.010356682 = weight(abstract_txt:that in 4144) [ClassicSimilarity], result of:
           0.010356682 = score(doc=4144,freq=1.0), product of:
             0.05605462 = queryWeight, product of:
               1.1582376 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020464187 = queryNorm
             0.18476056 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.010908798 = weight(abstract_txt:this in 4144) [ClassicSimilarity], result of:
           0.010908798 = score(doc=4144,freq=1.0), product of:
             0.058029506 = queryWeight, product of:
               1.1784642 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020464187 = queryNorm
             0.18798709 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.10182684 = weight(abstract_txt:binary in 4144) [ClassicSimilarity], result of:
           0.10182684 = score(doc=4144,freq=1.0), product of:
             0.1783742 = queryWeight, product of:
               1.1928816 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.020464187 = queryNorm
             0.5708608 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.1250601 = weight(abstract_txt:relevance in 4144) [ClassicSimilarity], result of:
           0.1250601 = score(doc=4144,freq=4.0), product of:
             0.16236524 = queryWeight, product of:
               1.609507 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020464187 = queryNorm
             0.77023935 = fieldWeight in 4144, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.07038659 = weight(abstract_txt:evaluation in 4144) [ClassicSimilarity], result of:
           0.07038659 = score(doc=4144,freq=1.0), product of:
             0.20112108 = queryWeight, product of:
               2.19392 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020464187 = queryNorm
             0.34997123 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.17008325 = weight(abstract_txt:judgments in 4144) [ClassicSimilarity], result of:
           0.17008325 = score(doc=4144,freq=1.0), product of:
             0.31637943 = queryWeight, product of:
               2.2467277 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.020464187 = queryNorm
             0.53759265 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.19940846 = weight(abstract_txt:search in 4144) [ClassicSimilarity], result of:
           0.19940846 = score(doc=4144,freq=5.0), product of:
             0.31234097 = queryWeight, product of:
               4.17633 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.020464187 = queryNorm
             0.63843197 = fieldWeight in 4144, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
         0.23177874 = weight(abstract_txt:engines in 4144) [ClassicSimilarity], result of:
           0.23177874 = score(doc=4144,freq=1.0), product of:
             0.56086284 = queryWeight, product of:
               5.1812587 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.020464187 = queryNorm
             0.41325387 = fieldWeight in 4144, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.078125 = fieldNorm(doc=4144)
       0.32 = coord(8/25)
   

4. Lewandowski, D.; Spree, U.: Ranking of Wikipedia articles in search engines revisited : fair ranking for reasonable quality? (2011) 0.28

   0.28401864 = sum of:
     0.28401864 = product of:
       0.8875582 = sum of:
         0.008285346 = weight(abstract_txt:that in 1444) [ClassicSimilarity], result of:
           0.008285346 = score(doc=1444,freq=1.0), product of:
             0.05605462 = queryWeight, product of:
               1.1582376 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020464187 = queryNorm
             0.14780845 = fieldWeight in 1444, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.012341896 = weight(abstract_txt:this in 1444) [ClassicSimilarity], result of:
           0.012341896 = score(doc=1444,freq=2.0), product of:
             0.058029506 = queryWeight, product of:
               1.1784642 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020464187 = queryNorm
             0.21268311 = fieldWeight in 1444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.08664418 = weight(abstract_txt:relevance in 1444) [ClassicSimilarity], result of:
           0.08664418 = score(doc=1444,freq=3.0), product of:
             0.16236524 = queryWeight, product of:
               1.609507 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020464187 = queryNorm
             0.53363746 = fieldWeight in 1444, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.12591137 = weight(abstract_txt:evaluation in 1444) [ClassicSimilarity], result of:
           0.12591137 = score(doc=1444,freq=5.0), product of:
             0.20112108 = queryWeight, product of:
               2.19392 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020464187 = queryNorm
             0.6260476 = fieldWeight in 1444, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.057035454 = weight(abstract_txt:method in 1444) [ClassicSimilarity], result of:
           0.057035454 = score(doc=1444,freq=1.0), product of:
             0.20284653 = queryWeight, product of:
               2.2033107 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.020464187 = queryNorm
             0.2811754 = fieldWeight in 1444, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.19242723 = weight(abstract_txt:judgments in 1444) [ClassicSimilarity], result of:
           0.19242723 = score(doc=1444,freq=2.0), product of:
             0.31637943 = queryWeight, product of:
               2.2467277 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.020464187 = queryNorm
             0.60821664 = fieldWeight in 1444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.14268509 = weight(abstract_txt:search in 1444) [ClassicSimilarity], result of:
           0.14268509 = score(doc=1444,freq=4.0), product of:
             0.31234097 = queryWeight, product of:
               4.17633 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.020464187 = queryNorm
             0.45682475 = fieldWeight in 1444, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
         0.26222768 = weight(abstract_txt:engines in 1444) [ClassicSimilarity], result of:
           0.26222768 = score(doc=1444,freq=2.0), product of:
             0.56086284 = queryWeight, product of:
               5.1812587 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.020464187 = queryNorm
             0.46754336 = fieldWeight in 1444, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=1444)
       0.32 = coord(8/25)
   

5. Blakeman, K.: Intelligent agents : search tools of the future? (1997) 0.28

   0.27978104 = sum of:
     0.27978104 = product of:
       0.87431574 = sum of:
         0.091119476 = weight(abstract_txt:indicates in 1765) [ClassicSimilarity], result of:
           0.091119476 = score(doc=1765,freq=1.0), product of:
             0.13235672 = queryWeight, product of:
               1.0275532 = boost
               6.294296 = idf(docFreq=222, maxDocs=44421)
               0.020464187 = queryNorm
             0.6884386 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.294296 = idf(docFreq=222, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.023568962 = weight(abstract_txt:based in 1765) [ClassicSimilarity], result of:
           0.023568962 = score(doc=1765,freq=1.0), product of:
             0.06769794 = queryWeight, product of:
               1.0392835 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.020464187 = queryNorm
             0.34814885 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.027652308 = weight(abstract_txt:used in 1765) [ClassicSimilarity], result of:
           0.027652308 = score(doc=1765,freq=1.0), product of:
             0.07530713 = queryWeight, product of:
               1.0961359 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.020464187 = queryNorm
             0.36719376 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.014499356 = weight(abstract_txt:that in 1765) [ClassicSimilarity], result of:
           0.014499356 = score(doc=1765,freq=1.0), product of:
             0.05605462 = queryWeight, product of:
               1.1582376 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020464187 = queryNorm
             0.2586648 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.015272317 = weight(abstract_txt:this in 1765) [ClassicSimilarity], result of:
           0.015272317 = score(doc=1765,freq=1.0), product of:
             0.058029506 = queryWeight, product of:
               1.1784642 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020464187 = queryNorm
             0.26318192 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.09854123 = weight(abstract_txt:evaluation in 1765) [ClassicSimilarity], result of:
           0.09854123 = score(doc=1765,freq=1.0), product of:
             0.20112108 = queryWeight, product of:
               2.19392 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020464187 = queryNorm
             0.48995975 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.27917185 = weight(abstract_txt:search in 1765) [ClassicSimilarity], result of:
           0.27917185 = score(doc=1765,freq=5.0), product of:
             0.31234097 = queryWeight, product of:
               4.17633 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.020464187 = queryNorm
             0.8938048 = fieldWeight in 1765, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
         0.32449022 = weight(abstract_txt:engines in 1765) [ClassicSimilarity], result of:
           0.32449022 = score(doc=1765,freq=1.0), product of:
             0.56086284 = queryWeight, product of:
               5.1812587 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.020464187 = queryNorm
             0.5785554 = fieldWeight in 1765, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.109375 = fieldNorm(doc=1765)
       0.32 = coord(8/25)