Document (#28650)

Author

Lancaster, F.W.

Title

Evaluating the performance of a large computerized information system

Source

Theory of subject analysis: a sourcebook. Ed.: L.M. Chan, et al

Imprint

Littleton, CO : Libraries Unlimited

Year

1985

Pages

S.326-339

Abstract

F. W. Lancaster is known for his writing an the state of the art in librarylinformation science. His skill in identifying significant contributions and synthesizing literature in fields as diverse as online systems, vocabulary control, measurement and evaluation, and the paperless society have earned him esteem as a chronicler of information science. Equally deserving of repute is his own contribution to research in the discipline-his evaluation of the MEDLARS operating system. The MEDLARS study is notable for several reasons. It was the first large-scale application of retrieval experiment methodology to the evaluation of an actual operating system. As such, problems had to be faced that do not arise in laboratory-like conditions. One example is the problem of recall: how to determine, for a very large and dynamic database, the number of documents relevant to a given search request. By solving this problem and others attendant upon transferring an experimental methodology to the real world, Lancaster created a constructive procedure that could be used to improve the design and functioning of retrieval systems. The MEDLARS study is notable also for its contribution to our understanding of what constitutes a good index language and good indexing. The ideal retrieval system would be one that retrieves all and only relevant documents. The failures that occur in real operating systems, when a relevant document is not retrieved (a recall failure) or an irrelevant document is retrieved (a precision failure), can be analysed to assess the impact of various factors an the performance of the system. This is exactly what Lancaster did. He found both the MEDLARS indexing and the McSH index language to be significant factors affecting retrieval performance. The indexing, primarily because it was insufficiently exhaustive, explained a large number of recall failures. The index language, largely because of its insufficient specificity, accounted for a large number of precision failures. The purpose of identifying factors responsible for a system's failures is ultimately to improve the system. Unlike many user studies, the MEDLARS evaluation yielded recommendations that were eventually implemented.* Indexing exhaustivity was increased and the McSH index language was enriched with more specific terms and a larger entry vocabulary.

Footnote

Nachdruck des Originalartikels mit Kommentierung durch die Herausgeber
Original in: Journal of the American Medical Association 207(1969) S.114-120.

Theme

Retrievalstudien

Object

Medlars

Similar documents (author)

1. Lancaster, F.W.: Vocabulary control in information retrieval systems (1977) 4.93

   4.934253 = sum of:
     4.934253 = weight(author_txt:lancaster in 1773) [ClassicSimilarity], result of:
       4.934253 = fieldWeight in 1773, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.894805 = idf(docFreq=44, maxDocs=44421)
         0.625 = fieldNorm(doc=1773)
   

2. Lancaster, F.W.: Toward paperless information systems (1978) 4.93

   4.934253 = sum of:
     4.934253 = weight(author_txt:lancaster in 3355) [ClassicSimilarity], result of:
       4.934253 = fieldWeight in 3355, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.894805 = idf(docFreq=44, maxDocs=44421)
         0.625 = fieldNorm(doc=3355)
   

3. Lancaster, F.W.: Libraries and librarians in an age of electronics (1982) 4.93

   4.934253 = sum of:
     4.934253 = weight(author_txt:lancaster in 6183) [ClassicSimilarity], result of:
       4.934253 = fieldWeight in 6183, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.894805 = idf(docFreq=44, maxDocs=44421)
         0.625 = fieldNorm(doc=6183)
   

4. Lancaster, F.W.: Librarians, technology and mediocrity (1993) 4.93

   4.934253 = sum of:
     4.934253 = weight(author_txt:lancaster in 7005) [ClassicSimilarity], result of:
       4.934253 = fieldWeight in 7005, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.894805 = idf(docFreq=44, maxDocs=44421)
         0.625 = fieldNorm(doc=7005)
   

5. Lancaster, F.W.: Information retrieval systems : characteristics, testing and evaluation (1979) 4.93

   4.934253 = sum of:
     4.934253 = weight(author_txt:lancaster in 7269) [ClassicSimilarity], result of:
       4.934253 = fieldWeight in 7269, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.894805 = idf(docFreq=44, maxDocs=44421)
         0.625 = fieldNorm(doc=7269)
   

Similar documents (content)

1. Tonta, Y.: Analysis of search failures in document retrieval systems : a review (1992) 0.33

   0.32783392 = sum of:
     0.32783392 = product of:
       1.024481 = sum of:
         0.054617815 = weight(abstract_txt:precision in 4679) [ClassicSimilarity], result of:
           0.054617815 = score(doc=4679,freq=1.0), product of:
             0.09040658 = queryWeight, product of:
               1.030295 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.015886283 = queryNorm
             0.6041354 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.010717252 = weight(abstract_txt:that in 4679) [ClassicSimilarity], result of:
           0.010717252 = score(doc=4679,freq=1.0), product of:
             0.041432977 = queryWeight, product of:
               1.10282 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015886283 = queryNorm
             0.2586648 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.047933046 = weight(abstract_txt:performance in 4679) [ClassicSimilarity], result of:
           0.047933046 = score(doc=4679,freq=1.0), product of:
             0.09486317 = queryWeight, product of:
               1.2925758 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015886283 = queryNorm
             0.50528616 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.066714175 = weight(abstract_txt:retrieval in 4679) [ClassicSimilarity], result of:
           0.066714175 = score(doc=4679,freq=6.0), product of:
             0.07162789 = queryWeight, product of:
               1.2969333 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015886283 = queryNorm
             0.9313994 = fieldWeight in 4679, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.11121506 = weight(abstract_txt:failure in 4679) [ClassicSimilarity], result of:
           0.11121506 = score(doc=4679,freq=1.0), product of:
             0.14524001 = queryWeight, product of:
               1.3058842 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.015886283 = queryNorm
             0.76573294 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.0924629 = weight(abstract_txt:recall in 4679) [ClassicSimilarity], result of:
           0.0924629 = score(doc=4679,freq=1.0), product of:
             0.14700066 = queryWeight, product of:
               1.60904 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015886283 = queryNorm
             0.6289965 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.03730518 = weight(abstract_txt:system in 4679) [ClassicSimilarity], result of:
           0.03730518 = score(doc=4679,freq=1.0), product of:
             0.10112621 = queryWeight, product of:
               1.887357 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.015886283 = queryNorm
             0.36889726 = fieldWeight in 4679, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
         0.6035157 = weight(abstract_txt:failures in 4679) [ClassicSimilarity], result of:
           0.6035157 = score(doc=4679,freq=4.0), product of:
             0.35598052 = queryWeight, product of:
               2.8912768 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.015886283 = queryNorm
             1.6953615 = fieldWeight in 4679, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.109375 = fieldNorm(doc=4679)
       0.32 = coord(8/25)
   

2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1985) 0.30

   0.29855147 = sum of:
     0.29855147 = product of:
       0.5331276 = sum of:
         0.04054321 = weight(abstract_txt:precision in 4643) [ClassicSimilarity], result of:
           0.04054321 = score(doc=4643,freq=3.0), product of:
             0.09040658 = queryWeight, product of:
               1.030295 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.015886283 = queryNorm
             0.4484542 = fieldWeight in 4643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.033675082 = weight(abstract_txt:good in 4643) [ClassicSimilarity], result of:
           0.033675082 = score(doc=4643,freq=2.0), product of:
             0.09144448 = queryWeight, product of:
               1.0361922 = boost
               5.5551386 = idf(docFreq=466, maxDocs=44421)
               0.015886283 = queryNorm
             0.36825714 = fieldWeight in 4643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5551386 = idf(docFreq=466, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.03647493 = weight(abstract_txt:retrieved in 4643) [ClassicSimilarity], result of:
           0.03647493 = score(doc=4643,freq=2.0), product of:
             0.09644537 = queryWeight, product of:
               1.0641485 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015886283 = queryNorm
             0.37819266 = fieldWeight in 4643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.013779324 = weight(abstract_txt:that in 4643) [ClassicSimilarity], result of:
           0.013779324 = score(doc=4643,freq=9.0), product of:
             0.041432977 = queryWeight, product of:
               1.10282 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015886283 = queryNorm
             0.332569 = fieldWeight in 4643, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.020542735 = weight(abstract_txt:performance in 4643) [ClassicSimilarity], result of:
           0.020542735 = score(doc=4643,freq=1.0), product of:
             0.09486317 = queryWeight, product of:
               1.2925758 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015886283 = queryNorm
             0.21655121 = fieldWeight in 4643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.029243438 = weight(abstract_txt:relevant in 4643) [ClassicSimilarity], result of:
           0.029243438 = score(doc=4643,freq=2.0), product of:
             0.09527986 = queryWeight, product of:
               1.2954115 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.015886283 = queryNorm
             0.3069215 = fieldWeight in 4643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.026100613 = weight(abstract_txt:retrieval in 4643) [ClassicSimilarity], result of:
           0.026100613 = score(doc=4643,freq=5.0), product of:
             0.07162789 = queryWeight, product of:
               1.2969333 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015886283 = queryNorm
             0.36439174 = fieldWeight in 4643, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.025330106 = weight(abstract_txt:factors in 4643) [ClassicSimilarity], result of:
           0.025330106 = score(doc=4643,freq=1.0), product of:
             0.10908125 = queryWeight, product of:
               1.3860607 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.015886283 = queryNorm
             0.23221318 = fieldWeight in 4643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.067779906 = weight(abstract_txt:notable in 4643) [ClassicSimilarity], result of:
           0.067779906 = score(doc=4643,freq=1.0), product of:
             0.1836661 = queryWeight, product of:
               1.4685072 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.015886283 = queryNorm
             0.36903873 = fieldWeight in 4643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.028508259 = weight(abstract_txt:language in 4643) [ClassicSimilarity], result of:
           0.028508259 = score(doc=4643,freq=2.0), product of:
             0.103103995 = queryWeight, product of:
               1.5560169 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.015886283 = queryNorm
             0.27650005 = fieldWeight in 4643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.0686359 = weight(abstract_txt:recall in 4643) [ClassicSimilarity], result of:
           0.0686359 = score(doc=4643,freq=3.0), product of:
             0.14700066 = queryWeight, product of:
               1.60904 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015886283 = queryNorm
             0.4669088 = fieldWeight in 4643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.060512967 = weight(abstract_txt:indexing in 4643) [ClassicSimilarity], result of:
           0.060512967 = score(doc=4643,freq=7.0), product of:
             0.11216 = queryWeight, product of:
               1.6229142 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.015886283 = queryNorm
             0.5395236 = fieldWeight in 4643, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.05155809 = weight(abstract_txt:index in 4643) [ClassicSimilarity], result of:
           0.05155809 = score(doc=4643,freq=3.0), product of:
             0.13369931 = queryWeight, product of:
               1.7719079 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.015886283 = queryNorm
             0.38562718 = fieldWeight in 4643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
         0.030443018 = weight(abstract_txt:large in 4643) [ClassicSimilarity], result of:
           0.030443018 = score(doc=4643,freq=1.0), product of:
             0.14619534 = queryWeight, product of:
               2.071564 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.015886283 = queryNorm
             0.20823522 = fieldWeight in 4643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.046875 = fieldNorm(doc=4643)
       0.56 = coord(14/25)
   

3. Dumais, S.T.: Latent semantic analysis (2003) 0.27

   0.26929736 = sum of:
     0.26929736 = product of:
       0.48088813 = sum of:
         0.028537206 = weight(abstract_txt:vocabulary in 3462) [ClassicSimilarity], result of:
           0.028537206 = score(doc=3462,freq=4.0), product of:
             0.08516808 = queryWeight, product of:
               5.3611083 = idf(docFreq=566, maxDocs=44421)
               0.015886283 = queryNorm
             0.33506927 = fieldWeight in 3462, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3611083 = idf(docFreq=566, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.015874585 = weight(abstract_txt:good in 3462) [ClassicSimilarity], result of:
           0.015874585 = score(doc=3462,freq=1.0), product of:
             0.09144448 = queryWeight, product of:
               1.0361922 = boost
               5.5551386 = idf(docFreq=466, maxDocs=44421)
               0.015886283 = queryNorm
             0.17359808 = fieldWeight in 3462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5551386 = idf(docFreq=466, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.024316622 = weight(abstract_txt:retrieved in 3462) [ClassicSimilarity], result of:
           0.024316622 = score(doc=3462,freq=2.0), product of:
             0.09644537 = queryWeight, product of:
               1.0641485 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015886283 = queryNorm
             0.25212845 = fieldWeight in 3462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.009186217 = weight(abstract_txt:that in 3462) [ClassicSimilarity], result of:
           0.009186217 = score(doc=3462,freq=9.0), product of:
             0.041432977 = queryWeight, product of:
               1.10282 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015886283 = queryNorm
             0.22171268 = fieldWeight in 3462, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.009825349 = weight(abstract_txt:number in 3462) [ClassicSimilarity], result of:
           0.009825349 = score(doc=3462,freq=1.0), product of:
             0.07602416 = queryWeight, product of:
               1.1571323 = boost
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.015886283 = queryNorm
             0.12923983 = fieldWeight in 3462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.023877168 = weight(abstract_txt:relevant in 3462) [ClassicSimilarity], result of:
           0.023877168 = score(doc=3462,freq=3.0), product of:
             0.09527986 = queryWeight, product of:
               1.2954115 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.015886283 = queryNorm
             0.25060037 = fieldWeight in 3462, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.023345098 = weight(abstract_txt:retrieval in 3462) [ClassicSimilarity], result of:
           0.023345098 = score(doc=3462,freq=9.0), product of:
             0.07162789 = queryWeight, product of:
               1.2969333 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015886283 = queryNorm
             0.3259219 = fieldWeight in 3462, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.016886737 = weight(abstract_txt:factors in 3462) [ClassicSimilarity], result of:
           0.016886737 = score(doc=3462,freq=1.0), product of:
             0.10908125 = queryWeight, product of:
               1.3860607 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.015886283 = queryNorm
             0.15480879 = fieldWeight in 3462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.013438921 = weight(abstract_txt:language in 3462) [ClassicSimilarity], result of:
           0.013438921 = score(doc=3462,freq=1.0), product of:
             0.103103995 = queryWeight, product of:
               1.5560169 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.015886283 = queryNorm
             0.13034336 = fieldWeight in 3462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.021563694 = weight(abstract_txt:indexing in 3462) [ClassicSimilarity], result of:
           0.021563694 = score(doc=3462,freq=2.0), product of:
             0.11216 = queryWeight, product of:
               1.6229142 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.015886283 = queryNorm
             0.19225833 = fieldWeight in 3462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.02806467 = weight(abstract_txt:index in 3462) [ClassicSimilarity], result of:
           0.02806467 = score(doc=3462,freq=2.0), product of:
             0.13369931 = queryWeight, product of:
               1.7719079 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.015886283 = queryNorm
             0.20990886 = fieldWeight in 3462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.045381773 = weight(abstract_txt:large in 3462) [ClassicSimilarity], result of:
           0.045381773 = score(doc=3462,freq=5.0), product of:
             0.14619534 = queryWeight, product of:
               2.071564 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.015886283 = queryNorm
             0.31041875 = fieldWeight in 3462, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.13437355 = weight(abstract_txt:lancaster in 3462) [ClassicSimilarity], result of:
           0.13437355 = score(doc=3462,freq=2.0), product of:
             0.34507924 = queryWeight, product of:
               2.4652822 = boost
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.015886283 = queryNorm
             0.3893991 = fieldWeight in 3462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
         0.086216524 = weight(abstract_txt:failures in 3462) [ClassicSimilarity], result of:
           0.086216524 = score(doc=3462,freq=1.0), product of:
             0.35598052 = queryWeight, product of:
               2.8912768 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.015886283 = queryNorm
             0.2421945 = fieldWeight in 3462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.03125 = fieldNorm(doc=3462)
       0.56 = coord(14/25)
   

4. Croft, W.B.: Effective retrieval based on combining evidence from the corpus and users (1995) 0.24

   0.23966946 = sum of:
     0.23966946 = product of:
       0.74896705 = sum of:
         0.062420357 = weight(abstract_txt:precision in 4557) [ClassicSimilarity], result of:
           0.062420357 = score(doc=4557,freq=1.0), product of:
             0.09040658 = queryWeight, product of:
               1.030295 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.015886283 = queryNorm
             0.6904404 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.012248288 = weight(abstract_txt:that in 4557) [ClassicSimilarity], result of:
           0.012248288 = score(doc=4557,freq=1.0), product of:
             0.041432977 = queryWeight, product of:
               1.10282 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015886283 = queryNorm
             0.2956169 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.039301395 = weight(abstract_txt:number in 4557) [ClassicSimilarity], result of:
           0.039301395 = score(doc=4557,freq=1.0), product of:
             0.07602416 = queryWeight, product of:
               1.1571323 = boost
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.015886283 = queryNorm
             0.5169593 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.044019938 = weight(abstract_txt:retrieval in 4557) [ClassicSimilarity], result of:
           0.044019938 = score(doc=4557,freq=2.0), product of:
             0.07162789 = queryWeight, product of:
               1.2969333 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015886283 = queryNorm
             0.6145642 = fieldWeight in 4557, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.10567188 = weight(abstract_txt:recall in 4557) [ClassicSimilarity], result of:
           0.10567188 = score(doc=4557,freq=1.0), product of:
             0.14700066 = queryWeight, product of:
               1.60904 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015886283 = queryNorm
             0.7188531 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.06659394 = weight(abstract_txt:evaluation in 4557) [ClassicSimilarity], result of:
           0.06659394 = score(doc=4557,freq=1.0), product of:
             0.11892752 = queryWeight, product of:
               1.6711589 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.015886283 = queryNorm
             0.559954 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.07384511 = weight(abstract_txt:system in 4557) [ClassicSimilarity], result of:
           0.07384511 = score(doc=4557,freq=3.0), product of:
             0.10112621 = queryWeight, product of:
               1.887357 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.015886283 = queryNorm
             0.73022723 = fieldWeight in 4557, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
         0.3448661 = weight(abstract_txt:failures in 4557) [ClassicSimilarity], result of:
           0.3448661 = score(doc=4557,freq=1.0), product of:
             0.35598052 = queryWeight, product of:
               2.8912768 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.015886283 = queryNorm
             0.968778 = fieldWeight in 4557, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.125 = fieldNorm(doc=4557)
       0.32 = coord(8/25)
   

5. Saracevic, T.: Effects of inconsistent relevance judgments on information retrieval test results : a historical perspective (2008) 0.24

   0.23529625 = sum of:
     0.23529625 = product of:
       0.7353008 = sum of:
         0.006124144 = weight(abstract_txt:that in 585) [ClassicSimilarity], result of:
           0.006124144 = score(doc=585,freq=1.0), product of:
             0.041432977 = queryWeight, product of:
               1.10282 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015886283 = queryNorm
             0.14780845 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.019650698 = weight(abstract_txt:number in 585) [ClassicSimilarity], result of:
           0.019650698 = score(doc=585,freq=1.0), product of:
             0.07602416 = queryWeight, product of:
               1.1571323 = boost
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.015886283 = queryNorm
             0.25847965 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1356745 = idf(docFreq=1930, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.027390312 = weight(abstract_txt:performance in 585) [ClassicSimilarity], result of:
           0.027390312 = score(doc=585,freq=1.0), product of:
             0.09486317 = queryWeight, product of:
               1.2925758 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015886283 = queryNorm
             0.28873494 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.02757098 = weight(abstract_txt:relevant in 585) [ClassicSimilarity], result of:
           0.02757098 = score(doc=585,freq=1.0), product of:
             0.09527986 = queryWeight, product of:
               1.2954115 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.015886283 = queryNorm
             0.2893684 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.026956595 = weight(abstract_txt:retrieval in 585) [ClassicSimilarity], result of:
           0.026956595 = score(doc=585,freq=3.0), product of:
             0.07162789 = queryWeight, product of:
               1.2969333 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015886283 = queryNorm
             0.37634215 = fieldWeight in 585, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.057672042 = weight(abstract_txt:evaluation in 585) [ClassicSimilarity], result of:
           0.057672042 = score(doc=585,freq=3.0), product of:
             0.11892752 = queryWeight, product of:
               1.6711589 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.015886283 = queryNorm
             0.48493436 = fieldWeight in 585, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.17243305 = weight(abstract_txt:failures in 585) [ClassicSimilarity], result of:
           0.17243305 = score(doc=585,freq=1.0), product of:
             0.35598052 = queryWeight, product of:
               2.8912768 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.015886283 = queryNorm
             0.484389 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
         0.39750293 = weight(abstract_txt:medlars in 585) [ClassicSimilarity], result of:
           0.39750293 = score(doc=585,freq=1.0), product of:
             0.66917974 = queryWeight, product of:
               4.4320326 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.015886283 = queryNorm
             0.5940152 = fieldWeight in 585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=585)
       0.32 = coord(8/25)