Document (#28644)

Author
Cleverdon, C.W.
Mills, J.
Title
¬The testing of index language devices
Source
Theory of subject analysis: a sourcebook. Ed.: L.M. Chan, et al
Imprint
Littleton, CO : Libraries Unlimited
Year
1985
Pages
S.221-246
Abstract
A landmark event in the twentieth-century development of subject analysis theory was a retrieval experiment, begun in 1957, by Cyril Cleverdon, Librarian of the Cranfield Institute of Technology. For this work he received the Professional Award of the Special Libraries Association in 1962 and the Award of Merit of the American Society for Information Science in 1970. The objective of the experiment, called Cranfield I, was to test the ability of four indexing systems-UDC, Facet, Uniterm, and Alphabetic-Subject Headings-to retrieve material responsive to questions addressed to a collection of documents. The experiment was ambitious in scale, consisting of eighteen thousand documents and twelve hundred questions. Prior to Cranfield I, the question of what constitutes good indexing was approached subjectively and reference was made to assumptions in the form of principles that should be observed or user needs that should be met. Cranfield I was the first large-scale effort to use objective criteria for determining the parameters of good indexing. Its creative impetus was the definition of user satisfaction in terms of precision and recall. Out of the experiment emerged the definition of recall as the percentage of relevant documents retrieved and precision as the percentage of retrieved documents that were relevant. Operationalizing the concept of user satisfaction, that is, making it measurable, meant that it could be studied empirically and manipulated as a variable in mathematical equations. Much has been made of the fact that the experimental methodology of Cranfield I was seriously flawed. This is unfortunate as it tends to diminish Cleverdon's contribu tion, which was not methodological-such contributions can be left to benchmark researchers-but rather creative: the introduction of a new paradigm, one that proved to be eminently productive. The criticism leveled at the methodological shortcomings of Cranfield I underscored the need for more precise definitions of the variables involved in information retrieval. Particularly important was the need for a definition of the dependent variable index language. Like the definitions of precision and recall, that of index language provided a new way of looking at the indexing process. It was a re-visioning that stimulated research activity and led not only to a better understanding of indexing but also the design of better retrieval systems." Cranfield I was followed by Cranfield II. While Cranfield I was a wholesale comparison of four indexing "systems," Cranfield II aimed to single out various individual factors in index languages, called "indexing devices," and to measure how variations in these affected retrieval performance. The following selection represents the thinking at Cranfield midway between these two notable retrieval experiments.
Footnote
Nachdruck des Originalartikels mit Kommentierung durch die Herausgeber
Original in: Aslib proceedings 15(1963) no.4, S.106-130.
Theme
Retrievalstudien
Object
Cranfield

Similar documents (author)

  1. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1997) 6.29 
    6.2884717 = sum of:
  6.2884717 = sum of:
    2.7112951 = weight(author_txt:mills in 1576) [ClassicSimilarity], result of:
      2.7112951 = score(doc=1576,freq=1.0), product of:
        0.639261 = queryWeight, product of:
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.07536152 = queryNorm
        4.241296 = fieldWeight in 1576, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.5 = fieldNorm(doc=1576)
    3.5771766 = weight(author_txt:cleverdon in 1576) [ClassicSimilarity], result of:
      3.5771766 = score(doc=1576,freq=1.0), product of:
        0.76898986 = queryWeight, product of:
          1.0967842 = boost
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.07536152 = queryNorm
        4.6517863 = fieldWeight in 1576, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.5 = fieldNorm(doc=1576)
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1963) 6.29 
    6.2884717 = sum of:
  6.2884717 = sum of:
    2.7112951 = weight(author_txt:mills in 1577) [ClassicSimilarity], result of:
      2.7112951 = score(doc=1577,freq=1.0), product of:
        0.639261 = queryWeight, product of:
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.07536152 = queryNorm
        4.241296 = fieldWeight in 1577, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.5 = fieldNorm(doc=1577)
    3.5771766 = weight(author_txt:cleverdon in 1577) [ClassicSimilarity], result of:
      3.5771766 = score(doc=1577,freq=1.0), product of:
        0.76898986 = queryWeight, product of:
          1.0967842 = boost
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.07536152 = queryNorm
        4.6517863 = fieldWeight in 1577, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.5 = fieldNorm(doc=1577)
  3. Cleverdon, C.W.; Mills, J.; Keen, M.: Factors determining the performance of indexing systems : ASLIB Cranfield research project (1966) 4.72 
    4.7163534 = sum of:
  4.7163534 = sum of:
    2.0334713 = weight(author_txt:mills in 5362) [ClassicSimilarity], result of:
      2.0334713 = score(doc=5362,freq=1.0), product of:
        0.639261 = queryWeight, product of:
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.07536152 = queryNorm
        3.1809719 = fieldWeight in 5362, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.482592 = idf(docFreq=24, maxDocs=44421)
          0.375 = fieldNorm(doc=5362)
    2.6828823 = weight(author_txt:cleverdon in 5362) [ClassicSimilarity], result of:
      2.6828823 = score(doc=5362,freq=1.0), product of:
        0.76898986 = queryWeight, product of:
          1.0967842 = boost
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.07536152 = queryNorm
        3.4888396 = fieldWeight in 5362, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.303573 = idf(docFreq=10, maxDocs=44421)
          0.375 = fieldNorm(doc=5362)
  4. Cleverdon, C.W.: On the inverse relationship of recall and precision (1972) 2.24 
    2.2357354 = sum of:
  2.2357354 = product of:
    4.471471 = sum of:
      4.471471 = weight(author_txt:cleverdon in 1842) [ClassicSimilarity], result of:
        4.471471 = score(doc=1842,freq=1.0), product of:
          0.76898986 = queryWeight, product of:
            1.0967842 = boost
            9.303573 = idf(docFreq=10, maxDocs=44421)
            0.07536152 = queryNorm
          5.814733 = fieldWeight in 1842, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.303573 = idf(docFreq=10, maxDocs=44421)
            0.625 = fieldNorm(doc=1842)
    0.5 = coord(1/2)
  5. Cleverdon, C.W.: Evaluation tests of information retrieval systems (1970) 2.24 
    2.2357354 = sum of:
  2.2357354 = product of:
    4.471471 = sum of:
      4.471471 = weight(author_txt:cleverdon in 2271) [ClassicSimilarity], result of:
        4.471471 = score(doc=2271,freq=1.0), product of:
          0.76898986 = queryWeight, product of:
            1.0967842 = boost
            9.303573 = idf(docFreq=10, maxDocs=44421)
            0.07536152 = queryNorm
          5.814733 = fieldWeight in 2271, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.303573 = idf(docFreq=10, maxDocs=44421)
            0.625 = fieldNorm(doc=2271)
    0.5 = coord(1/2)

Similar documents (content)

  1. Fugmann, R.: ¬The complementarity of natural and indexing languages (1985) 0.45 
    0.44719887 = sum of:
  0.44719887 = product of:
    0.93166435 = sum of:
      0.029733386 = weight(abstract_txt:objective in 4641) [ClassicSimilarity], result of:
        0.029733386 = score(doc=4641,freq=2.0), product of:
          0.0777447 = queryWeight, product of:
            1.0886248 = boost
            5.7692223 = idf(docFreq=376, maxDocs=44421)
            0.0123787075 = queryNorm
          0.38244903 = fieldWeight in 4641, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7692223 = idf(docFreq=376, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.024490548 = weight(abstract_txt:definitions in 4641) [ClassicSimilarity], result of:
        0.024490548 = score(doc=4641,freq=1.0), product of:
          0.08606969 = queryWeight, product of:
            1.1454284 = boost
            6.0702558 = idf(docFreq=278, maxDocs=44421)
            0.0123787075 = queryNorm
          0.28454325 = fieldWeight in 4641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.0702558 = idf(docFreq=278, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.035752524 = weight(abstract_txt:language in 4641) [ClassicSimilarity], result of:
        0.035752524 = score(doc=4641,freq=9.0), product of:
          0.06095443 = queryWeight, product of:
            1.1805682 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.0123787075 = queryNorm
          0.5865451 = fieldWeight in 4641, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.027460724 = weight(abstract_txt:definition in 4641) [ClassicSimilarity], result of:
        0.027460724 = score(doc=4641,freq=1.0), product of:
          0.106338285 = queryWeight, product of:
            1.5593129 = boost
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2582393 = fieldWeight in 4641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.027676895 = weight(abstract_txt:precision in 4641) [ClassicSimilarity], result of:
        0.027676895 = score(doc=4641,freq=1.0), product of:
          0.10689562 = queryWeight, product of:
            1.563394 = boost
            5.5235233 = idf(docFreq=481, maxDocs=44421)
            0.0123787075 = queryNorm
          0.25891516 = fieldWeight in 4641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5235233 = idf(docFreq=481, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.031236282 = weight(abstract_txt:recall in 4641) [ClassicSimilarity], result of:
        0.031236282 = score(doc=4641,freq=1.0), product of:
          0.1158745 = queryWeight, product of:
            1.6277301 = boost
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.0123787075 = queryNorm
          0.26956993 = fieldWeight in 4641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.023002459 = weight(abstract_txt:retrieval in 4641) [ClassicSimilarity], result of:
        0.023002459 = score(doc=4641,freq=4.0), product of:
          0.0705766 = queryWeight, product of:
            1.6399975 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0123787075 = queryNorm
          0.3259219 = fieldWeight in 4641, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.046928298 = weight(abstract_txt:index in 4641) [ClassicSimilarity], result of:
        0.046928298 = score(doc=4641,freq=4.0), product of:
          0.1053896 = queryWeight, product of:
            1.7924899 = boost
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.0123787075 = queryNorm
          0.44528395 = fieldWeight in 4641, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.018432861 = weight(abstract_txt:that in 4641) [ClassicSimilarity], result of:
        0.018432861 = score(doc=4641,freq=8.0), product of:
          0.058787804 = queryWeight, product of:
            2.0081341 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0123787075 = queryNorm
          0.31354907 = fieldWeight in 4641, product of:
            2.828427 = tf(freq=8.0), with freq of:
              8.0 = termFreq=8.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.03968155 = weight(abstract_txt:experiment in 4641) [ClassicSimilarity], result of:
        0.03968155 = score(doc=4641,freq=1.0), product of:
          0.14959611 = queryWeight, product of:
            2.1355906 = boost
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2652579 = fieldWeight in 4641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.04461912 = weight(abstract_txt:indexing in 4641) [ClassicSimilarity], result of:
        0.04461912 = score(doc=4641,freq=2.0), product of:
          0.15471934 = queryWeight, product of:
            2.8730896 = boost
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.0123787075 = queryNorm
          0.28838748 = fieldWeight in 4641, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
      0.5826497 = weight(abstract_txt:cranfield in 4641) [ClassicSimilarity], result of:
        0.5826497 = score(doc=4641,freq=3.0), product of:
          0.87137157 = queryWeight, product of:
            8.547239 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.0123787075 = queryNorm
          0.66865814 = fieldWeight in 4641, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.046875 = fieldNorm(doc=4641)
    0.48 = coord(12/25)
  2. Harter, S.P.; Hert, C.A.: Evaluation of information retrieval systems : approaches, issues, and methods (1997) 0.28 
    0.2770066 = sum of:
  0.2770066 = product of:
    1.3850329 = sum of:
      0.025585743 = weight(abstract_txt:documents in 3264) [ClassicSimilarity], result of:
        0.025585743 = score(doc=3264,freq=1.0), product of:
          0.07942565 = queryWeight, product of:
            1.5561025 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0123787075 = queryNorm
          0.32213452 = fieldWeight in 3264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.078125 = fieldNorm(doc=3264)
      0.052060463 = weight(abstract_txt:recall in 3264) [ClassicSimilarity], result of:
        0.052060463 = score(doc=3264,freq=1.0), product of:
          0.1158745 = queryWeight, product of:
            1.6277301 = boost
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.0123787075 = queryNorm
          0.44928318 = fieldWeight in 3264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.078125 = fieldNorm(doc=3264)
      0.042862553 = weight(abstract_txt:retrieval in 3264) [ClassicSimilarity], result of:
        0.042862553 = score(doc=3264,freq=5.0), product of:
          0.0705766 = queryWeight, product of:
            1.6399975 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0123787075 = queryNorm
          0.6073196 = fieldWeight in 3264, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=3264)
      0.010861668 = weight(abstract_txt:that in 3264) [ClassicSimilarity], result of:
        0.010861668 = score(doc=3264,freq=1.0), product of:
          0.058787804 = queryWeight, product of:
            2.0081341 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0123787075 = queryNorm
          0.18476056 = fieldWeight in 3264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.078125 = fieldNorm(doc=3264)
      1.2536625 = weight(abstract_txt:cranfield in 3264) [ClassicSimilarity], result of:
        1.2536625 = score(doc=3264,freq=5.0), product of:
          0.87137157 = queryWeight, product of:
            8.547239 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.0123787075 = queryNorm
          1.4387232 = fieldWeight in 3264, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.078125 = fieldNorm(doc=3264)
    0.2 = coord(5/25)
  3. Lancaster, F.W.: Evaluating the performance of a large computerized information system (1985) 0.21 
    0.21188559 = sum of:
  0.21188559 = product of:
    0.40747228 = sum of:
      0.017910426 = weight(abstract_txt:scale in 4649) [ClassicSimilarity], result of:
        0.017910426 = score(doc=4649,freq=1.0), product of:
          0.06986428 = queryWeight, product of:
            1.031978 = boost
            5.4690194 = idf(docFreq=508, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2563603 = fieldWeight in 4649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4690194 = idf(docFreq=508, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.008190675 = weight(abstract_txt:user in 4649) [ClassicSimilarity], result of:
        0.008190675 = score(doc=4649,freq=1.0), product of:
          0.04747097 = queryWeight, product of:
            1.0418435 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0123787075 = queryNorm
          0.17254071 = fieldWeight in 4649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.026544664 = weight(abstract_txt:good in 4649) [ClassicSimilarity], result of:
        0.026544664 = score(doc=4649,freq=2.0), product of:
          0.07208187 = queryWeight, product of:
            1.0482283 = boost
            5.5551386 = idf(docFreq=466, maxDocs=44421)
            0.0123787075 = queryNorm
          0.36825714 = fieldWeight in 4649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5551386 = idf(docFreq=466, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.02875167 = weight(abstract_txt:retrieved in 4649) [ClassicSimilarity], result of:
        0.02875167 = score(doc=4649,freq=2.0), product of:
          0.07602387 = queryWeight, product of:
            1.0765094 = boost
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.0123787075 = queryNorm
          0.37819266 = fieldWeight in 4649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.023835015 = weight(abstract_txt:language in 4649) [ClassicSimilarity], result of:
        0.023835015 = score(doc=4649,freq=4.0), product of:
          0.06095443 = queryWeight, product of:
            1.1805682 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.0123787075 = queryNorm
          0.39103007 = fieldWeight in 4649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.021710224 = weight(abstract_txt:documents in 4649) [ClassicSimilarity], result of:
        0.021710224 = score(doc=4649,freq=2.0), product of:
          0.07942565 = queryWeight, product of:
            1.5561025 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0123787075 = queryNorm
          0.27334023 = fieldWeight in 4649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.03914104 = weight(abstract_txt:precision in 4649) [ClassicSimilarity], result of:
        0.03914104 = score(doc=4649,freq=2.0), product of:
          0.10689562 = queryWeight, product of:
            1.563394 = boost
            5.5235233 = idf(docFreq=481, maxDocs=44421)
            0.0123787075 = queryNorm
          0.36616132 = fieldWeight in 4649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5235233 = idf(docFreq=481, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.054102823 = weight(abstract_txt:recall in 4649) [ClassicSimilarity], result of:
        0.054102823 = score(doc=4649,freq=3.0), product of:
          0.1158745 = queryWeight, product of:
            1.6277301 = boost
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.0123787075 = queryNorm
          0.4669088 = fieldWeight in 4649, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.750825 = idf(docFreq=383, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.023002459 = weight(abstract_txt:retrieval in 4649) [ClassicSimilarity], result of:
        0.023002459 = score(doc=4649,freq=4.0), product of:
          0.0705766 = queryWeight, product of:
            1.6399975 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0123787075 = queryNorm
          0.3259219 = fieldWeight in 4649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.046928298 = weight(abstract_txt:index in 4649) [ClassicSimilarity], result of:
        0.046928298 = score(doc=4649,freq=4.0), product of:
          0.1053896 = queryWeight, product of:
            1.7924899 = boost
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.0123787075 = queryNorm
          0.44528395 = fieldWeight in 4649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.0145724565 = weight(abstract_txt:that in 4649) [ClassicSimilarity], result of:
        0.0145724565 = score(doc=4649,freq=5.0), product of:
          0.058787804 = queryWeight, product of:
            2.0081341 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2478823 = fieldWeight in 4649, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.03968155 = weight(abstract_txt:experiment in 4649) [ClassicSimilarity], result of:
        0.03968155 = score(doc=4649,freq=1.0), product of:
          0.14959611 = queryWeight, product of:
            2.1355906 = boost
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2652579 = fieldWeight in 4649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
      0.063100964 = weight(abstract_txt:indexing in 4649) [ClassicSimilarity], result of:
        0.063100964 = score(doc=4649,freq=4.0), product of:
          0.15471934 = queryWeight, product of:
            2.8730896 = boost
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.0123787075 = queryNorm
          0.4078415 = fieldWeight in 4649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.046875 = fieldNorm(doc=4649)
    0.52 = coord(13/25)
  4. Strzalkowski, T.: Natural language information retrieval (1995) 0.21 
    0.20613445 = sum of:
  0.20613445 = product of:
    0.7361945 = sum of:
      0.013651124 = weight(abstract_txt:user in 1982) [ClassicSimilarity], result of:
        0.013651124 = score(doc=1982,freq=1.0), product of:
          0.04747097 = queryWeight, product of:
            1.0418435 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0123787075 = queryNorm
          0.28756785 = fieldWeight in 1982, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.03440288 = weight(abstract_txt:language in 1982) [ClassicSimilarity], result of:
        0.03440288 = score(doc=1982,freq=3.0), product of:
          0.06095443 = queryWeight, product of:
            1.1805682 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.0123787075 = queryNorm
          0.5644033 = fieldWeight in 1982, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.044315808 = weight(abstract_txt:documents in 1982) [ClassicSimilarity], result of:
        0.044315808 = score(doc=1982,freq=3.0), product of:
          0.07942565 = queryWeight, product of:
            1.5561025 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0123787075 = queryNorm
          0.55795336 = fieldWeight in 1982, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.033201188 = weight(abstract_txt:retrieval in 1982) [ClassicSimilarity], result of:
        0.033201188 = score(doc=1982,freq=3.0), product of:
          0.0705766 = queryWeight, product of:
            1.6399975 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0123787075 = queryNorm
          0.4704277 = fieldWeight in 1982, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.039106913 = weight(abstract_txt:index in 1982) [ClassicSimilarity], result of:
        0.039106913 = score(doc=1982,freq=1.0), product of:
          0.1053896 = queryWeight, product of:
            1.7924899 = boost
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.0123787075 = queryNorm
          0.37106994 = fieldWeight in 1982, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.010861668 = weight(abstract_txt:that in 1982) [ClassicSimilarity], result of:
        0.010861668 = score(doc=1982,freq=1.0), product of:
          0.058787804 = queryWeight, product of:
            2.0081341 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0123787075 = queryNorm
          0.18476056 = fieldWeight in 1982, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
      0.56065494 = weight(abstract_txt:cranfield in 1982) [ClassicSimilarity], result of:
        0.56065494 = score(doc=1982,freq=1.0), product of:
          0.87137157 = queryWeight, product of:
            8.547239 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.0123787075 = queryNorm
          0.6434166 = fieldWeight in 1982, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.078125 = fieldNorm(doc=1982)
    0.28 = coord(7/25)
  5. Kaiser, J.O.: Systematic indexing (1985) 0.19 
    0.18851392 = sum of:
  0.18851392 = product of:
    0.589106 = sum of:
      0.023046749 = weight(abstract_txt:called in 1571) [ClassicSimilarity], result of:
        0.023046749 = score(doc=1571,freq=2.0), product of:
          0.06560159 = queryWeight, product of:
            5.2995505 = idf(docFreq=602, maxDocs=44421)
            0.0123787075 = queryNorm
          0.3513139 = fieldWeight in 1571, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.2995505 = idf(docFreq=602, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.029191814 = weight(abstract_txt:language in 1571) [ClassicSimilarity], result of:
        0.029191814 = score(doc=1571,freq=6.0), product of:
          0.06095443 = queryWeight, product of:
            1.1805682 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.0123787075 = queryNorm
          0.47891212 = fieldWeight in 1571, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.027460724 = weight(abstract_txt:definition in 1571) [ClassicSimilarity], result of:
        0.027460724 = score(doc=1571,freq=1.0), product of:
          0.106338285 = queryWeight, product of:
            1.5593129 = boost
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2582393 = fieldWeight in 1571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.509105 = idf(docFreq=488, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.040641095 = weight(abstract_txt:index in 1571) [ClassicSimilarity], result of:
        0.040641095 = score(doc=1571,freq=3.0), product of:
          0.1053896 = queryWeight, product of:
            1.7924899 = boost
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.0123787075 = queryNorm
          0.38562718 = fieldWeight in 1571, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.7496953 = idf(docFreq=1044, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.009216431 = weight(abstract_txt:that in 1571) [ClassicSimilarity], result of:
        0.009216431 = score(doc=1571,freq=2.0), product of:
          0.058787804 = queryWeight, product of:
            2.0081341 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0123787075 = queryNorm
          0.15677454 = fieldWeight in 1571, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.03968155 = weight(abstract_txt:experiment in 1571) [ClassicSimilarity], result of:
        0.03968155 = score(doc=1571,freq=1.0), product of:
          0.14959611 = queryWeight, product of:
            2.1355906 = boost
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.0123787075 = queryNorm
          0.2652579 = fieldWeight in 1571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.658835 = idf(docFreq=420, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.08347473 = weight(abstract_txt:indexing in 1571) [ClassicSimilarity], result of:
        0.08347473 = score(doc=1571,freq=7.0), product of:
          0.15471934 = queryWeight, product of:
            2.8730896 = boost
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.0123787075 = queryNorm
          0.5395236 = fieldWeight in 1571, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            4.3503094 = idf(docFreq=1557, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
      0.33639294 = weight(abstract_txt:cranfield in 1571) [ClassicSimilarity], result of:
        0.33639294 = score(doc=1571,freq=1.0), product of:
          0.87137157 = queryWeight, product of:
            8.547239 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.0123787075 = queryNorm
          0.38604993 = fieldWeight in 1571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.046875 = fieldNorm(doc=1571)
    0.32 = coord(8/25)