Document (#13454)

Author
Borgman, C.L.
Hirsh, S.G.
Hiller, J.
Title
Rethinking online monitoring methods for information retrieval systems : from search product to search process
Source
Journal of the American Society for Information Science. 47(1996) no.7, S.568-583
Year
1996
Abstract
Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the 'search product') to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quatitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental of field studies, whether alone or combined with other data collection methods. Based on the the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent varaibles to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7-year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems
Theme
OPAC
Benutzerstudien

Similar documents (author)

  1. Hirsh, S.G.; Borgman, C.L.: Comparing children's use of browsing and keyword searching on the Science Library catalog (1995) 3.17 
    3.169174 = sum of:
  3.169174 = product of:
    4.753761 = sum of:
      1.7811588 = weight(author_txt:borgman in 3893) [ClassicSimilarity], result of:
        1.7811588 = score(doc=3893,freq=1.0), product of:
          0.44459012 = queryWeight, product of:
            8.0125885 = idf(docFreq=39, maxDocs=44421)
            0.055486456 = queryNorm
          4.0062943 = fieldWeight in 3893, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.0125885 = idf(docFreq=39, maxDocs=44421)
            0.5 = fieldNorm(doc=3893)
      2.972602 = weight(author_txt:hirsh in 3893) [ClassicSimilarity], result of:
        2.972602 = score(doc=3893,freq=1.0), product of:
          0.62553155 = queryWeight, product of:
            1.1861639 = boost
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.055486456 = queryNorm
          4.7521214 = fieldWeight in 3893, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.5 = fieldNorm(doc=3893)
    0.6666667 = coord(2/3)
  2. Borgman, C.L.; Hirsh, S.G.; Walter, V.A.; Gallagher, A.L.: Childrens searching behavior on browsing and keyword online catalogs : the Science Library Catalog project (1995) 1.98 
    1.9807336 = sum of:
  1.9807336 = product of:
    2.9711003 = sum of:
      1.1132243 = weight(author_txt:borgman in 2659) [ClassicSimilarity], result of:
        1.1132243 = score(doc=2659,freq=1.0), product of:
          0.44459012 = queryWeight, product of:
            8.0125885 = idf(docFreq=39, maxDocs=44421)
            0.055486456 = queryNorm
          2.503934 = fieldWeight in 2659, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.0125885 = idf(docFreq=39, maxDocs=44421)
            0.3125 = fieldNorm(doc=2659)
      1.8578762 = weight(author_txt:hirsh in 2659) [ClassicSimilarity], result of:
        1.8578762 = score(doc=2659,freq=1.0), product of:
          0.62553155 = queryWeight, product of:
            1.1861639 = boost
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.055486456 = queryNorm
          2.9700758 = fieldWeight in 2659, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.3125 = fieldNorm(doc=2659)
    0.6666667 = coord(2/3)
  3. Hiller, H.: Wörterbuch des Buches (1991) 1.29 
    1.2852054 = sum of:
  1.2852054 = product of:
    3.855616 = sum of:
      3.855616 = weight(author_txt:hiller in 214) [ClassicSimilarity], result of:
        3.855616 = score(doc=214,freq=1.0), product of:
          0.6411317 = queryWeight, product of:
            1.2008637 = boost
            9.622026 = idf(docFreq=7, maxDocs=44421)
            0.055486456 = queryNorm
          6.0137663 = fieldWeight in 214, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.622026 = idf(docFreq=7, maxDocs=44421)
            0.625 = fieldNorm(doc=214)
    0.33333334 = coord(1/3)
  4. Hirsh, S.G.: Complexity of search tasks and children's information retrieval (1996) 1.24 
    1.2385842 = sum of:
  1.2385842 = product of:
    3.7157524 = sum of:
      3.7157524 = weight(author_txt:hirsh in 4498) [ClassicSimilarity], result of:
        3.7157524 = score(doc=4498,freq=1.0), product of:
          0.62553155 = queryWeight, product of:
            1.1861639 = boost
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.055486456 = queryNorm
          5.9401517 = fieldWeight in 4498, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.625 = fieldNorm(doc=4498)
    0.33333334 = coord(1/3)
  5. Hirsh, S.G.: Children's relevance criteria and information seeking on electronic resources (1999) 1.24 
    1.2385842 = sum of:
  1.2385842 = product of:
    3.7157524 = sum of:
      3.7157524 = weight(author_txt:hirsh in 5297) [ClassicSimilarity], result of:
        3.7157524 = score(doc=5297,freq=1.0), product of:
          0.62553155 = queryWeight, product of:
            1.1861639 = boost
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.055486456 = queryNorm
          5.9401517 = fieldWeight in 5297, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.504243 = idf(docFreq=8, maxDocs=44421)
            0.625 = fieldNorm(doc=5297)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Fidel, R.: What is missing in research about online searching behaviour? (1987) 0.56 
    0.5625527 = sum of:
  0.5625527 = product of:
    1.4063817 = sum of:
      0.027318535 = weight(abstract_txt:these in 3396) [ClassicSimilarity], result of:
        0.027318535 = score(doc=3396,freq=2.0), product of:
          0.06473684 = queryWeight, product of:
            1.0093962 = boost
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.020149775 = queryNorm
          0.42199364 = fieldWeight in 3396, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.029481724 = weight(abstract_txt:online in 3396) [ClassicSimilarity], result of:
        0.029481724 = score(doc=3396,freq=1.0), product of:
          0.085814066 = queryWeight, product of:
            1.1621579 = boost
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.020149775 = queryNorm
          0.3435535 = fieldWeight in 3396, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.06887512 = weight(abstract_txt:process in 3396) [ClassicSimilarity], result of:
        0.06887512 = score(doc=3396,freq=3.0), product of:
          0.10475893 = queryWeight, product of:
            1.2840486 = boost
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.020149775 = queryNorm
          0.65746295 = fieldWeight in 3396, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.10460636 = weight(abstract_txt:dependent in 3396) [ClassicSimilarity], result of:
        0.10460636 = score(doc=3396,freq=1.0), product of:
          0.174394 = queryWeight, product of:
            1.3527142 = boost
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.020149775 = queryNorm
          0.59982777 = fieldWeight in 3396, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.06671813 = weight(abstract_txt:searching in 3396) [ClassicSimilarity], result of:
        0.06671813 = score(doc=3396,freq=2.0), product of:
          0.117402084 = queryWeight, product of:
            1.3593266 = boost
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.020149775 = queryNorm
          0.56828743 = fieldWeight in 3396, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.036876794 = weight(abstract_txt:data in 3396) [ClassicSimilarity], result of:
        0.036876794 = score(doc=3396,freq=1.0), product of:
          0.118115865 = queryWeight, product of:
            1.7602097 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.020149775 = queryNorm
          0.31220865 = fieldWeight in 3396, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.11748227 = weight(abstract_txt:independent in 3396) [ClassicSimilarity], result of:
        0.11748227 = score(doc=3396,freq=1.0), product of:
          0.21569403 = queryWeight, product of:
            1.8424892 = boost
            5.8098235 = idf(docFreq=361, maxDocs=44421)
            0.020149775 = queryNorm
          0.54467094 = fieldWeight in 3396, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.8098235 = idf(docFreq=361, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.05344626 = weight(abstract_txt:research in 3396) [ClassicSimilarity], result of:
        0.05344626 = score(doc=3396,freq=2.0), product of:
          0.12758553 = queryWeight, product of:
            2.004018 = boost
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.020149775 = queryNorm
          0.41890535 = fieldWeight in 3396, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.1743637 = weight(abstract_txt:search in 3396) [ClassicSimilarity], result of:
        0.1743637 = score(doc=3396,freq=5.0), product of:
          0.22759368 = queryWeight, product of:
            3.090654 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.020149775 = queryNorm
          0.7661184 = fieldWeight in 3396, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
      0.7272128 = weight(abstract_txt:variables in 3396) [ClassicSimilarity], result of:
        0.7272128 = score(doc=3396,freq=6.0), product of:
          0.5041856 = queryWeight, product of:
            3.983787 = boost
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.020149775 = queryNorm
          1.4423513 = fieldWeight in 3396, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.09375 = fieldNorm(doc=3396)
    0.4 = coord(10/25)
  2. Hsieh-Yee, I.: Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers (1993) 0.42 
    0.41681525 = sum of:
  0.41681525 = product of:
    0.9473074 = sum of:
      0.0140870055 = weight(abstract_txt:that in 3405) [ClassicSimilarity], result of:
        0.0140870055 = score(doc=3405,freq=4.0), product of:
          0.04765291 = queryWeight, product of:
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.020149775 = queryNorm
          0.2956169 = fieldWeight in 3405, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.053678453 = weight(abstract_txt:questions in 3405) [ClassicSimilarity], result of:
        0.053678453 = score(doc=3405,freq=3.0), product of:
          0.101557784 = queryWeight, product of:
            1.0322785 = boost
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.020149775 = queryNorm
          0.52855086 = fieldWeight in 3405, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.016812133 = weight(abstract_txt:results in 3405) [ClassicSimilarity], result of:
        0.016812133 = score(doc=3405,freq=1.0), product of:
          0.07732726 = queryWeight, product of:
            1.1031948 = boost
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.020149775 = queryNorm
          0.21741535 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.019654483 = weight(abstract_txt:online in 3405) [ClassicSimilarity], result of:
        0.019654483 = score(doc=3405,freq=1.0), product of:
          0.085814066 = queryWeight, product of:
            1.1621579 = boost
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.020149775 = queryNorm
          0.22903568 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.026510047 = weight(abstract_txt:process in 3405) [ClassicSimilarity], result of:
        0.026510047 = score(doc=3405,freq=1.0), product of:
          0.10475893 = queryWeight, product of:
            1.2840486 = boost
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.020149775 = queryNorm
          0.25305763 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.056211255 = weight(abstract_txt:behavior in 3405) [ClassicSimilarity], result of:
        0.056211255 = score(doc=3405,freq=1.0), product of:
          0.17290182 = queryWeight, product of:
            1.6496267 = boost
            5.2016807 = idf(docFreq=664, maxDocs=44421)
            0.020149775 = queryNorm
          0.32510504 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.2016807 = idf(docFreq=664, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.01678285 = weight(abstract_txt:from in 3405) [ClassicSimilarity], result of:
        0.01678285 = score(doc=3405,freq=1.0), product of:
          0.097313076 = queryWeight, product of:
            1.7501951 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.020149775 = queryNorm
          0.17246243 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.024584528 = weight(abstract_txt:data in 3405) [ClassicSimilarity], result of:
        0.024584528 = score(doc=3405,freq=1.0), product of:
          0.118115865 = queryWeight, product of:
            1.7602097 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.020149775 = queryNorm
          0.20813909 = fieldWeight in 3405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.25164703 = weight(abstract_txt:monitoring in 3405) [ClassicSimilarity], result of:
        0.25164703 = score(doc=3405,freq=2.0), product of:
          0.4102811 = queryWeight, product of:
            2.9342427 = boost
            6.939294 = idf(docFreq=116, maxDocs=44421)
            0.020149775 = queryNorm
          0.6133527 = fieldWeight in 3405, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.939294 = idf(docFreq=116, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.18743536 = weight(abstract_txt:search in 3405) [ClassicSimilarity], result of:
        0.18743536 = score(doc=3405,freq=13.0), product of:
          0.22759368 = queryWeight, product of:
            3.090654 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.020149775 = queryNorm
          0.82355255 = fieldWeight in 3405, product of:
            3.6055512 = tf(freq=13.0), with freq of:
              13.0 = termFreq=13.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
      0.2799043 = weight(abstract_txt:variables in 3405) [ClassicSimilarity], result of:
        0.2799043 = score(doc=3405,freq=2.0), product of:
          0.5041856 = queryWeight, product of:
            3.983787 = boost
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.020149775 = queryNorm
          0.55516124 = fieldWeight in 3405, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.0625 = fieldNorm(doc=3405)
    0.44 = coord(11/25)
  3. Hildreth, C.R.: Are Web-based OPACs more effective retrieval systems than their conventional predecessors? : an experimental study (2000) 0.34 
    0.33807427 = sum of:
  0.33807427 = product of:
    0.7043214 = sum of:
      0.009961017 = weight(abstract_txt:that in 1113) [ClassicSimilarity], result of:
        0.009961017 = score(doc=1113,freq=2.0), product of:
          0.04765291 = queryWeight, product of:
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.020149775 = queryNorm
          0.20903271 = fieldWeight in 1113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.0075367563 = weight(abstract_txt:information in 1113) [ClassicSimilarity], result of:
        0.0075367563 = score(doc=1113,freq=1.0), product of:
          0.049852464 = queryWeight, product of:
            1.0228186 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.020149775 = queryNorm
          0.15118122 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.03099127 = weight(abstract_txt:questions in 1113) [ClassicSimilarity], result of:
        0.03099127 = score(doc=1113,freq=1.0), product of:
          0.101557784 = queryWeight, product of:
            1.0322785 = boost
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.020149775 = queryNorm
          0.30515897 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.022419155 = weight(abstract_txt:systems in 1113) [ClassicSimilarity], result of:
        0.022419155 = score(doc=1113,freq=2.0), product of:
          0.07435672 = queryWeight, product of:
            1.0817976 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.020149775 = queryNorm
          0.30150813 = fieldWeight in 1113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.037593074 = weight(abstract_txt:results in 1113) [ClassicSimilarity], result of:
        0.037593074 = score(doc=1113,freq=5.0), product of:
          0.07732726 = queryWeight, product of:
            1.1031948 = boost
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.020149775 = queryNorm
          0.4861555 = fieldWeight in 1113, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.059194017 = weight(abstract_txt:experimental in 1113) [ClassicSimilarity], result of:
        0.059194017 = score(doc=1113,freq=2.0), product of:
          0.124087736 = queryWeight, product of:
            1.1410501 = boost
            5.397019 = idf(docFreq=546, maxDocs=44421)
            0.020149775 = queryNorm
          0.4770336 = fieldWeight in 1113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.397019 = idf(docFreq=546, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.069737576 = weight(abstract_txt:dependent in 1113) [ClassicSimilarity], result of:
        0.069737576 = score(doc=1113,freq=1.0), product of:
          0.174394 = queryWeight, product of:
            1.3527142 = boost
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.020149775 = queryNorm
          0.39988518 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.01678285 = weight(abstract_txt:from in 1113) [ClassicSimilarity], result of:
        0.01678285 = score(doc=1113,freq=1.0), product of:
          0.097313076 = queryWeight, product of:
            1.7501951 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.020149775 = queryNorm
          0.17246243 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.039553296 = weight(abstract_txt:retrieval in 1113) [ClassicSimilarity], result of:
        0.039553296 = score(doc=1113,freq=2.0), product of:
          0.12871982 = queryWeight, product of:
            1.8375239 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.020149775 = queryNorm
          0.3072821 = fieldWeight in 1113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.025194809 = weight(abstract_txt:research in 1113) [ClassicSimilarity], result of:
        0.025194809 = score(doc=1113,freq=1.0), product of:
          0.12758553 = queryWeight, product of:
            2.004018 = boost
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.020149775 = queryNorm
          0.19747387 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.18743536 = weight(abstract_txt:search in 1113) [ClassicSimilarity], result of:
        0.18743536 = score(doc=1113,freq=13.0), product of:
          0.22759368 = queryWeight, product of:
            3.090654 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.020149775 = queryNorm
          0.82355255 = fieldWeight in 1113, product of:
            3.6055512 = tf(freq=13.0), with freq of:
              13.0 = termFreq=13.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
      0.19792223 = weight(abstract_txt:variables in 1113) [ClassicSimilarity], result of:
        0.19792223 = score(doc=1113,freq=1.0), product of:
          0.5041856 = queryWeight, product of:
            3.983787 = boost
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.020149775 = queryNorm
          0.39255828 = fieldWeight in 1113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.0625 = fieldNorm(doc=1113)
    0.48 = coord(12/25)
  4. Yi, M.: Information organization and retrieval using a topic maps-based ontology : results of a task-based evaluation (2008) 0.34 
    0.33793885 = sum of:
  0.33793885 = product of:
    0.7040393 = sum of:
      0.012451272 = weight(abstract_txt:that in 3369) [ClassicSimilarity], result of:
        0.012451272 = score(doc=3369,freq=2.0), product of:
          0.04765291 = queryWeight, product of:
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.020149775 = queryNorm
          0.2612909 = fieldWeight in 3369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.016097602 = weight(abstract_txt:these in 3369) [ClassicSimilarity], result of:
        0.016097602 = score(doc=3369,freq=1.0), product of:
          0.06473684 = queryWeight, product of:
            1.0093962 = boost
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.020149775 = queryNorm
          0.24866214 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.02307651 = weight(abstract_txt:information in 3369) [ClassicSimilarity], result of:
        0.02307651 = score(doc=3369,freq=6.0), product of:
          0.049852464 = queryWeight, product of:
            1.0228186 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.020149775 = queryNorm
          0.46289608 = fieldWeight in 3369, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.028023945 = weight(abstract_txt:systems in 3369) [ClassicSimilarity], result of:
        0.028023945 = score(doc=3369,freq=2.0), product of:
          0.07435672 = queryWeight, product of:
            1.0817976 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.020149775 = queryNorm
          0.37688518 = fieldWeight in 3369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.029719932 = weight(abstract_txt:results in 3369) [ClassicSimilarity], result of:
        0.029719932 = score(doc=3369,freq=2.0), product of:
          0.07732726 = queryWeight, product of:
            1.1031948 = boost
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.020149775 = queryNorm
          0.38433966 = fieldWeight in 3369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4786456 = idf(docFreq=3724, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.087171964 = weight(abstract_txt:dependent in 3369) [ClassicSimilarity], result of:
        0.087171964 = score(doc=3369,freq=1.0), product of:
          0.174394 = queryWeight, product of:
            1.3527142 = boost
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.020149775 = queryNorm
          0.49985647 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.398163 = idf(docFreq=200, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.03931404 = weight(abstract_txt:searching in 3369) [ClassicSimilarity], result of:
        0.03931404 = score(doc=3369,freq=1.0), product of:
          0.117402084 = queryWeight, product of:
            1.3593266 = boost
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.020149775 = queryNorm
          0.3348666 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.020978563 = weight(abstract_txt:from in 3369) [ClassicSimilarity], result of:
        0.020978563 = score(doc=3369,freq=1.0), product of:
          0.097313076 = queryWeight, product of:
            1.7501951 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.020149775 = queryNorm
          0.21557805 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.047351576 = weight(abstract_txt:methods in 3369) [ClassicSimilarity], result of:
        0.047351576 = score(doc=3369,freq=1.0), product of:
          0.1462783 = queryWeight, product of:
            1.7520449 = boost
            4.1434727 = idf(docFreq=1915, maxDocs=44421)
            0.020149775 = queryNorm
          0.3237088 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1434727 = idf(docFreq=1915, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.06055337 = weight(abstract_txt:retrieval in 3369) [ClassicSimilarity], result of:
        0.06055337 = score(doc=3369,freq=3.0), product of:
          0.12871982 = queryWeight, product of:
            1.8375239 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.020149775 = queryNorm
          0.4704277 = fieldWeight in 3369, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.09189774 = weight(abstract_txt:search in 3369) [ClassicSimilarity], result of:
        0.09189774 = score(doc=3369,freq=2.0), product of:
          0.22759368 = queryWeight, product of:
            3.090654 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.020149775 = queryNorm
          0.40377986 = fieldWeight in 3369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
      0.2474028 = weight(abstract_txt:variables in 3369) [ClassicSimilarity], result of:
        0.2474028 = score(doc=3369,freq=1.0), product of:
          0.5041856 = queryWeight, product of:
            3.983787 = boost
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.020149775 = queryNorm
          0.49069786 = fieldWeight in 3369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.078125 = fieldNorm(doc=3369)
    0.48 = coord(12/25)
  5. Markey, K.: Twenty-five years of end-user searching : part 2: future research directions (2007) 0.32 
    0.320623 = sum of:
  0.320623 = product of:
    0.61658275 = sum of:
      0.012199704 = weight(abstract_txt:that in 1443) [ClassicSimilarity], result of:
        0.012199704 = score(doc=1443,freq=3.0), product of:
          0.04765291 = queryWeight, product of:
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.020149775 = queryNorm
          0.25601172 = fieldWeight in 1443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.018212358 = weight(abstract_txt:these in 1443) [ClassicSimilarity], result of:
        0.018212358 = score(doc=1443,freq=2.0), product of:
          0.06473684 = queryWeight, product of:
            1.0093962 = boost
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.020149775 = queryNorm
          0.2813291 = fieldWeight in 1443, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.1828754 = idf(docFreq=5006, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.015073513 = weight(abstract_txt:information in 1443) [ClassicSimilarity], result of:
        0.015073513 = score(doc=1443,freq=4.0), product of:
          0.049852464 = queryWeight, product of:
            1.0228186 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.020149775 = queryNorm
          0.30236244 = fieldWeight in 1443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.03099127 = weight(abstract_txt:questions in 1443) [ClassicSimilarity], result of:
        0.03099127 = score(doc=1443,freq=1.0), product of:
          0.101557784 = queryWeight, product of:
            1.0322785 = boost
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.020149775 = queryNorm
          0.30515897 = fieldWeight in 1443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.031705473 = weight(abstract_txt:systems in 1443) [ClassicSimilarity], result of:
        0.031705473 = score(doc=1443,freq=4.0), product of:
          0.07435672 = queryWeight, product of:
            1.0817976 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.020149775 = queryNorm
          0.42639688 = fieldWeight in 1443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.039308965 = weight(abstract_txt:online in 1443) [ClassicSimilarity], result of:
        0.039308965 = score(doc=1443,freq=4.0), product of:
          0.085814066 = queryWeight, product of:
            1.1621579 = boost
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.020149775 = queryNorm
          0.45807135 = fieldWeight in 1443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.026510047 = weight(abstract_txt:process in 1443) [ClassicSimilarity], result of:
        0.026510047 = score(doc=1443,freq=1.0), product of:
          0.10475893 = queryWeight, product of:
            1.2840486 = boost
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.020149775 = queryNorm
          0.25305763 = fieldWeight in 1443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.048922 = idf(docFreq=2105, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.05447513 = weight(abstract_txt:searching in 1443) [ClassicSimilarity], result of:
        0.05447513 = score(doc=1443,freq=3.0), product of:
          0.117402084 = queryWeight, product of:
            1.3593266 = boost
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.020149775 = queryNorm
          0.46400478 = fieldWeight in 1443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.2862926 = idf(docFreq=1660, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.024584528 = weight(abstract_txt:data in 1443) [ClassicSimilarity], result of:
        0.024584528 = score(doc=1443,freq=1.0), product of:
          0.118115865 = queryWeight, product of:
            1.7602097 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.020149775 = queryNorm
          0.20813909 = fieldWeight in 1443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.048442695 = weight(abstract_txt:retrieval in 1443) [ClassicSimilarity], result of:
        0.048442695 = score(doc=1443,freq=3.0), product of:
          0.12871982 = queryWeight, product of:
            1.8375239 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.020149775 = queryNorm
          0.37634215 = fieldWeight in 1443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.043638688 = weight(abstract_txt:research in 1443) [ClassicSimilarity], result of:
        0.043638688 = score(doc=1443,freq=3.0), product of:
          0.12758553 = queryWeight, product of:
            2.004018 = boost
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.020149775 = queryNorm
          0.34203476 = fieldWeight in 1443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.159582 = idf(docFreq=5124, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.073518194 = weight(abstract_txt:search in 1443) [ClassicSimilarity], result of:
        0.073518194 = score(doc=1443,freq=2.0), product of:
          0.22759368 = queryWeight, product of:
            3.090654 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.020149775 = queryNorm
          0.3230239 = fieldWeight in 1443, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
      0.19792223 = weight(abstract_txt:variables in 1443) [ClassicSimilarity], result of:
        0.19792223 = score(doc=1443,freq=1.0), product of:
          0.5041856 = queryWeight, product of:
            3.983787 = boost
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.020149775 = queryNorm
          0.39255828 = fieldWeight in 1443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2809324 = idf(docFreq=225, maxDocs=44421)
            0.0625 = fieldNorm(doc=1443)
    0.52 = coord(13/25)