Document (#34022)

Author

Blandford, A.
Adams, A.
Attfield, S.
Buchanan, G.
Gow, J.
Makri, S.
Rimmer, J.
Warwick, C.

Title

¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work

Source

Information processing and management. 44(2008) no.1, S.4-21

Year

2008

Abstract

The strongest tradition of IR systems evaluation has focused on system effectiveness; more recently, there has been a growing interest in evaluation of Interactive IR systems, balancing system and user-oriented evaluation criteria. In this paper we shift the focus to considering how IR systems, and particularly digital libraries, can be evaluated to assess (and improve) their fit with users' broader work activities. Taking this focus, we answer a different set of evaluation questions that reveal more about the design of interfaces, user-system interactions and how systems may be deployed in the information working context. The planning and conduct of such evaluation studies share some features with the established methods for conducting IR evaluation studies, but come with a shift in emphasis; for example, a greater range of ethical considerations may be pertinent. We present the PRET A Rapporter framework for structuring user-centred evaluation studies and illustrate its application to three evaluation studies of digital library systems.

Footnote

Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems

Theme

Retrievalstudien
Information Gateway

Similar documents (author)

1. Makri, S.; Blandford, A.; Gow, J.; Rimmer, J.; Warwick, C.; Buchanan, G.: ¬A library or just another information resource? : a case study of users' mental models of taditional and digital libraries (2007) 3.21

   3.2121484 = sum of:
     3.2121484 = product of:
       4.0151854 = sum of:
         0.86857915 = weight(author_txt:buchanan in 1141) [ClassicSimilarity], result of:
           0.86857915 = score(doc=1141,freq=1.0), product of:
             0.40958196 = queryWeight, product of:
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.048285004 = queryNorm
             2.120648 = fieldWeight in 1141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.25 = fieldNorm(doc=1141)
         0.9232467 = weight(author_txt:blandford in 1141) [ClassicSimilarity], result of:
           0.9232467 = score(doc=1141,freq=1.0), product of:
             0.42659235 = queryWeight, product of:
               1.0205543 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.048285004 = queryNorm
             2.1642363 = fieldWeight in 1141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.25 = fieldNorm(doc=1141)
         0.95563936 = weight(author_txt:makri in 1141) [ClassicSimilarity], result of:
           0.95563936 = score(doc=1141,freq=1.0), product of:
             0.43651307 = queryWeight, product of:
               1.0323529 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.048285004 = queryNorm
             2.1892571 = fieldWeight in 1141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.25 = fieldNorm(doc=1141)
         1.26772 = weight(author_txt:warwick in 1141) [ClassicSimilarity], result of:
           1.26772 = score(doc=1141,freq=1.0), product of:
             0.52700746 = queryWeight, product of:
               1.1343262 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.048285004 = queryNorm
             2.4055066 = fieldWeight in 1141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.25 = fieldNorm(doc=1141)
       0.8 = coord(4/5)
   

2. Rimmer, J.; Warwick, C.; Blandford, A.; Gow, J.; Buchanan, G.: ¬An examination of the physical and the digital qualities of humanities research (2008) 2.29

   2.2946594 = sum of:
     2.2946594 = product of:
       3.8244321 = sum of:
         1.0857239 = weight(author_txt:buchanan in 3098) [ClassicSimilarity], result of:
           1.0857239 = score(doc=3098,freq=1.0), product of:
             0.40958196 = queryWeight, product of:
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.048285004 = queryNorm
             2.6508098 = fieldWeight in 3098, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.3125 = fieldNorm(doc=3098)
         1.1540583 = weight(author_txt:blandford in 3098) [ClassicSimilarity], result of:
           1.1540583 = score(doc=3098,freq=1.0), product of:
             0.42659235 = queryWeight, product of:
               1.0205543 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.048285004 = queryNorm
             2.7052953 = fieldWeight in 3098, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.3125 = fieldNorm(doc=3098)
         1.5846498 = weight(author_txt:warwick in 3098) [ClassicSimilarity], result of:
           1.5846498 = score(doc=3098,freq=1.0), product of:
             0.52700746 = queryWeight, product of:
               1.1343262 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.048285004 = queryNorm
             3.0068831 = fieldWeight in 3098, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.3125 = fieldNorm(doc=3098)
       0.6 = coord(3/5)
   

3. Warwick, C.; Rimmer, J.; Blandford, A.; Gow, J.; Buchanan, G.: Cognitive economy and satisficing in information seeking : a longitudinal study of undergraduate information behavior (2009) 2.29

   2.2946594 = sum of:
     2.2946594 = product of:
       3.8244321 = sum of:
         1.0857239 = weight(author_txt:buchanan in 278) [ClassicSimilarity], result of:
           1.0857239 = score(doc=278,freq=1.0), product of:
             0.40958196 = queryWeight, product of:
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.048285004 = queryNorm
             2.6508098 = fieldWeight in 278, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.3125 = fieldNorm(doc=278)
         1.1540583 = weight(author_txt:blandford in 278) [ClassicSimilarity], result of:
           1.1540583 = score(doc=278,freq=1.0), product of:
             0.42659235 = queryWeight, product of:
               1.0205543 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.048285004 = queryNorm
             2.7052953 = fieldWeight in 278, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.3125 = fieldNorm(doc=278)
         1.5846498 = weight(author_txt:warwick in 278) [ClassicSimilarity], result of:
           1.5846498 = score(doc=278,freq=1.0), product of:
             0.52700746 = queryWeight, product of:
               1.1343262 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.048285004 = queryNorm
             3.0068831 = fieldWeight in 278, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.3125 = fieldNorm(doc=278)
       0.6 = coord(3/5)
   

4. Makri, S.; Warwick, C.: Information for inspiration : understanding architects' information seeking and use behaviors to inform design (2010) 1.78

   1.7786875 = sum of:
     1.7786875 = product of:
       4.4467187 = sum of:
         1.9112787 = weight(author_txt:makri in 966) [ClassicSimilarity], result of:
           1.9112787 = score(doc=966,freq=1.0), product of:
             0.43651307 = queryWeight, product of:
               1.0323529 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.048285004 = queryNorm
             4.3785143 = fieldWeight in 966, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.5 = fieldNorm(doc=966)
         2.53544 = weight(author_txt:warwick in 966) [ClassicSimilarity], result of:
           2.53544 = score(doc=966,freq=1.0), product of:
             0.52700746 = queryWeight, product of:
               1.1343262 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.048285004 = queryNorm
             4.811013 = fieldWeight in 966, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.5 = fieldNorm(doc=966)
       0.4 = coord(2/5)
   

5. Makri, S.; Blandford, A.: Coming across information serendipitously : Part 2: A classification framework (2012) 1.50

   1.5031089 = sum of:
     1.5031089 = product of:
       3.757772 = sum of:
         1.8464934 = weight(author_txt:blandford in 1396) [ClassicSimilarity], result of:
           1.8464934 = score(doc=1396,freq=1.0), product of:
             0.42659235 = queryWeight, product of:
               1.0205543 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.048285004 = queryNorm
             4.3284726 = fieldWeight in 1396, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.5 = fieldNorm(doc=1396)
         1.9112787 = weight(author_txt:makri in 1396) [ClassicSimilarity], result of:
           1.9112787 = score(doc=1396,freq=1.0), product of:
             0.43651307 = queryWeight, product of:
               1.0323529 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.048285004 = queryNorm
             4.3785143 = fieldWeight in 1396, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.5 = fieldNorm(doc=1396)
       0.4 = coord(2/5)
   

Similar documents (content)

1. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.27

   0.26721913 = sum of:
     0.26721913 = product of:
       0.74227536 = sum of:
         0.10204506 = weight(abstract_txt:conducting in 4700) [ClassicSimilarity], result of:
           0.10204506 = score(doc=4700,freq=2.0), product of:
             0.16469163 = queryWeight, product of:
               1.0947924 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.021459239 = queryNorm
             0.61961293 = fieldWeight in 4700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.009773017 = weight(abstract_txt:with in 4700) [ClassicSimilarity], result of:
           0.009773017 = score(doc=4700,freq=1.0), product of:
             0.062644035 = queryWeight, product of:
               1.16949 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.021459239 = queryNorm
             0.15600874 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.022709696 = weight(abstract_txt:libraries in 4700) [ClassicSimilarity], result of:
           0.022709696 = score(doc=4700,freq=1.0), product of:
             0.09600733 = queryWeight, product of:
               1.1821245 = boost
               3.78466 = idf(docFreq=2742, maxDocs=44421)
               0.021459239 = queryNorm
             0.23654126 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.78466 = idf(docFreq=2742, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.06810089 = weight(abstract_txt:framework in 4700) [ClassicSimilarity], result of:
           0.06810089 = score(doc=4700,freq=3.0), product of:
             0.13842833 = queryWeight, product of:
               1.4194611 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.021459239 = queryNorm
             0.49195778 = fieldWeight in 4700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.024109269 = weight(abstract_txt:system in 4700) [ClassicSimilarity], result of:
           0.024109269 = score(doc=4700,freq=1.0), product of:
             0.11437119 = queryWeight, product of:
               1.5802106 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021459239 = queryNorm
             0.21079844 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.05092403 = weight(abstract_txt:digital in 4700) [ClassicSimilarity], result of:
           0.05092403 = score(doc=4700,freq=1.0), product of:
             0.18828213 = queryWeight, product of:
               2.0275016 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.021459239 = queryNorm
             0.2704666 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.09134732 = weight(abstract_txt:studies in 4700) [ClassicSimilarity], result of:
           0.09134732 = score(doc=4700,freq=2.0), product of:
             0.24282537 = queryWeight, product of:
               2.6587226 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.021459239 = queryNorm
             0.37618524 = fieldWeight in 4700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.07200179 = weight(abstract_txt:systems in 4700) [ClassicSimilarity], result of:
           0.07200179 = score(doc=4700,freq=3.0), product of:
             0.19498385 = queryWeight, product of:
               2.6636696 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.021459239 = queryNorm
             0.36927053 = fieldWeight in 4700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.30126426 = weight(abstract_txt:evaluation in 4700) [ClassicSimilarity], result of:
           0.30126426 = score(doc=4700,freq=4.0), product of:
             0.5380161 = queryWeight, product of:
               5.596785 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021459239 = queryNorm
             0.559954 = fieldWeight in 4700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
       0.36 = coord(9/25)
   

2. Hastings, S.K.: Evaluation of image retrieval systems : role of user feedback (1999) 0.26

   0.25816315 = sum of:
     0.25816315 = product of:
       0.8067599 = sum of:
         0.029009962 = weight(abstract_txt:more in 970) [ClassicSimilarity], result of:
           0.029009962 = score(doc=970,freq=2.0), product of:
             0.07731166 = queryWeight, product of:
               1.0608 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.021459239 = queryNorm
             0.375234 = fieldWeight in 970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.049147587 = weight(abstract_txt:framework in 970) [ClassicSimilarity], result of:
           0.049147587 = score(doc=970,freq=1.0), product of:
             0.13842833 = queryWeight, product of:
               1.4194611 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.021459239 = queryNorm
             0.35503995 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.05994682 = weight(abstract_txt:focus in 970) [ClassicSimilarity], result of:
           0.05994682 = score(doc=970,freq=1.0), product of:
             0.1580281 = queryWeight, product of:
               1.5166248 = boost
               4.855588 = idf(docFreq=939, maxDocs=44421)
               0.021459239 = queryNorm
             0.3793428 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.855588 = idf(docFreq=939, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.03917264 = weight(abstract_txt:user in 970) [ClassicSimilarity], result of:
           0.03917264 = score(doc=970,freq=1.0), product of:
             0.1362205 = queryWeight, product of:
               1.7245582 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.021459239 = queryNorm
             0.28756785 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.09002181 = weight(abstract_txt:digital in 970) [ClassicSimilarity], result of:
           0.09002181 = score(doc=970,freq=2.0), product of:
             0.18828213 = queryWeight, product of:
               2.0275016 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.021459239 = queryNorm
             0.4781219 = fieldWeight in 970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.13984646 = weight(abstract_txt:studies in 970) [ClassicSimilarity], result of:
           0.13984646 = score(doc=970,freq=3.0), product of:
             0.24282537 = queryWeight, product of:
               2.6587226 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.021459239 = queryNorm
             0.57591367 = fieldWeight in 970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.07348652 = weight(abstract_txt:systems in 970) [ClassicSimilarity], result of:
           0.07348652 = score(doc=970,freq=2.0), product of:
             0.19498385 = queryWeight, product of:
               2.6636696 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.021459239 = queryNorm
             0.37688518 = fieldWeight in 970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
         0.32612813 = weight(abstract_txt:evaluation in 970) [ClassicSimilarity], result of:
           0.32612813 = score(doc=970,freq=3.0), product of:
             0.5380161 = queryWeight, product of:
               5.596785 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021459239 = queryNorm
             0.606168 = fieldWeight in 970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=970)
       0.32 = coord(8/25)
   

3. Wacholder, N.; Kelly, D.; Kantor, P.; Rittman, R.; Sun, Y.; Bai, B.; Small, S.; Yamrom, B.; Strzalkowski, T.: ¬A model for quantitative evaluation of an end-to-end question-answering system (2007) 0.24

   0.24315925 = sum of:
     0.24315925 = product of:
       0.7598727 = sum of:
         0.07574916 = weight(abstract_txt:conduct in 1435) [ClassicSimilarity], result of:
           0.07574916 = score(doc=1435,freq=1.0), product of:
             0.14659935 = queryWeight, product of:
               1.0329089 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.021459239 = queryNorm
             0.5167087 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.020513143 = weight(abstract_txt:more in 1435) [ClassicSimilarity], result of:
           0.020513143 = score(doc=1435,freq=1.0), product of:
             0.07731166 = queryWeight, product of:
               1.0608 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.021459239 = queryNorm
             0.26533052 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.09019594 = weight(abstract_txt:conducting in 1435) [ClassicSimilarity], result of:
           0.09019594 = score(doc=1435,freq=1.0), product of:
             0.16469163 = queryWeight, product of:
               1.0947924 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.021459239 = queryNorm
             0.5476656 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.012216271 = weight(abstract_txt:with in 1435) [ClassicSimilarity], result of:
           0.012216271 = score(doc=1435,freq=1.0), product of:
             0.062644035 = queryWeight, product of:
               1.16949 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.021459239 = queryNorm
             0.19501092 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.028494151 = weight(abstract_txt:work in 1435) [ClassicSimilarity], result of:
           0.028494151 = score(doc=1435,freq=1.0), product of:
             0.09624851 = queryWeight, product of:
               1.1836083 = boost
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.021459239 = queryNorm
             0.29604772 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.052198097 = weight(abstract_txt:system in 1435) [ClassicSimilarity], result of:
           0.052198097 = score(doc=1435,freq=3.0), product of:
             0.11437119 = queryWeight, product of:
               1.5802106 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021459239 = queryNorm
             0.45639202 = fieldWeight in 1435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.10392564 = weight(abstract_txt:systems in 1435) [ClassicSimilarity], result of:
           0.10392564 = score(doc=1435,freq=4.0), product of:
             0.19498385 = queryWeight, product of:
               2.6636696 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.021459239 = queryNorm
             0.5329961 = fieldWeight in 1435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.3765803 = weight(abstract_txt:evaluation in 1435) [ClassicSimilarity], result of:
           0.3765803 = score(doc=1435,freq=4.0), product of:
             0.5380161 = queryWeight, product of:
               5.596785 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021459239 = queryNorm
             0.69994247 = fieldWeight in 1435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
       0.32 = coord(8/25)
   

4. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.23

   0.23117821 = sum of:
     0.23117821 = product of:
       0.7224319 = sum of:
         0.017405977 = weight(abstract_txt:more in 3019) [ClassicSimilarity], result of:
           0.017405977 = score(doc=3019,freq=2.0), product of:
             0.07731166 = queryWeight, product of:
               1.0608 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.021459239 = queryNorm
             0.2251404 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.09474506 = weight(abstract_txt:centred in 3019) [ClassicSimilarity], result of:
           0.09474506 = score(doc=3019,freq=2.0), product of:
             0.1898776 = queryWeight, product of:
               1.1755277 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.021459239 = queryNorm
             0.49897966 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.06229856 = weight(abstract_txt:focus in 3019) [ClassicSimilarity], result of:
           0.06229856 = score(doc=3019,freq=3.0), product of:
             0.1580281 = queryWeight, product of:
               1.5166248 = boost
               4.855588 = idf(docFreq=939, maxDocs=44421)
               0.021459239 = queryNorm
             0.39422458 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.855588 = idf(docFreq=939, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.02557174 = weight(abstract_txt:system in 3019) [ClassicSimilarity], result of:
           0.02557174 = score(doc=3019,freq=2.0), product of:
             0.11437119 = queryWeight, product of:
               1.5802106 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021459239 = queryNorm
             0.2235855 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.052555606 = weight(abstract_txt:user in 3019) [ClassicSimilarity], result of:
           0.052555606 = score(doc=3019,freq=5.0), product of:
             0.1362205 = queryWeight, product of:
               1.7245582 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.021459239 = queryNorm
             0.38581276 = fieldWeight in 3019, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.048444234 = weight(abstract_txt:studies in 3019) [ClassicSimilarity], result of:
           0.048444234 = score(doc=3019,freq=1.0), product of:
             0.24282537 = queryWeight, product of:
               2.6587226 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.021459239 = queryNorm
             0.19950235 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.08248842 = weight(abstract_txt:systems in 3019) [ClassicSimilarity], result of:
           0.08248842 = score(doc=3019,freq=7.0), product of:
             0.19498385 = queryWeight, product of:
               2.6636696 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.021459239 = queryNorm
             0.42305255 = fieldWeight in 3019, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.3389223 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
           0.3389223 = score(doc=3019,freq=9.0), product of:
             0.5380161 = queryWeight, product of:
               5.596785 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021459239 = queryNorm
             0.62994826 = fieldWeight in 3019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
       0.32 = coord(8/25)
   

5. Spink, A.; Cole, C.: New directions in cognitive information retrieval : introduction (2005) 0.22

   0.21661237 = sum of:
     0.21661237 = product of:
       0.5415309 = sum of:
         0.024870863 = weight(abstract_txt:more in 772) [ClassicSimilarity], result of:
           0.024870863 = score(doc=772,freq=3.0), product of:
             0.07731166 = queryWeight, product of:
               1.0608 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.021459239 = queryNorm
             0.32169616 = fieldWeight in 772, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.06313716 = weight(abstract_txt:conducting in 772) [ClassicSimilarity], result of:
           0.06313716 = score(doc=772,freq=1.0), product of:
             0.16469163 = queryWeight, product of:
               1.0947924 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.021459239 = queryNorm
             0.38336593 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.02094654 = weight(abstract_txt:with in 772) [ClassicSimilarity], result of:
           0.02094654 = score(doc=772,freq=6.0), product of:
             0.062644035 = queryWeight, product of:
               1.16949 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.021459239 = queryNorm
             0.33437407 = fieldWeight in 772, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.019870983 = weight(abstract_txt:libraries in 772) [ClassicSimilarity], result of:
           0.019870983 = score(doc=772,freq=1.0), product of:
             0.09600733 = queryWeight, product of:
               1.1821245 = boost
               3.78466 = idf(docFreq=2742, maxDocs=44421)
               0.021459239 = queryNorm
             0.2069736 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.78466 = idf(docFreq=2742, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.03440331 = weight(abstract_txt:framework in 772) [ClassicSimilarity], result of:
           0.03440331 = score(doc=772,freq=1.0), product of:
             0.13842833 = queryWeight, product of:
               1.4194611 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.021459239 = queryNorm
             0.24852796 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.02109561 = weight(abstract_txt:system in 772) [ClassicSimilarity], result of:
           0.02109561 = score(doc=772,freq=1.0), product of:
             0.11437119 = queryWeight, product of:
               1.5802106 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021459239 = queryNorm
             0.18444863 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.05484169 = weight(abstract_txt:user in 772) [ClassicSimilarity], result of:
           0.05484169 = score(doc=772,freq=4.0), product of:
             0.1362205 = queryWeight, product of:
               1.7245582 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.021459239 = queryNorm
             0.40259498 = fieldWeight in 772, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.044558525 = weight(abstract_txt:digital in 772) [ClassicSimilarity], result of:
           0.044558525 = score(doc=772,freq=1.0), product of:
             0.18828213 = queryWeight, product of:
               2.0275016 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.021459239 = queryNorm
             0.23665828 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.12600313 = weight(abstract_txt:systems in 772) [ClassicSimilarity], result of:
           0.12600313 = score(doc=772,freq=12.0), product of:
             0.19498385 = queryWeight, product of:
               2.6636696 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.021459239 = queryNorm
             0.6462234 = fieldWeight in 772, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
         0.13180311 = weight(abstract_txt:evaluation in 772) [ClassicSimilarity], result of:
           0.13180311 = score(doc=772,freq=1.0), product of:
             0.5380161 = queryWeight, product of:
               5.596785 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021459239 = queryNorm
             0.24497987 = fieldWeight in 772, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=772)
       0.4 = coord(10/25)