Document (#7302)

Author

Smithson, S.

Title

Information retrieval evaluation in practice : a case study approach

Source

Information processing and management. 30(1994) no.2, S.205-221

Year

1994

Abstract

The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of 'real' users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgements and satisfaction ratings. The study demonstrates considerable variations among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question

Theme

Retrievalstudien

Similar documents (content)

1. Lopatovska, I.; Mokros, H.B.: Willingness to pay and experienced utility as measures of affective value of information objects : users' accounts (2008) 0.31

   0.3063086 = sum of:
     0.3063086 = product of:
       0.7657715 = sum of:
         0.022041874 = weight(abstract_txt:retrieval in 3025) [ClassicSimilarity], result of:
           0.022041874 = score(doc=3025,freq=1.0), product of:
             0.08115518 = queryWeight, product of:
               1.0745927 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021723516 = queryNorm
             0.27160156 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.019289775 = weight(abstract_txt:information in 3025) [ClassicSimilarity], result of:
           0.019289775 = score(doc=3025,freq=3.0), product of:
             0.058933016 = queryWeight, product of:
               1.1215296 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.021723516 = queryNorm
             0.32731694 = fieldWeight in 3025, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.025714016 = weight(abstract_txt:different in 3025) [ClassicSimilarity], result of:
           0.025714016 = score(doc=3025,freq=1.0), product of:
             0.08993536 = queryWeight, product of:
               1.1312302 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.021723516 = queryNorm
             0.28591663 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.1477496 = weight(abstract_txt:ratings in 3025) [ClassicSimilarity], result of:
           0.1477496 = score(doc=3025,freq=2.0), product of:
             0.18175295 = queryWeight, product of:
               1.1371336 = boost
               7.357662 = idf(docFreq=76, maxDocs=44421)
               0.021723516 = queryNorm
             0.8129145 = fieldWeight in 3025, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.357662 = idf(docFreq=76, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.038602564 = weight(abstract_txt:within in 3025) [ClassicSimilarity], result of:
           0.038602564 = score(doc=3025,freq=1.0), product of:
             0.1179129 = queryWeight, product of:
               1.2952882 = boost
               4.19049 = idf(docFreq=1827, maxDocs=44421)
               0.021723516 = queryNorm
             0.32738203 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.19049 = idf(docFreq=1827, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.055940382 = weight(abstract_txt:same in 3025) [ClassicSimilarity], result of:
           0.055940382 = score(doc=3025,freq=1.0), product of:
             0.15099671 = queryWeight, product of:
               1.4657824 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.021723516 = queryNorm
             0.37047416 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.16749768 = weight(abstract_txt:measures in 3025) [ClassicSimilarity], result of:
           0.16749768 = score(doc=3025,freq=4.0), product of:
             0.19760735 = queryWeight, product of:
               1.6768233 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.021723516 = queryNorm
             0.8476288 = fieldWeight in 3025, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.041202758 = weight(abstract_txt:approach in 3025) [ClassicSimilarity], result of:
           0.041202758 = score(doc=3025,freq=1.0), product of:
             0.14097168 = queryWeight, product of:
               1.7345918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021723516 = queryNorm
             0.29227686 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.05910367 = weight(abstract_txt:study in 3025) [ClassicSimilarity], result of:
           0.05910367 = score(doc=3025,freq=2.0), product of:
             0.15663671 = queryWeight, product of:
               2.1112883 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.021723516 = queryNorm
             0.37732962 = fieldWeight in 3025, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
         0.18862912 = weight(abstract_txt:evaluation in 3025) [ClassicSimilarity], result of:
           0.18862912 = score(doc=3025,freq=1.0), product of:
             0.53898466 = queryWeight, product of:
               5.5386505 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021723516 = queryNorm
             0.34997123 = fieldWeight in 3025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3025)
       0.4 = coord(10/25)
   

2. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.26

   0.26318693 = sum of:
     0.26318693 = product of:
       0.9399533 = sum of:
         0.16378568 = weight(abstract_txt:variations in 3307) [ClassicSimilarity], result of:
           0.16378568 = score(doc=3307,freq=3.0), product of:
             0.15060173 = queryWeight, product of:
               1.0351082 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.021723516 = queryNorm
             1.0875418 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.0529005 = weight(abstract_txt:retrieval in 3307) [ClassicSimilarity], result of:
           0.0529005 = score(doc=3307,freq=4.0), product of:
             0.08115518 = queryWeight, product of:
               1.0745927 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021723516 = queryNorm
             0.6518438 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.013364348 = weight(abstract_txt:information in 3307) [ClassicSimilarity], result of:
           0.013364348 = score(doc=3307,freq=1.0), product of:
             0.058933016 = queryWeight, product of:
               1.1215296 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.021723516 = queryNorm
             0.22677183 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.25766623 = weight(abstract_txt:judgements in 3307) [ClassicSimilarity], result of:
           0.25766623 = score(doc=3307,freq=4.0), product of:
             0.18508507 = queryWeight, product of:
               1.1475099 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.021723516 = queryNorm
             1.3921503 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.08710349 = weight(abstract_txt:among in 3307) [ClassicSimilarity], result of:
           0.08710349 = score(doc=3307,freq=1.0), product of:
             0.20562877 = queryWeight, product of:
               2.0949483 = boost
               4.518356 = idf(docFreq=1316, maxDocs=44421)
               0.021723516 = queryNorm
             0.42359585 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.518356 = idf(docFreq=1316, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.13877808 = weight(abstract_txt:case in 3307) [ClassicSimilarity], result of:
           0.13877808 = score(doc=3307,freq=1.0), product of:
             0.3087358 = queryWeight, product of:
               2.9641094 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.021723516 = queryNorm
             0.44950435 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.22635496 = weight(abstract_txt:evaluation in 3307) [ClassicSimilarity], result of:
           0.22635496 = score(doc=3307,freq=1.0), product of:
             0.53898466 = queryWeight, product of:
               5.5386505 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021723516 = queryNorm
             0.4199655 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
       0.28 = coord(7/25)
   

3. Morse, E.; Lewis, M.; Olsen, K.A.: Testing visual information retrieval methodologies case study : comparative analysis of textual, icon, graphical, and "spring" displays (2002) 0.25

   0.2467361 = sum of:
     0.2467361 = product of:
       0.685378 = sum of:
         0.023250055 = weight(abstract_txt:data in 1191) [ClassicSimilarity], result of:
           0.023250055 = score(doc=1191,freq=1.0), product of:
             0.0744696 = queryWeight, product of:
               1.0293789 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.021723516 = queryNorm
             0.31220865 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.02645025 = weight(abstract_txt:retrieval in 1191) [ClassicSimilarity], result of:
           0.02645025 = score(doc=1191,freq=1.0), product of:
             0.08115518 = queryWeight, product of:
               1.0745927 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021723516 = queryNorm
             0.3259219 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.012489701 = weight(abstract_txt:that in 1191) [ClassicSimilarity], result of:
           0.012489701 = score(doc=1191,freq=1.0), product of:
             0.05633282 = queryWeight, product of:
               1.0965089 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.021723516 = queryNorm
             0.22171268 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.013364348 = weight(abstract_txt:information in 1191) [ClassicSimilarity], result of:
           0.013364348 = score(doc=1191,freq=1.0), product of:
             0.058933016 = queryWeight, product of:
               1.1215296 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.021723516 = queryNorm
             0.22677183 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.030856818 = weight(abstract_txt:different in 1191) [ClassicSimilarity], result of:
           0.030856818 = score(doc=1191,freq=1.0), product of:
             0.08993536 = queryWeight, product of:
               1.1312302 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.021723516 = queryNorm
             0.34309995 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.0699234 = weight(abstract_txt:approach in 1191) [ClassicSimilarity], result of:
           0.0699234 = score(doc=1191,freq=2.0), product of:
             0.14097168 = queryWeight, product of:
               1.7345918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021723516 = queryNorm
             0.49601027 = fieldWeight in 1191, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.050151132 = weight(abstract_txt:study in 1191) [ClassicSimilarity], result of:
           0.050151132 = score(doc=1191,freq=1.0), product of:
             0.15663671 = queryWeight, product of:
               2.1112883 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.021723516 = queryNorm
             0.3201748 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.13877808 = weight(abstract_txt:case in 1191) [ClassicSimilarity], result of:
           0.13877808 = score(doc=1191,freq=1.0), product of:
             0.3087358 = queryWeight, product of:
               2.9641094 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.021723516 = queryNorm
             0.44950435 = fieldWeight in 1191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
         0.32011425 = weight(abstract_txt:evaluation in 1191) [ClassicSimilarity], result of:
           0.32011425 = score(doc=1191,freq=2.0), product of:
             0.53898466 = queryWeight, product of:
               5.5386505 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021723516 = queryNorm
             0.5939209 = fieldWeight in 1191, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=1191)
       0.36 = coord(9/25)
   

4. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.23

   0.23179214 = sum of:
     0.23179214 = product of:
       0.57948035 = sum of:
         0.022906587 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
           0.022906587 = score(doc=3019,freq=3.0), product of:
             0.08115518 = queryWeight, product of:
               1.0745927 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021723516 = queryNorm
             0.2822566 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.010816396 = weight(abstract_txt:that in 3019) [ClassicSimilarity], result of:
           0.010816396 = score(doc=3019,freq=3.0), product of:
             0.05633282 = queryWeight, product of:
               1.0965089 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.021723516 = queryNorm
             0.1920088 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.006682174 = weight(abstract_txt:information in 3019) [ClassicSimilarity], result of:
           0.006682174 = score(doc=3019,freq=1.0), product of:
             0.058933016 = queryWeight, product of:
               1.1215296 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.021723516 = queryNorm
             0.113385916 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.015428409 = weight(abstract_txt:different in 3019) [ClassicSimilarity], result of:
           0.015428409 = score(doc=3019,freq=1.0), product of:
             0.08993536 = queryWeight, product of:
               1.1312302 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.021723516 = queryNorm
             0.17154998 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.040116962 = weight(abstract_txt:within in 3019) [ClassicSimilarity], result of:
           0.040116962 = score(doc=3019,freq=3.0), product of:
             0.1179129 = queryWeight, product of:
               1.2952882 = boost
               4.19049 = idf(docFreq=1827, maxDocs=44421)
               0.021723516 = queryNorm
             0.34022537 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.19049 = idf(docFreq=1827, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.03356423 = weight(abstract_txt:same in 3019) [ClassicSimilarity], result of:
           0.03356423 = score(doc=3019,freq=1.0), product of:
             0.15099671 = queryWeight, product of:
               1.4657824 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.021723516 = queryNorm
             0.2222845 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.050249305 = weight(abstract_txt:measures in 3019) [ClassicSimilarity], result of:
           0.050249305 = score(doc=3019,freq=1.0), product of:
             0.19760735 = queryWeight, product of:
               1.6768233 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.021723516 = queryNorm
             0.25428864 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.024721656 = weight(abstract_txt:approach in 3019) [ClassicSimilarity], result of:
           0.024721656 = score(doc=3019,freq=1.0), product of:
             0.14097168 = queryWeight, product of:
               1.7345918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021723516 = queryNorm
             0.17536612 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.035462204 = weight(abstract_txt:study in 3019) [ClassicSimilarity], result of:
           0.035462204 = score(doc=3019,freq=2.0), product of:
             0.15663671 = queryWeight, product of:
               2.1112883 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.021723516 = queryNorm
             0.22639778 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.33953243 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
           0.33953243 = score(doc=3019,freq=9.0), product of:
             0.53898466 = queryWeight, product of:
               5.5386505 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021723516 = queryNorm
             0.62994826 = fieldWeight in 3019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
       0.4 = coord(10/25)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017) 0.23

   0.2257232 = sum of:
     0.2257232 = product of:
       0.705385 = sum of:
         0.008326466 = weight(abstract_txt:that in 4593) [ClassicSimilarity], result of:
           0.008326466 = score(doc=4593,freq=1.0), product of:
             0.05633282 = queryWeight, product of:
               1.0965089 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.021723516 = queryNorm
             0.14780845 = fieldWeight in 4593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.020571213 = weight(abstract_txt:different in 4593) [ClassicSimilarity], result of:
           0.020571213 = score(doc=4593,freq=1.0), product of:
             0.08993536 = queryWeight, product of:
               1.1312302 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.021723516 = queryNorm
             0.2287333 = fieldWeight in 4593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.19205308 = weight(abstract_txt:judgements in 4593) [ClassicSimilarity], result of:
           0.19205308 = score(doc=4593,freq=5.0), product of:
             0.18508507 = queryWeight, product of:
               1.1475099 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.021723516 = queryNorm
             1.0376476 = fieldWeight in 4593, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.06699907 = weight(abstract_txt:measures in 4593) [ClassicSimilarity], result of:
           0.06699907 = score(doc=4593,freq=1.0), product of:
             0.19760735 = queryWeight, product of:
               1.6768233 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.021723516 = queryNorm
             0.3390515 = fieldWeight in 4593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.10714501 = weight(abstract_txt:cases in 4593) [ClassicSimilarity], result of:
           0.10714501 = score(doc=4593,freq=2.0), product of:
             0.21448416 = queryWeight, product of:
               1.7469616 = boost
               5.6517344 = idf(docFreq=423, maxDocs=44421)
               0.021723516 = queryNorm
             0.49954745 = fieldWeight in 4593, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6517344 = idf(docFreq=423, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.06686818 = weight(abstract_txt:study in 4593) [ClassicSimilarity], result of:
           0.06686818 = score(doc=4593,freq=4.0), product of:
             0.15663671 = queryWeight, product of:
               2.1112883 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.021723516 = queryNorm
             0.42689976 = fieldWeight in 4593, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.09251872 = weight(abstract_txt:case in 4593) [ClassicSimilarity], result of:
           0.09251872 = score(doc=4593,freq=1.0), product of:
             0.3087358 = queryWeight, product of:
               2.9641094 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.021723516 = queryNorm
             0.29966956 = fieldWeight in 4593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
         0.1509033 = weight(abstract_txt:evaluation in 4593) [ClassicSimilarity], result of:
           0.1509033 = score(doc=4593,freq=1.0), product of:
             0.53898466 = queryWeight, product of:
               5.5386505 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021723516 = queryNorm
             0.279977 = fieldWeight in 4593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4593)
       0.32 = coord(8/25)