Document (#7959)

Author

Su, L.T.

Title

Is relevance an adequate criterion for retrieval system evaluation : an empirical enquiry into the user's evaluation

Source

Integrating technologies - converging professions: proceedings of the 56th Annual Meeting of the American Society for Information Science, Columbus, OH, 24-28 October 1993. Ed.: S. Bonzi

Imprint

Medford, NJ : Learned Information

Year

1993

Pages

S.93-104

Abstract

Considers whether relevance is an adequate criterion for retrieval system evaluation. Addresses this question by providing a brief review of the information retrieval literature and by presenting some empirical evidence collected in an earlier study concerning user's assessment of retrieval system performance. Identifies a total of 26 success dimensions through content analysis of 203 users' reasons for system success. The user's judgement of system performance is a multi-dimensional assessment. Although relevance is an important criterion, there are many other considerations affecting assessments of the system success. Discusses dimensions or categories of success related to as well as those not related to relevance. Compares the results from content analysis of verbal data with those from factor analysis of quantitative data. Discusses implications and future research

Similar documents (content)

1. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.48

   0.4821833 = sum of:
     0.4821833 = product of:
       1.0045485 = sum of:
         0.022652378 = weight(abstract_txt:data in 6932) [ClassicSimilarity], result of:
           0.022652378 = score(doc=6932,freq=4.0), product of:
             0.06219022 = queryWeight, product of:
               1.0233449 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.018248469 = queryNorm
             0.36424342 = fieldWeight in 6932, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.074995644 = weight(abstract_txt:verbal in 6932) [ClassicSimilarity], result of:
           0.074995644 = score(doc=6932,freq=2.0), product of:
             0.13814555 = queryWeight, product of:
               1.0784858 = boost
               7.019336 = idf(docFreq=107, maxDocs=44421)
               0.018248469 = queryNorm
             0.5428741 = fieldWeight in 6932, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.019336 = idf(docFreq=107, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.022390801 = weight(abstract_txt:content in 6932) [ClassicSimilarity], result of:
           0.022390801 = score(doc=6932,freq=1.0), product of:
             0.09795937 = queryWeight, product of:
               1.2843517 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.018248469 = queryNorm
             0.22857234 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.022690568 = weight(abstract_txt:related in 6932) [ClassicSimilarity], result of:
           0.022690568 = score(doc=6932,freq=1.0), product of:
             0.09883174 = queryWeight, product of:
               1.2900579 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.018248469 = queryNorm
             0.22958785 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.03023576 = weight(abstract_txt:performance in 6932) [ClassicSimilarity], result of:
           0.03023576 = score(doc=6932,freq=1.0), product of:
             0.11967777 = queryWeight, product of:
               1.4196056 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.018248469 = queryNorm
             0.25264308 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.038605455 = weight(abstract_txt:analysis in 6932) [ClassicSimilarity], result of:
           0.038605455 = score(doc=6932,freq=3.0), product of:
             0.111794904 = queryWeight, product of:
               1.6804191 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.018248469 = queryNorm
             0.34532392 = fieldWeight in 6932, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.07162122 = weight(abstract_txt:evaluation in 6932) [ClassicSimilarity], result of:
           0.07162122 = score(doc=6932,freq=3.0), product of:
             0.16879155 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018248469 = queryNorm
             0.42431757 = fieldWeight in 6932, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.03644472 = weight(abstract_txt:retrieval in 6932) [ClassicSimilarity], result of:
           0.03644472 = score(doc=6932,freq=2.0), product of:
             0.1355468 = queryWeight, product of:
               2.1365871 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018248469 = queryNorm
             0.26887184 = fieldWeight in 6932, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.20316234 = weight(abstract_txt:user's in 6932) [ClassicSimilarity], result of:
           0.20316234 = score(doc=6932,freq=5.0), product of:
             0.28527832 = queryWeight, product of:
               2.6843615 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.018248469 = queryNorm
             0.71215487 = fieldWeight in 6932, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.07346999 = weight(abstract_txt:relevance in 6932) [ClassicSimilarity], result of:
           0.07346999 = score(doc=6932,freq=1.0), product of:
             0.27253118 = queryWeight, product of:
               3.0295916 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018248469 = queryNorm
             0.2695838 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.1972532 = weight(abstract_txt:success in 6932) [ClassicSimilarity], result of:
           0.1972532 = score(doc=6932,freq=3.0), product of:
             0.36502156 = queryWeight, product of:
               3.5061882 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.018248469 = queryNorm
             0.5403878 = fieldWeight in 6932, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.21102645 = weight(abstract_txt:criterion in 6932) [ClassicSimilarity], result of:
           0.21102645 = score(doc=6932,freq=1.0), product of:
             0.5003277 = queryWeight, product of:
               3.5549533 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.018248469 = queryNorm
             0.42177644 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
       0.48 = coord(12/25)
   

2. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.25

   0.25192484 = sum of:
     0.25192484 = product of:
       0.7872651 = sum of:
         0.025932077 = weight(abstract_txt:related in 5435) [ClassicSimilarity], result of:
           0.025932077 = score(doc=5435,freq=1.0), product of:
             0.09883174 = queryWeight, product of:
               1.2900579 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.018248469 = queryNorm
             0.2623861 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.028036898 = weight(abstract_txt:those in 5435) [ClassicSimilarity], result of:
           0.028036898 = score(doc=5435,freq=1.0), product of:
             0.10410979 = queryWeight, product of:
               1.3240572 = boost
               4.3088202 = idf(docFreq=1623, maxDocs=44421)
               0.018248469 = queryNorm
             0.26930127 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3088202 = idf(docFreq=1623, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.025472995 = weight(abstract_txt:analysis in 5435) [ClassicSimilarity], result of:
           0.025472995 = score(doc=5435,freq=1.0), product of:
             0.111794904 = queryWeight, product of:
               1.6804191 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.018248469 = queryNorm
             0.2278547 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.04725775 = weight(abstract_txt:evaluation in 5435) [ClassicSimilarity], result of:
           0.04725775 = score(doc=5435,freq=1.0), product of:
             0.16879155 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018248469 = queryNorm
             0.279977 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.118745424 = weight(abstract_txt:relevance in 5435) [ClassicSimilarity], result of:
           0.118745424 = score(doc=5435,freq=2.0), product of:
             0.27253118 = queryWeight, product of:
               3.0295916 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018248469 = queryNorm
             0.43571317 = fieldWeight in 5435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.04034022 = weight(abstract_txt:system in 5435) [ClassicSimilarity], result of:
           0.04034022 = score(doc=5435,freq=1.0), product of:
             0.19136867 = queryWeight, product of:
               3.1092598 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018248469 = queryNorm
             0.21079844 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.26030672 = weight(abstract_txt:success in 5435) [ClassicSimilarity], result of:
           0.26030672 = score(doc=5435,freq=4.0), product of:
             0.36502156 = queryWeight, product of:
               3.5061882 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.018248469 = queryNorm
             0.71312696 = fieldWeight in 5435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.24117307 = weight(abstract_txt:criterion in 5435) [ClassicSimilarity], result of:
           0.24117307 = score(doc=5435,freq=1.0), product of:
             0.5003277 = queryWeight, product of:
               3.5549533 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.018248469 = queryNorm
             0.4820302 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
       0.32 = coord(8/25)
   

3. Brooks, T.A.: Relevance auras : macro patterns and micro scatter (2001) 0.22

   0.22259475 = sum of:
     0.22259475 = product of:
       0.6956086 = sum of:
         0.012944216 = weight(abstract_txt:data in 2591) [ClassicSimilarity], result of:
           0.012944216 = score(doc=2591,freq=1.0), product of:
             0.06219022 = queryWeight, product of:
               1.0233449 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.018248469 = queryNorm
             0.20813909 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.07830602 = weight(abstract_txt:dimensional in 2591) [ClassicSimilarity], result of:
           0.07830602 = score(doc=2591,freq=2.0), product of:
             0.13007137 = queryWeight, product of:
               1.0464942 = boost
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.018248469 = queryNorm
             0.6020235 = fieldWeight in 2591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.1080072 = weight(abstract_txt:assessments in 2591) [ClassicSimilarity], result of:
           0.1080072 = score(doc=2591,freq=3.0), product of:
             0.14079578 = queryWeight, product of:
               1.0887817 = boost
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.018248469 = queryNorm
             0.7671196 = fieldWeight in 2591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.036673494 = weight(abstract_txt:related in 2591) [ClassicSimilarity], result of:
           0.036673494 = score(doc=2591,freq=2.0), product of:
             0.09883174 = queryWeight, product of:
               1.2900579 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.018248469 = queryNorm
             0.37107 = fieldWeight in 2591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.04932714 = weight(abstract_txt:empirical in 2591) [ClassicSimilarity], result of:
           0.04932714 = score(doc=2591,freq=1.0), product of:
             0.15172677 = queryWeight, product of:
               1.5984243 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.018248469 = queryNorm
             0.32510504 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.025472995 = weight(abstract_txt:analysis in 2591) [ClassicSimilarity], result of:
           0.025472995 = score(doc=2591,freq=1.0), product of:
             0.111794904 = queryWeight, product of:
               1.6804191 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.018248469 = queryNorm
             0.2278547 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.09401191 = weight(abstract_txt:assessment in 2591) [ClassicSimilarity], result of:
           0.09401191 = score(doc=2591,freq=2.0), product of:
             0.18511865 = queryWeight, product of:
               1.7655746 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.018248469 = queryNorm
             0.5078468 = fieldWeight in 2591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
         0.2908657 = weight(abstract_txt:relevance in 2591) [ClassicSimilarity], result of:
           0.2908657 = score(doc=2591,freq=12.0), product of:
             0.27253118 = queryWeight, product of:
               3.0295916 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018248469 = queryNorm
             1.0672749 = fieldWeight in 2591, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=2591)
       0.32 = coord(8/25)
   

4. Maglaughlin, K.L.; Sonnenwald, D.H.: User perspectives an relevance criteria : a comparison among relevant, partially relevant, and not-relevant judgements (2002) 0.22

   0.22207728 = sum of:
     0.22207728 = product of:
       0.925322 = sum of:
         0.15373667 = weight(abstract_txt:judgement in 201) [ClassicSimilarity], result of:
           0.15373667 = score(doc=201,freq=2.0), product of:
             0.17575051 = queryWeight, product of:
               1.21645 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.018248469 = queryNorm
             0.8747438 = fieldWeight in 201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
         0.03198686 = weight(abstract_txt:content in 201) [ClassicSimilarity], result of:
           0.03198686 = score(doc=201,freq=1.0), product of:
             0.09795937 = queryWeight, product of:
               1.2843517 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.018248469 = queryNorm
             0.3265319 = fieldWeight in 201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
         0.032415096 = weight(abstract_txt:related in 201) [ClassicSimilarity], result of:
           0.032415096 = score(doc=201,freq=1.0), product of:
             0.09883174 = queryWeight, product of:
               1.2900579 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.018248469 = queryNorm
             0.32798263 = fieldWeight in 201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
         0.13241382 = weight(abstract_txt:adequate in 201) [ClassicSimilarity], result of:
           0.13241382 = score(doc=201,freq=1.0), product of:
             0.25255373 = queryWeight, product of:
               2.0622337 = boost
               6.7110353 = idf(docFreq=146, maxDocs=44421)
               0.018248469 = queryNorm
             0.5242996 = fieldWeight in 201, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7110353 = idf(docFreq=146, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
         0.1484318 = weight(abstract_txt:relevance in 201) [ClassicSimilarity], result of:
           0.1484318 = score(doc=201,freq=2.0), product of:
             0.27253118 = queryWeight, product of:
               3.0295916 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018248469 = queryNorm
             0.5446415 = fieldWeight in 201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
         0.42633778 = weight(abstract_txt:criterion in 201) [ClassicSimilarity], result of:
           0.42633778 = score(doc=201,freq=2.0), product of:
             0.5003277 = queryWeight, product of:
               3.5549533 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.018248469 = queryNorm
             0.85211706 = fieldWeight in 201, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.078125 = fieldNorm(doc=201)
       0.24 = coord(6/25)
   

5. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.19

   0.18842342 = sum of:
     0.18842342 = product of:
       0.6729408 = sum of:
         0.011326189 = weight(abstract_txt:data in 3592) [ClassicSimilarity], result of:
           0.011326189 = score(doc=3592,freq=1.0), product of:
             0.06219022 = queryWeight, product of:
               1.0233449 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.018248469 = queryNorm
             0.18212171 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.041350532 = weight(abstract_txt:evaluation in 3592) [ClassicSimilarity], result of:
           0.041350532 = score(doc=3592,freq=1.0), product of:
             0.16879155 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018248469 = queryNorm
             0.24497987 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.03644472 = weight(abstract_txt:retrieval in 3592) [ClassicSimilarity], result of:
           0.03644472 = score(doc=3592,freq=2.0), product of:
             0.1355468 = queryWeight, product of:
               2.1365871 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.018248469 = queryNorm
             0.26887184 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.12849113 = weight(abstract_txt:user's in 3592) [ClassicSimilarity], result of:
           0.12849113 = score(doc=3592,freq=2.0), product of:
             0.28527832 = queryWeight, product of:
               2.6843615 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.018248469 = queryNorm
             0.45040625 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.19438331 = weight(abstract_txt:relevance in 3592) [ClassicSimilarity], result of:
           0.19438331 = score(doc=3592,freq=7.0), product of:
             0.27253118 = queryWeight, product of:
               3.0295916 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018248469 = queryNorm
             0.71325165 = fieldWeight in 3592, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.04991847 = weight(abstract_txt:system in 3592) [ClassicSimilarity], result of:
           0.04991847 = score(doc=3592,freq=2.0), product of:
             0.19136867 = queryWeight, product of:
               3.1092598 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018248469 = queryNorm
             0.26084974 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.21102645 = weight(abstract_txt:criterion in 3592) [ClassicSimilarity], result of:
           0.21102645 = score(doc=3592,freq=1.0), product of:
             0.5003277 = queryWeight, product of:
               3.5549533 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.018248469 = queryNorm
             0.42177644 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
       0.28 = coord(7/25)