Document (#34066)

Author

Baillie, M.
Azzopardi, L.
Ruthven, I.

Title

Evaluating epistemic uncertainty under incomplete assessments

Source

Information processing and management. 44(2008) no.2, S.811-837

Year

2008

Abstract

The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology aims to identify potential uncertainty during system comparison that may result from incompleteness. The adoption of this methodology is advantageous, because the detection of epistemic uncertainty - the amount of knowledge (or ignorance) we have about the estimate of a system's performance - during the evaluation process can guide and direct researchers when evaluating new systems over existing and future test collections. Across a series of experiments we demonstrate how this methodology can lead towards a finer grained analysis of systems. In particular, we show through experimentation how the current practice in Information Retrieval evaluation of using a measurement depth larger than the pooling depth increases uncertainty during system comparison.

Theme

Retrievalstudien

Similar documents (author)

1. Ruthven, I.; Baillie, M.; Azzopardi, L.; Bierig, R.; Nicol, E.; Sweeney, S.; Yaciki, M.: Contextual factors affecting the utility of surrogates within exploratory search (2008) 3.97

   3.9745796 = sum of:
     3.9745796 = sum of:
       0.91045415 = weight(author_txt:ruthven in 3042) [ClassicSimilarity], result of:
         0.91045415 = score(doc=3042,freq=1.0), product of:
           0.44706154 = queryWeight, product of:
             8.146119 = idf(docFreq=34, maxDocs=44421)
             0.05488031 = queryNorm
           2.0365298 = fieldWeight in 3042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.146119 = idf(docFreq=34, maxDocs=44421)
             0.25 = fieldNorm(doc=3042)
       1.5003943 = weight(author_txt:azzopardi in 3042) [ClassicSimilarity], result of:
         1.5003943 = score(doc=3042,freq=1.0), product of:
           0.6237332 = queryWeight, product of:
             1.1811792 = boost
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.05488031 = queryNorm
           2.4055066 = fieldWeight in 3042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.25 = fieldNorm(doc=3042)
       1.563731 = weight(author_txt:baillie in 3042) [ClassicSimilarity], result of:
         1.563731 = score(doc=3042,freq=1.0), product of:
           0.6411652 = queryWeight, product of:
             1.1975712 = boost
             9.755557 = idf(docFreq=6, maxDocs=44421)
             0.05488031 = queryNorm
           2.4388893 = fieldWeight in 3042, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.755557 = idf(docFreq=6, maxDocs=44421)
             0.25 = fieldNorm(doc=3042)
   

2. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 2.47

   2.474185 = sum of:
     2.474185 = product of:
       3.7112775 = sum of:
         1.3656813 = weight(author_txt:ruthven in 1835) [ClassicSimilarity], result of:
           1.3656813 = score(doc=1835,freq=1.0), product of:
             0.44706154 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05488031 = queryNorm
             3.0547948 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.375 = fieldNorm(doc=1835)
         2.3455963 = weight(author_txt:baillie in 1835) [ClassicSimilarity], result of:
           2.3455963 = score(doc=1835,freq=1.0), product of:
             0.6411652 = queryWeight, product of:
               1.1975712 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.05488031 = queryNorm
             3.6583338 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.375 = fieldNorm(doc=1835)
       0.6666667 = coord(2/3)
   

3. Lee, M.; Baillie, S.; Dell'Oro, J.: TML: a Thesaural Markpup Language (200?) 0.78

   0.7818655 = sum of:
     0.7818655 = product of:
       2.3455963 = sum of:
         2.3455963 = weight(author_txt:baillie in 2622) [ClassicSimilarity], result of:
           2.3455963 = score(doc=2622,freq=1.0), product of:
             0.6411652 = queryWeight, product of:
               1.1975712 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.05488031 = queryNorm
             3.6583338 = fieldWeight in 2622, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.375 = fieldNorm(doc=2622)
       0.33333334 = coord(1/3)
   

4. Bache, R.; Baillie, M.; Crestani, F.: Measuring the likelihood property of scoring functions in general retrieval models (2009) 0.78

   0.7818655 = sum of:
     0.7818655 = product of:
       2.3455963 = sum of:
         2.3455963 = weight(author_txt:baillie in 3860) [ClassicSimilarity], result of:
           2.3455963 = score(doc=3860,freq=1.0), product of:
             0.6411652 = queryWeight, product of:
               1.1975712 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.05488031 = queryNorm
             3.6583338 = fieldWeight in 3860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.375 = fieldNorm(doc=3860)
       0.33333334 = coord(1/3)
   

5. Htun, N.N.; Halvey, M.; Baillie, L.: Beyond traditional collaborative search : understanding the effect of awareness on multi-level collaborative information retrieval (2018) 0.78

   0.7818655 = sum of:
     0.7818655 = product of:
       2.3455963 = sum of:
         2.3455963 = weight(author_txt:baillie in 94) [ClassicSimilarity], result of:
           2.3455963 = score(doc=94,freq=1.0), product of:
             0.6411652 = queryWeight, product of:
               1.1975712 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.05488031 = queryNorm
             3.6583338 = fieldWeight in 94, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.375 = fieldNorm(doc=94)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Pal, S.; Mitra, M.; Kamps, J.: Evaluation effort, reliability and reusability in XML retrieval (2011) 0.20

   0.2018761 = sum of:
     0.2018761 = product of:
       0.63086283 = sum of:
         0.022650704 = weight(abstract_txt:retrieval in 197) [ClassicSimilarity], result of:
           0.022650704 = score(doc=197,freq=4.0), product of:
             0.059569146 = queryWeight, product of:
               1.0044285 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017059257 = queryNorm
             0.3802422 = fieldWeight in 197, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.18797706 = weight(abstract_txt:pooling in 197) [ClassicSimilarity], result of:
           0.18797706 = score(doc=197,freq=3.0), product of:
             0.21330765 = queryWeight, product of:
               1.3439916 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.017059257 = queryNorm
             0.8812486 = fieldWeight in 197, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.010621454 = weight(abstract_txt:this in 197) [ClassicSimilarity], result of:
           0.010621454 = score(doc=197,freq=2.0), product of:
             0.057074603 = queryWeight, product of:
               1.3904161 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017059257 = queryNorm
             0.18609773 = fieldWeight in 197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.036917362 = weight(abstract_txt:under in 197) [ClassicSimilarity], result of:
           0.036917362 = score(doc=197,freq=1.0), product of:
             0.13096061 = queryWeight, product of:
               1.489288 = boost
               5.154682 = idf(docFreq=696, maxDocs=44421)
               0.017059257 = queryNorm
             0.28189668 = fieldWeight in 197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.154682 = idf(docFreq=696, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.07583954 = weight(abstract_txt:evaluating in 197) [ClassicSimilarity], result of:
           0.07583954 = score(doc=197,freq=2.0), product of:
             0.16797349 = queryWeight, product of:
               1.6866646 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.017059257 = queryNorm
             0.4514971 = fieldWeight in 197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.036344882 = weight(abstract_txt:evaluation in 197) [ClassicSimilarity], result of:
           0.036344882 = score(doc=197,freq=1.0), product of:
             0.14835864 = queryWeight, product of:
               1.9413793 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017059257 = queryNorm
             0.24497987 = fieldWeight in 197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.095916264 = weight(abstract_txt:assessments in 197) [ClassicSimilarity], result of:
           0.095916264 = score(doc=197,freq=1.0), product of:
             0.24750373 = queryWeight, product of:
               2.0473835 = boost
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.017059257 = queryNorm
             0.38753462 = fieldWeight in 197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
         0.16459551 = weight(abstract_txt:incomplete in 197) [ClassicSimilarity], result of:
           0.16459551 = score(doc=197,freq=2.0), product of:
             0.28157166 = queryWeight, product of:
               2.1837494 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.017059257 = queryNorm
             0.58456 = fieldWeight in 197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0546875 = fieldNorm(doc=197)
       0.32 = coord(8/25)
   

2. Golub, K.; Soergel, D.; Buchanan, G.; Tudhope, D.; Lykke, M.; Hiom, D.: ¬A framework for evaluating automatic indexing or classification in the context of retrieval (2016) 0.12

   0.12282679 = sum of:
     0.12282679 = product of:
       0.43866712 = sum of:
         0.018304532 = weight(abstract_txt:retrieval in 4311) [ClassicSimilarity], result of:
           0.018304532 = score(doc=4311,freq=2.0), product of:
             0.059569146 = queryWeight, product of:
               1.0044285 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017059257 = queryNorm
             0.3072821 = fieldWeight in 4311, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.05264772 = weight(abstract_txt:laboratory in 4311) [ClassicSimilarity], result of:
           0.05264772 = score(doc=4311,freq=1.0), product of:
             0.12047641 = queryWeight, product of:
               1.0100534 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.017059257 = queryNorm
             0.4369961 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.008583431 = weight(abstract_txt:this in 4311) [ClassicSimilarity], result of:
           0.008583431 = score(doc=4311,freq=1.0), product of:
             0.057074603 = queryWeight, product of:
               1.3904161 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017059257 = queryNorm
             0.15038967 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.054993447 = weight(abstract_txt:comparison in 4311) [ClassicSimilarity], result of:
           0.054993447 = score(doc=4311,freq=1.0), product of:
             0.15626663 = queryWeight, product of:
               1.6268274 = boost
               5.6307297 = idf(docFreq=432, maxDocs=44421)
               0.017059257 = queryNorm
             0.3519206 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6307297 = idf(docFreq=432, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.122575216 = weight(abstract_txt:evaluating in 4311) [ClassicSimilarity], result of:
           0.122575216 = score(doc=4311,freq=4.0), product of:
             0.16797349 = queryWeight, product of:
               1.6866646 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.017059257 = queryNorm
             0.72972953 = fieldWeight in 4311, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.07194421 = weight(abstract_txt:evaluation in 4311) [ClassicSimilarity], result of:
           0.07194421 = score(doc=4311,freq=3.0), product of:
             0.14835864 = queryWeight, product of:
               1.9413793 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017059257 = queryNorm
             0.48493436 = fieldWeight in 4311, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
         0.10961858 = weight(abstract_txt:assessments in 4311) [ClassicSimilarity], result of:
           0.10961858 = score(doc=4311,freq=1.0), product of:
             0.24750373 = queryWeight, product of:
               2.0473835 = boost
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.017059257 = queryNorm
             0.4428967 = fieldWeight in 4311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.0625 = fieldNorm(doc=4311)
       0.28 = coord(7/25)
   

3. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.11

   0.11055077 = sum of:
     0.11055077 = product of:
       0.4606282 = sum of:
         0.072253935 = weight(abstract_txt:measurement in 3072) [ClassicSimilarity], result of:
           0.072253935 = score(doc=3072,freq=2.0), product of:
             0.11809005 = queryWeight, product of:
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.017059257 = queryNorm
             0.61185455 = fieldWeight in 3072, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.028942008 = weight(abstract_txt:retrieval in 3072) [ClassicSimilarity], result of:
           0.028942008 = score(doc=3072,freq=5.0), product of:
             0.059569146 = queryWeight, product of:
               1.0044285 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017059257 = queryNorm
             0.48585567 = fieldWeight in 3072, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.008583431 = weight(abstract_txt:this in 3072) [ClassicSimilarity], result of:
           0.008583431 = score(doc=3072,freq=1.0), product of:
             0.057074603 = queryWeight, product of:
               1.3904161 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017059257 = queryNorm
             0.15038967 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.059667464 = weight(abstract_txt:under in 3072) [ClassicSimilarity], result of:
           0.059667464 = score(doc=3072,freq=2.0), product of:
             0.13096061 = queryWeight, product of:
               1.489288 = boost
               5.154682 = idf(docFreq=696, maxDocs=44421)
               0.017059257 = queryNorm
             0.45561382 = fieldWeight in 3072, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.154682 = idf(docFreq=696, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.07194421 = weight(abstract_txt:evaluation in 3072) [ClassicSimilarity], result of:
           0.07194421 = score(doc=3072,freq=3.0), product of:
             0.14835864 = queryWeight, product of:
               1.9413793 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017059257 = queryNorm
             0.48493436 = fieldWeight in 3072, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.21923716 = weight(abstract_txt:assessments in 3072) [ClassicSimilarity], result of:
           0.21923716 = score(doc=3072,freq=4.0), product of:
             0.24750373 = queryWeight, product of:
               2.0473835 = boost
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.017059257 = queryNorm
             0.8857934 = fieldWeight in 3072, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.086347 = idf(docFreq=100, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
       0.24 = coord(6/25)
   

4. Rubin, V.L.: Epistemic modality : from uncertainty to certainty in the context of information seeking as interactions with texts (2010) 0.11

   0.1068525 = sum of:
     0.1068525 = product of:
       0.66782814 = sum of:
         0.014866938 = weight(abstract_txt:this in 241) [ClassicSimilarity], result of:
           0.014866938 = score(doc=241,freq=3.0), product of:
             0.057074603 = queryWeight, product of:
               1.3904161 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017059257 = queryNorm
             0.26048255 = fieldWeight in 241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=241)
         0.041537005 = weight(abstract_txt:evaluation in 241) [ClassicSimilarity], result of:
           0.041537005 = score(doc=241,freq=1.0), product of:
             0.14835864 = queryWeight, product of:
               1.9413793 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017059257 = queryNorm
             0.279977 = fieldWeight in 241, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=241)
         0.25615755 = weight(abstract_txt:epistemic in 241) [ClassicSimilarity], result of:
           0.25615755 = score(doc=241,freq=3.0), product of:
             0.3021969 = queryWeight, product of:
               2.2623165 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.017059257 = queryNorm
             0.8476512 = fieldWeight in 241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.0625 = fieldNorm(doc=241)
         0.35526666 = weight(abstract_txt:uncertainty in 241) [ClassicSimilarity], result of:
           0.35526666 = score(doc=241,freq=3.0), product of:
             0.47351256 = queryWeight, product of:
               4.004876 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017059257 = queryNorm
             0.75027925 = fieldWeight in 241, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=241)
       0.16 = coord(4/25)
   

5. Egghe, L.: Sampling and concentration values of incomplete bibliographies (2002) 0.10

   0.10156622 = sum of:
     0.10156622 = product of:
       0.6347889 = sum of:
         0.07663687 = weight(abstract_txt:measurement in 1450) [ClassicSimilarity], result of:
           0.07663687 = score(doc=1450,freq=1.0), product of:
             0.11809005 = queryWeight, product of:
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.017059257 = queryNorm
             0.64896977 = fieldWeight in 1450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.09375 = fieldNorm(doc=1450)
         0.26311308 = weight(abstract_txt:incompleteness in 1450) [ClassicSimilarity], result of:
           0.26311308 = score(doc=1450,freq=2.0), product of:
             0.21330765 = queryWeight, product of:
               1.3439916 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.017059257 = queryNorm
             1.2334911 = fieldWeight in 1450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.09375 = fieldNorm(doc=1450)
         0.012875146 = weight(abstract_txt:this in 1450) [ClassicSimilarity], result of:
           0.012875146 = score(doc=1450,freq=1.0), product of:
             0.057074603 = queryWeight, product of:
               1.3904161 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017059257 = queryNorm
             0.2255845 = fieldWeight in 1450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.09375 = fieldNorm(doc=1450)
         0.28216377 = weight(abstract_txt:incomplete in 1450) [ClassicSimilarity], result of:
           0.28216377 = score(doc=1450,freq=2.0), product of:
             0.28157166 = queryWeight, product of:
               2.1837494 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.017059257 = queryNorm
             1.0021029 = fieldWeight in 1450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.09375 = fieldNorm(doc=1450)
       0.16 = coord(4/25)