Document (#34027)

Author
Petrelli, D.
Title
On the role of user-centred evaluation in the advancement of interactive information retrieval
Source
Information processing and management. 44(2008) no.1, S.22-38
Year
2008
Abstract
This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.
Footnote
Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems
Theme
Retrievalstudien

Similar documents (content)

  1. Petrelli, D.; Levin, S.; Beaulieu, M.; Sanderson, M.: Which user interaction for cross-language information retrieval? : design issues and reflections (2006) 0.35 
    0.35043335 = sum of:
  0.35043335 = product of:
    0.8760834 = sum of:
      0.101530716 = weight(abstract_txt:instrumental in 53) [ClassicSimilarity], result of:
        0.101530716 = score(doc=53,freq=1.0), product of:
          0.16008885 = queryWeight, product of:
            1.047447 = boost
            8.117949 = idf(docFreq=35, maxDocs=44421)
            0.018827071 = queryNorm
          0.63421476 = fieldWeight in 53, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.117949 = idf(docFreq=35, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.0431971 = weight(abstract_txt:during in 53) [ClassicSimilarity], result of:
        0.0431971 = score(doc=53,freq=1.0), product of:
          0.11409744 = queryWeight, product of:
            1.2505597 = boost
            4.846059 = idf(docFreq=948, maxDocs=44421)
            0.018827071 = queryNorm
          0.37859833 = fieldWeight in 53, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.846059 = idf(docFreq=948, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.047820162 = weight(abstract_txt:view in 53) [ClassicSimilarity], result of:
        0.047820162 = score(doc=53,freq=1.0), product of:
          0.1220994 = queryWeight, product of:
            1.2936692 = boost
            5.013113 = idf(docFreq=802, maxDocs=44421)
            0.018827071 = queryNorm
          0.39164945 = fieldWeight in 53, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.013113 = idf(docFreq=802, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.030892774 = weight(abstract_txt:system in 53) [ClassicSimilarity], result of:
        0.030892774 = score(doc=53,freq=2.0), product of:
          0.0829019 = queryWeight, product of:
            1.3055526 = boost
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.018827071 = queryNorm
          0.37264252 = fieldWeight in 53, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.01899315 = weight(abstract_txt:information in 53) [ClassicSimilarity], result of:
        0.01899315 = score(doc=53,freq=2.0), product of:
          0.07106801 = queryWeight, product of:
            1.5605352 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018827071 = queryNorm
          0.26725316 = fieldWeight in 53, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.082627855 = weight(abstract_txt:language in 53) [ClassicSimilarity], result of:
        0.082627855 = score(doc=53,freq=4.0), product of:
          0.1267849 = queryWeight, product of:
            1.6145291 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.018827071 = queryNorm
          0.6517168 = fieldWeight in 53, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.1732893 = weight(abstract_txt:cross in 53) [ClassicSimilarity], result of:
        0.1732893 = score(doc=53,freq=3.0), product of:
          0.22863567 = queryWeight, product of:
            2.168124 = boost
            5.6011486 = idf(docFreq=445, maxDocs=44421)
            0.018827071 = queryNorm
          0.75792766 = fieldWeight in 53, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.6011486 = idf(docFreq=445, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.0690583 = weight(abstract_txt:retrieval in 53) [ClassicSimilarity], result of:
        0.0690583 = score(doc=53,freq=3.0), product of:
          0.14679897 = queryWeight, product of:
            2.2428384 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018827071 = queryNorm
          0.4704277 = fieldWeight in 53, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.08196719 = weight(abstract_txt:user in 53) [ClassicSimilarity], result of:
        0.08196719 = score(doc=53,freq=3.0), product of:
          0.16456562 = queryWeight, product of:
            2.3746853 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018827071 = queryNorm
          0.4980821 = fieldWeight in 53, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
      0.22670677 = weight(abstract_txt:evaluations in 53) [ClassicSimilarity], result of:
        0.22670677 = score(doc=53,freq=1.0), product of:
          0.434136 = queryWeight, product of:
            3.4498036 = boost
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.018827071 = queryNorm
          0.5222022 = fieldWeight in 53, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.078125 = fieldNorm(doc=53)
    0.4 = coord(10/25)
  2. Díaz, A.; García, A.; Gervás, P.: User-centred versus system-centred evaluation of a personalization system (2008) 0.31 
    0.30952957 = sum of:
  0.30952957 = product of:
    1.1054628 = sum of:
      0.054592818 = weight(abstract_txt:evaluation in 3094) [ClassicSimilarity], result of:
        0.054592818 = score(doc=3094,freq=4.0), product of:
          0.09749518 = queryWeight, product of:
            1.1560006 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018827071 = queryNorm
          0.559954 = fieldWeight in 3094, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.03455768 = weight(abstract_txt:during in 3094) [ClassicSimilarity], result of:
        0.03455768 = score(doc=3094,freq=1.0), product of:
          0.11409744 = queryWeight, product of:
            1.2505597 = boost
            4.846059 = idf(docFreq=948, maxDocs=44421)
            0.018827071 = queryNorm
          0.30287868 = fieldWeight in 3094, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.846059 = idf(docFreq=948, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.046236068 = weight(abstract_txt:system in 3094) [ClassicSimilarity], result of:
        0.046236068 = score(doc=3094,freq=7.0), product of:
          0.0829019 = queryWeight, product of:
            1.3055526 = boost
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.018827071 = queryNorm
          0.55772024 = fieldWeight in 3094, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.010744149 = weight(abstract_txt:information in 3094) [ClassicSimilarity], result of:
        0.010744149 = score(doc=3094,freq=1.0), product of:
          0.07106801 = queryWeight, product of:
            1.5605352 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018827071 = queryNorm
          0.15118122 = fieldWeight in 3094, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.0927353 = weight(abstract_txt:user in 3094) [ClassicSimilarity], result of:
        0.0927353 = score(doc=3094,freq=6.0), product of:
          0.16456562 = queryWeight, product of:
            2.3746853 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018827071 = queryNorm
          0.5635156 = fieldWeight in 3094, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.18136542 = weight(abstract_txt:evaluations in 3094) [ClassicSimilarity], result of:
        0.18136542 = score(doc=3094,freq=1.0), product of:
          0.434136 = queryWeight, product of:
            3.4498036 = boost
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.018827071 = queryNorm
          0.41776174 = fieldWeight in 3094, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
      0.6852313 = weight(abstract_txt:centred in 3094) [ClassicSimilarity], result of:
        0.6852313 = score(doc=3094,freq=7.0), product of:
          0.5505308 = queryWeight, product of:
            3.8848324 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.018827071 = queryNorm
          1.244674 = fieldWeight in 3094, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.0625 = fieldNorm(doc=3094)
    0.28 = coord(7/25)
  3. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.26 
    0.2583644 = sum of:
  0.2583644 = product of:
    0.8073888 = sum of:
      0.06141692 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
        0.06141692 = score(doc=3019,freq=9.0), product of:
          0.09749518 = queryWeight, product of:
            1.1560006 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018827071 = queryNorm
          0.62994826 = fieldWeight in 3019, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.018535664 = weight(abstract_txt:system in 3019) [ClassicSimilarity], result of:
        0.018535664 = score(doc=3019,freq=2.0), product of:
          0.0829019 = queryWeight, product of:
            1.3055526 = boost
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.018827071 = queryNorm
          0.2235855 = fieldWeight in 3019, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.06769986 = weight(abstract_txt:interactive in 3019) [ClassicSimilarity], result of:
        0.06769986 = score(doc=3019,freq=3.0), product of:
          0.15004565 = queryWeight, product of:
            1.4340959 = boost
            5.557282 = idf(docFreq=465, maxDocs=44421)
            0.018827071 = queryNorm
          0.45119506 = fieldWeight in 3019, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.557282 = idf(docFreq=465, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.008058111 = weight(abstract_txt:information in 3019) [ClassicSimilarity], result of:
        0.008058111 = score(doc=3019,freq=1.0), product of:
          0.07106801 = queryWeight, product of:
            1.5605352 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018827071 = queryNorm
          0.113385916 = fieldWeight in 3019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.041434977 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
        0.041434977 = score(doc=3019,freq=3.0), product of:
          0.14679897 = queryWeight, product of:
            2.2428384 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018827071 = queryNorm
          0.2822566 = fieldWeight in 3019, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.063491516 = weight(abstract_txt:user in 3019) [ClassicSimilarity], result of:
        0.063491516 = score(doc=3019,freq=5.0), product of:
          0.16456562 = queryWeight, product of:
            2.3746853 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018827071 = queryNorm
          0.38581276 = fieldWeight in 3019, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.27204812 = weight(abstract_txt:evaluations in 3019) [ClassicSimilarity], result of:
        0.27204812 = score(doc=3019,freq=4.0), product of:
          0.434136 = queryWeight, product of:
            3.4498036 = boost
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.018827071 = queryNorm
          0.6266426 = fieldWeight in 3019, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.27470365 = weight(abstract_txt:centred in 3019) [ClassicSimilarity], result of:
        0.27470365 = score(doc=3019,freq=2.0), product of:
          0.5505308 = queryWeight, product of:
            3.8848324 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.018827071 = queryNorm
          0.49897966 = fieldWeight in 3019, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
    0.32 = coord(8/25)
  4. TREC: experiment and evaluation in information retrieval (2005) 0.18 
    0.1771489 = sum of:
  0.1771489 = product of:
    0.5535903 = sum of:
      0.03860295 = weight(abstract_txt:evaluation in 761) [ClassicSimilarity], result of:
        0.03860295 = score(doc=761,freq=2.0), product of:
          0.09749518 = queryWeight, product of:
            1.1560006 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018827071 = queryNorm
          0.39594725 = fieldWeight in 761, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.029038496 = weight(abstract_txt:impact in 761) [ClassicSimilarity], result of:
        0.029038496 = score(doc=761,freq=1.0), product of:
          0.10160044 = queryWeight, product of:
            1.1800877 = boost
            4.572972 = idf(docFreq=1246, maxDocs=44421)
            0.018827071 = queryNorm
          0.28581074 = fieldWeight in 761, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.572972 = idf(docFreq=1246, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.052115373 = weight(abstract_txt:interactive in 761) [ClassicSimilarity], result of:
        0.052115373 = score(doc=761,freq=1.0), product of:
          0.15004565 = queryWeight, product of:
            1.4340959 = boost
            5.557282 = idf(docFreq=465, maxDocs=44421)
            0.018827071 = queryNorm
          0.34733012 = fieldWeight in 761, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.557282 = idf(docFreq=465, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.01519452 = weight(abstract_txt:information in 761) [ClassicSimilarity], result of:
        0.01519452 = score(doc=761,freq=2.0), product of:
          0.07106801 = queryWeight, product of:
            1.5605352 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018827071 = queryNorm
          0.21380253 = fieldWeight in 761, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.046741374 = weight(abstract_txt:language in 761) [ClassicSimilarity], result of:
        0.046741374 = score(doc=761,freq=2.0), product of:
          0.1267849 = queryWeight, product of:
            1.6145291 = boost
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.018827071 = queryNorm
          0.3686667 = fieldWeight in 761, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.1709876 = idf(docFreq=1863, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.0800389 = weight(abstract_txt:cross in 761) [ClassicSimilarity], result of:
        0.0800389 = score(doc=761,freq=1.0), product of:
          0.22863567 = queryWeight, product of:
            2.168124 = boost
            5.6011486 = idf(docFreq=445, maxDocs=44421)
            0.018827071 = queryNorm
          0.3500718 = fieldWeight in 761, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.6011486 = idf(docFreq=445, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.11049328 = weight(abstract_txt:retrieval in 761) [ClassicSimilarity], result of:
        0.11049328 = score(doc=761,freq=12.0), product of:
          0.14679897 = queryWeight, product of:
            2.2428384 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018827071 = queryNorm
          0.7526843 = fieldWeight in 761, product of:
            3.4641016 = tf(freq=12.0), with freq of:
              12.0 = termFreq=12.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
      0.18136542 = weight(abstract_txt:evaluations in 761) [ClassicSimilarity], result of:
        0.18136542 = score(doc=761,freq=1.0), product of:
          0.434136 = queryWeight, product of:
            3.4498036 = boost
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.018827071 = queryNorm
          0.41776174 = fieldWeight in 761, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.0625 = fieldNorm(doc=761)
    0.32 = coord(8/25)
  5. Gross, M.: ¬The imposed query : implications for library service evaluation (1998) 0.17 
    0.16971011 = sum of:
  0.16971011 = product of:
    0.5303441 = sum of:
      0.06824102 = weight(abstract_txt:evaluation in 4702) [ClassicSimilarity], result of:
        0.06824102 = score(doc=4702,freq=4.0), product of:
          0.09749518 = queryWeight, product of:
            1.1560006 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018827071 = queryNorm
          0.69994247 = fieldWeight in 4702, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.03629812 = weight(abstract_txt:impact in 4702) [ClassicSimilarity], result of:
        0.03629812 = score(doc=4702,freq=1.0), product of:
          0.10160044 = queryWeight, product of:
            1.1800877 = boost
            4.572972 = idf(docFreq=1246, maxDocs=44421)
            0.018827071 = queryNorm
          0.35726342 = fieldWeight in 4702, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.572972 = idf(docFreq=1246, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.037505567 = weight(abstract_txt:possible in 4702) [ClassicSimilarity], result of:
        0.037505567 = score(doc=4702,freq=1.0), product of:
          0.10384126 = queryWeight, product of:
            1.1930302 = boost
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.018827071 = queryNorm
          0.36118174 = fieldWeight in 4702, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.021844491 = weight(abstract_txt:system in 4702) [ClassicSimilarity], result of:
        0.021844491 = score(doc=4702,freq=1.0), product of:
          0.0829019 = queryWeight, product of:
            1.3055526 = boost
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.018827071 = queryNorm
          0.26349807 = fieldWeight in 4702, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.372775 = idf(docFreq=4140, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.023261763 = weight(abstract_txt:information in 4702) [ClassicSimilarity], result of:
        0.023261763 = score(doc=4702,freq=3.0), product of:
          0.07106801 = queryWeight, product of:
            1.5605352 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018827071 = queryNorm
          0.32731694 = fieldWeight in 4702, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.04956045 = weight(abstract_txt:role in 4702) [ClassicSimilarity], result of:
        0.04956045 = score(doc=4702,freq=1.0), product of:
          0.14313969 = queryWeight, product of:
            1.7155056 = boost
            4.431851 = idf(docFreq=1435, maxDocs=44421)
            0.018827071 = queryNorm
          0.34623834 = fieldWeight in 4702, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.431851 = idf(docFreq=1435, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.066925935 = weight(abstract_txt:user in 4702) [ClassicSimilarity], result of:
        0.066925935 = score(doc=4702,freq=2.0), product of:
          0.16456562 = queryWeight, product of:
            2.3746853 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018827071 = queryNorm
          0.40668234 = fieldWeight in 4702, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
      0.22670677 = weight(abstract_txt:evaluations in 4702) [ClassicSimilarity], result of:
        0.22670677 = score(doc=4702,freq=1.0), product of:
          0.434136 = queryWeight, product of:
            3.4498036 = boost
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.018827071 = queryNorm
          0.5222022 = fieldWeight in 4702, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.684188 = idf(docFreq=150, maxDocs=44421)
            0.078125 = fieldNorm(doc=4702)
    0.32 = coord(8/25)