Document (#43642)

Author
Breuer, T.
Tavakolpoursaleh, N.
Schaer, P.
Hienert, D.
Schaible, J.
Castro, L.J.
Title
Online Information Retrieval Evaluation using the STELLA Framework
Source
https://www.researchgate.net/publication/364689252_Online_Information_Retrieval_Evaluation_using_the_STELLA_Framework
Year
2022
Abstract
Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning. Once a system is in production, new opportunities to observe, evaluate and learn from users emerge as more information becomes available. Gathering information from users to continuously evaluate their behavior is a common practice for commercial software, while the Cranfield paradigm remains the preferred option for Information Retrieval (IR) and recommendation systems in the academic world. Here we introduce the Infrastructures for Living Labs STELLA project which aims to create an evaluation infrastructure allowing experimental systems to run along production web-based academic search systems with real users. STELLA combines user interactions and log files analyses to enable large-scale A/B experiments for academic search.
Content
Vgl.: DOI: 10.48550/arXiv.2210.13202.
Theme
Retrievalstudien

Similar documents (author)

  1. Keller, K.; Breuer, T.; Schaer, P.: Evaluation of temporal change in IR test collections (2024) 2.74 
    2.7412233 = sum of:
  2.7412233 = product of:
    4.111835 = sum of:
      1.7638313 = weight(author_txt:schaer in 2344) [ClassicSimilarity], result of:
        1.7638313 = score(doc=2344,freq=1.0), product of:
          0.5303806 = queryWeight, product of:
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.05980665 = queryNorm
          3.3255954 = fieldWeight in 2344, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.375 = fieldNorm(doc=2344)
      2.3480039 = weight(author_txt:breuer in 2344) [ClassicSimilarity], result of:
        2.3480039 = score(doc=2344,freq=1.0), product of:
          0.6418233 = queryWeight, product of:
            1.1000538 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.05980665 = queryNorm
          3.6583338 = fieldWeight in 2344, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.375 = fieldNorm(doc=2344)
    0.6666667 = coord(2/3)
  2. Breuer, H.: Gedankenschranken : Freier Wille (2003) 1.30 
    1.3044467 = sum of:
  1.3044467 = product of:
    3.9133399 = sum of:
      3.9133399 = weight(author_txt:breuer in 3361) [ClassicSimilarity], result of:
        3.9133399 = score(doc=3361,freq=1.0), product of:
          0.6418233 = queryWeight, product of:
            1.1000538 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.05980665 = queryNorm
          6.0972233 = fieldWeight in 3361, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.625 = fieldNorm(doc=3361)
    0.33333334 = coord(1/3)
  3. Castro, M.C.P.S.: Communicacao e modernidadde : o impasse antinomica e as possibilidades da polifonia (1993) 1.05 
    1.045686 = sum of:
  1.045686 = product of:
    3.1370578 = sum of:
      3.1370578 = weight(author_txt:castro in 4730) [ClassicSimilarity], result of:
        3.1370578 = score(doc=4730,freq=1.0), product of:
          0.55385846 = queryWeight, product of:
            1.0218934 = boost
            9.06241 = idf(docFreq=13, maxDocs=44421)
            0.05980665 = queryNorm
          5.664006 = fieldWeight in 4730, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.06241 = idf(docFreq=13, maxDocs=44421)
            0.625 = fieldNorm(doc=4730)
    0.33333334 = coord(1/3)
  4. Schaer, P.: Integration von Open-Access-Repositorien in Fachportale (2010) 0.98 
    0.9799063 = sum of:
  0.9799063 = product of:
    2.939719 = sum of:
      2.939719 = weight(author_txt:schaer in 3320) [ClassicSimilarity], result of:
        2.939719 = score(doc=3320,freq=1.0), product of:
          0.5303806 = queryWeight, product of:
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.05980665 = queryNorm
          5.5426593 = fieldWeight in 3320, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.625 = fieldNorm(doc=3320)
    0.33333334 = coord(1/3)
  5. Schaer, P.: Sprachmodelle und neuronale Netze im Information Retrieval (2023) 0.98 
    0.9799063 = sum of:
  0.9799063 = product of:
    2.939719 = sum of:
      2.939719 = weight(author_txt:schaer in 1800) [ClassicSimilarity], result of:
        2.939719 = score(doc=1800,freq=1.0), product of:
          0.5303806 = queryWeight, product of:
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.05980665 = queryNorm
          5.5426593 = fieldWeight in 1800, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.868255 = idf(docFreq=16, maxDocs=44421)
            0.625 = fieldNorm(doc=1800)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Information science in transition (2009) 0.18 
    0.17603952 = sum of:
  0.17603952 = product of:
    0.48899865 = sum of:
      0.015122261 = weight(abstract_txt:retrieval in 1634) [ClassicSimilarity], result of:
        0.015122261 = score(doc=1634,freq=2.0), product of:
          0.06561728 = queryWeight, product of:
            1.0044285 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018791305 = queryNorm
          0.23046157 = fieldWeight in 1634, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.017567456 = weight(abstract_txt:search in 1634) [ClassicSimilarity], result of:
        0.017567456 = score(doc=1634,freq=2.0), product of:
          0.072512515 = queryWeight, product of:
            1.0558845 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.018791305 = queryNorm
          0.2422679 = fieldWeight in 1634, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.012691879 = weight(abstract_txt:user in 1634) [ClassicSimilarity], result of:
        0.012691879 = score(doc=1634,freq=1.0), product of:
          0.07355875 = queryWeight, product of:
            1.0634745 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018791305 = queryNorm
          0.17254071 = fieldWeight in 1634, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.013892178 = weight(abstract_txt:from in 1634) [ClassicSimilarity], result of:
        0.013892178 = score(doc=1634,freq=3.0), product of:
          0.06200889 = queryWeight, product of:
            1.195866 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018791305 = queryNorm
          0.22403526 = fieldWeight in 1634, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.021064397 = weight(abstract_txt:software in 1634) [ClassicSimilarity], result of:
        0.021064397 = score(doc=1634,freq=1.0), product of:
          0.10311371 = queryWeight, product of:
            1.259123 = boost
            4.3580413 = idf(docFreq=1545, maxDocs=44421)
            0.018791305 = queryNorm
          0.20428318 = fieldWeight in 1634, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.3580413 = idf(docFreq=1545, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.022877155 = weight(abstract_txt:evaluation in 1634) [ClassicSimilarity], result of:
        0.022877155 = score(doc=1634,freq=1.0), product of:
          0.10894778 = queryWeight, product of:
            1.2942529 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018791305 = queryNorm
          0.20998275 = fieldWeight in 1634, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.030562911 = weight(abstract_txt:information in 1634) [ClassicSimilarity], result of:
        0.030562911 = score(doc=1634,freq=18.0), product of:
          0.063533 = queryWeight, product of:
            1.3977343 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018791305 = queryNorm
          0.48105568 = fieldWeight in 1634, product of:
            4.2426405 = tf(freq=18.0), with freq of:
              18.0 = termFreq=18.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.0151522895 = weight(abstract_txt:systems in 1634) [ClassicSimilarity], result of:
        0.0151522895 = score(doc=1634,freq=1.0), product of:
          0.09476173 = queryWeight, product of:
            1.4783323 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.018791305 = queryNorm
          0.15989883 = fieldWeight in 1634, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
      0.34006813 = weight(abstract_txt:stella in 1634) [ClassicSimilarity], result of:
        0.34006813 = score(doc=1634,freq=1.0), product of:
          0.753977 = queryWeight, product of:
            4.1699862 = boost
            9.622026 = idf(docFreq=7, maxDocs=44421)
            0.018791305 = queryNorm
          0.4510325 = fieldWeight in 1634, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.622026 = idf(docFreq=7, maxDocs=44421)
            0.046875 = fieldNorm(doc=1634)
    0.36 = coord(9/25)
  2. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.14 
    0.14258265 = sum of:
  0.14258265 = product of:
    0.35645664 = sum of:
      0.01852091 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
        0.01852091 = score(doc=3019,freq=3.0), product of:
          0.06561728 = queryWeight, product of:
            1.0044285 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018791305 = queryNorm
          0.2822566 = fieldWeight in 3019, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.027776586 = weight(abstract_txt:search in 3019) [ClassicSimilarity], result of:
        0.027776586 = score(doc=3019,freq=5.0), product of:
          0.072512515 = queryWeight, product of:
            1.0558845 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.018791305 = queryNorm
          0.3830592 = fieldWeight in 3019, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.028379904 = weight(abstract_txt:user in 3019) [ClassicSimilarity], result of:
        0.028379904 = score(doc=3019,freq=5.0), product of:
          0.07355875 = queryWeight, product of:
            1.0634745 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018791305 = queryNorm
          0.38581276 = fieldWeight in 3019, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.07108069 = weight(abstract_txt:cranfield in 3019) [ClassicSimilarity], result of:
        0.07108069 = score(doc=3019,freq=1.0), product of:
          0.18412305 = queryWeight, product of:
            1.1897317 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.018791305 = queryNorm
          0.38604993 = fieldWeight in 3019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.008020652 = weight(abstract_txt:from in 3019) [ClassicSimilarity], result of:
        0.008020652 = score(doc=3019,freq=1.0), product of:
          0.06200889 = queryWeight, product of:
            1.195866 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018791305 = queryNorm
          0.12934682 = fieldWeight in 3019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.06863147 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
        0.06863147 = score(doc=3019,freq=9.0), product of:
          0.10894778 = queryWeight, product of:
            1.2942529 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018791305 = queryNorm
          0.62994826 = fieldWeight in 3019, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.0072037475 = weight(abstract_txt:information in 3019) [ClassicSimilarity], result of:
        0.0072037475 = score(doc=3019,freq=1.0), product of:
          0.063533 = queryWeight, product of:
            1.3977343 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018791305 = queryNorm
          0.113385916 = fieldWeight in 3019, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.04008919 = weight(abstract_txt:systems in 3019) [ClassicSimilarity], result of:
        0.04008919 = score(doc=3019,freq=7.0), product of:
          0.09476173 = queryWeight, product of:
            1.4783323 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.018791305 = queryNorm
          0.42305255 = fieldWeight in 3019, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.054076914 = weight(abstract_txt:evaluate in 3019) [ClassicSimilarity], result of:
        0.054076914 = score(doc=3019,freq=2.0), product of:
          0.15344344 = queryWeight, product of:
            1.5359749 = boost
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.018791305 = queryNorm
          0.35242245 = fieldWeight in 3019, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
      0.032676574 = weight(abstract_txt:users in 3019) [ClassicSimilarity], result of:
        0.032676574 = score(doc=3019,freq=2.0), product of:
          0.1381788 = queryWeight, product of:
            2.061321 = boost
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.018791305 = queryNorm
          0.23648039 = fieldWeight in 3019, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.046875 = fieldNorm(doc=3019)
    0.4 = coord(10/25)
  3. Balog, K.; Schuth, A.; Dekker, P.; Tavakolpoursaleh, N.; Schaer, P.; Chuang, P.-Y.: Overview of the TREC 2016 Open Search track Academic Search Edition (2016) 0.13 
    0.13063467 = sum of:
  0.13063467 = product of:
    0.46655238 = sum of:
      0.024950458 = weight(abstract_txt:retrieval in 1044) [ClassicSimilarity], result of:
        0.024950458 = score(doc=1044,freq=1.0), product of:
          0.06561728 = queryWeight, product of:
            1.0044285 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018791305 = queryNorm
          0.3802422 = fieldWeight in 1044, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.07099803 = weight(abstract_txt:search in 1044) [ClassicSimilarity], result of:
        0.07099803 = score(doc=1044,freq=6.0), product of:
          0.072512515 = queryWeight, product of:
            1.0558845 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.018791305 = queryNorm
          0.9791141 = fieldWeight in 1044, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.053380027 = weight(abstract_txt:evaluation in 1044) [ClassicSimilarity], result of:
        0.053380027 = score(doc=1044,freq=1.0), product of:
          0.10894778 = queryWeight, product of:
            1.2942529 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018791305 = queryNorm
          0.48995975 = fieldWeight in 1044, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.016808745 = weight(abstract_txt:information in 1044) [ClassicSimilarity], result of:
        0.016808745 = score(doc=1044,freq=1.0), product of:
          0.063533 = queryWeight, product of:
            1.3977343 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018791305 = queryNorm
          0.26456714 = fieldWeight in 1044, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.08922236 = weight(abstract_txt:evaluate in 1044) [ClassicSimilarity], result of:
        0.08922236 = score(doc=1044,freq=1.0), product of:
          0.15344344 = queryWeight, product of:
            1.5359749 = boost
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.018791305 = queryNorm
          0.5814674 = fieldWeight in 1044, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.15727918 = weight(abstract_txt:academic in 1044) [ClassicSimilarity], result of:
        0.15727918 = score(doc=1044,freq=3.0), product of:
          0.17772016 = queryWeight, product of:
            2.0245285 = boost
            4.6714945 = idf(docFreq=1129, maxDocs=44421)
            0.018791305 = queryNorm
          0.88498217 = fieldWeight in 1044, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.6714945 = idf(docFreq=1129, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
      0.053913597 = weight(abstract_txt:users in 1044) [ClassicSimilarity], result of:
        0.053913597 = score(doc=1044,freq=1.0), product of:
          0.1381788 = queryWeight, product of:
            2.061321 = boost
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.018791305 = queryNorm
          0.39017272 = fieldWeight in 1044, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.109375 = fieldNorm(doc=1044)
    0.28 = coord(7/25)
  4. Shah, C.; Hendahewa, C.; González-Ibáñez, R.: Rain or shine? : forecasting search process performance in exploratory search tasks (2016) 0.13 
    0.12762062 = sum of:
  0.12762062 = product of:
    0.31905156 = sum of:
      0.014257404 = weight(abstract_txt:retrieval in 4012) [ClassicSimilarity], result of:
        0.014257404 = score(doc=4012,freq=1.0), product of:
          0.06561728 = queryWeight, product of:
            1.0044285 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018791305 = queryNorm
          0.21728125 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.059386868 = weight(abstract_txt:recommendation in 4012) [ClassicSimilarity], result of:
        0.059386868 = score(doc=4012,freq=1.0), product of:
          0.13482638 = queryWeight, product of:
            1.0180811 = boost
            7.0475073 = idf(docFreq=104, maxDocs=44421)
            0.018791305 = queryNorm
          0.4404692 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.0475073 = idf(docFreq=104, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.052376032 = weight(abstract_txt:search in 4012) [ClassicSimilarity], result of:
        0.052376032 = score(doc=4012,freq=10.0), product of:
          0.072512515 = queryWeight, product of:
            1.0558845 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.018791305 = queryNorm
          0.72230333 = fieldWeight in 4012, product of:
            3.1622777 = tf(freq=10.0), with freq of:
              10.0 = termFreq=10.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.023932034 = weight(abstract_txt:user in 4012) [ClassicSimilarity], result of:
        0.023932034 = score(doc=4012,freq=2.0), product of:
          0.07355875 = queryWeight, product of:
            1.0634745 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018791305 = queryNorm
          0.32534587 = fieldWeight in 4012, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.015123888 = weight(abstract_txt:from in 4012) [ClassicSimilarity], result of:
        0.015123888 = score(doc=4012,freq=2.0), product of:
          0.06200889 = queryWeight, product of:
            1.195866 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018791305 = queryNorm
          0.2438987 = fieldWeight in 4012, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.030502873 = weight(abstract_txt:evaluation in 4012) [ClassicSimilarity], result of:
        0.030502873 = score(doc=4012,freq=1.0), product of:
          0.10894778 = queryWeight, product of:
            1.2942529 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018791305 = queryNorm
          0.279977 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.021477425 = weight(abstract_txt:information in 4012) [ClassicSimilarity], result of:
        0.021477425 = score(doc=4012,freq=5.0), product of:
          0.063533 = queryWeight, product of:
            1.3977343 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018791305 = queryNorm
          0.3380515 = fieldWeight in 4012, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.020203052 = weight(abstract_txt:systems in 4012) [ClassicSimilarity], result of:
        0.020203052 = score(doc=4012,freq=1.0), product of:
          0.09476173 = queryWeight, product of:
            1.4783323 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.018791305 = queryNorm
          0.21319844 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.050984204 = weight(abstract_txt:evaluate in 4012) [ClassicSimilarity], result of:
        0.050984204 = score(doc=4012,freq=1.0), product of:
          0.15344344 = queryWeight, product of:
            1.5359749 = boost
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.018791305 = queryNorm
          0.33226708 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
      0.030807769 = weight(abstract_txt:users in 4012) [ClassicSimilarity], result of:
        0.030807769 = score(doc=4012,freq=1.0), product of:
          0.1381788 = queryWeight, product of:
            2.061321 = boost
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.018791305 = queryNorm
          0.22295584 = fieldWeight in 4012, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.0625 = fieldNorm(doc=4012)
    0.4 = coord(10/25)
  5. Amolochitis, E.; Christou, I.T.; Tan, Z.-H.; Prasad, R.: ¬A heuristic hierarchical scheme for academic search and retrieval (2013) 0.12 
    0.123664215 = sum of:
  0.123664215 = product of:
    0.3435117 = sum of:
      0.024694547 = weight(abstract_txt:retrieval in 3711) [ClassicSimilarity], result of:
        0.024694547 = score(doc=3711,freq=3.0), product of:
          0.06561728 = queryWeight, product of:
            1.0044285 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.018791305 = queryNorm
          0.37634215 = fieldWeight in 3711, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.037035447 = weight(abstract_txt:search in 3711) [ClassicSimilarity], result of:
        0.037035447 = score(doc=3711,freq=5.0), product of:
          0.072512515 = queryWeight, product of:
            1.0558845 = boost
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.018791305 = queryNorm
          0.5107456 = fieldWeight in 3711, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.654598 = idf(docFreq=3123, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.033845007 = weight(abstract_txt:user in 3711) [ClassicSimilarity], result of:
        0.033845007 = score(doc=3711,freq=4.0), product of:
          0.07355875 = queryWeight, product of:
            1.0634745 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.018791305 = queryNorm
          0.46010855 = fieldWeight in 3711, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.015123888 = weight(abstract_txt:from in 3711) [ClassicSimilarity], result of:
        0.015123888 = score(doc=3711,freq=2.0), product of:
          0.06200889 = queryWeight, product of:
            1.195866 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018791305 = queryNorm
          0.2438987 = fieldWeight in 3711, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.037638515 = weight(abstract_txt:common in 3711) [ClassicSimilarity], result of:
        0.037638515 = score(doc=3711,freq=1.0), product of:
          0.12533708 = queryWeight, product of:
            1.3881925 = boost
            4.8047733 = idf(docFreq=988, maxDocs=44421)
            0.018791305 = queryNorm
          0.30029833 = fieldWeight in 3711, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8047733 = idf(docFreq=988, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.009604997 = weight(abstract_txt:information in 3711) [ClassicSimilarity], result of:
        0.009604997 = score(doc=3711,freq=1.0), product of:
          0.063533 = queryWeight, product of:
            1.3977343 = boost
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.018791305 = queryNorm
          0.15118122 = fieldWeight in 3711, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4188995 = idf(docFreq=10748, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.050984204 = weight(abstract_txt:evaluate in 3711) [ClassicSimilarity], result of:
        0.050984204 = score(doc=3711,freq=1.0), product of:
          0.15344344 = queryWeight, product of:
            1.5359749 = boost
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.018791305 = queryNorm
          0.33226708 = fieldWeight in 3711, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.316273 = idf(docFreq=592, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.10377734 = weight(abstract_txt:academic in 3711) [ClassicSimilarity], result of:
        0.10377734 = score(doc=3711,freq=4.0), product of:
          0.17772016 = queryWeight, product of:
            2.0245285 = boost
            4.6714945 = idf(docFreq=1129, maxDocs=44421)
            0.018791305 = queryNorm
          0.5839368 = fieldWeight in 3711, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.6714945 = idf(docFreq=1129, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
      0.030807769 = weight(abstract_txt:users in 3711) [ClassicSimilarity], result of:
        0.030807769 = score(doc=3711,freq=1.0), product of:
          0.1381788 = queryWeight, product of:
            2.061321 = boost
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.018791305 = queryNorm
          0.22295584 = fieldWeight in 3711, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5672934 = idf(docFreq=3408, maxDocs=44421)
            0.0625 = fieldNorm(doc=3711)
    0.36 = coord(9/25)