Document (#43045)

Author
Balog, K.
Schuth, A.
Dekker, P.
Tavakolpoursaleh, N.
Schaer, P.
Chuang, P.-Y.
Title
Overview of the TREC 2016 Open Search track Academic Search Edition
Source
TREC 2016, Gaithersburg, Unites States
Year
2016
Abstract
We present the TREC Open Search track, which represents a new evaluation paradigm for information retrieval. It offers the possibility for researchers to evaluate their approaches in a live setting, with real, unsuspecting users of an existing search engine. The first edition of the track focuses on the academic search domain and features the ad-hoc scientific literature search task. We report on experiments with three different academic search engines: Cite-SeerX, SSOAR, and Microsoft Academic Search.
Content
Vgl.: https://www.researchgate.net/publication/345253485_Overview_of_the_TREC_2016_Open_Search_track_Academic_Search_Edition.
Theme
Retrievalstudien
Object
TREC-2016

Similar documents (author)

  1. Chuang, K.Y.; Yang, C.C.: Informational support exchanges using different computer-mediated communication formats in a social media alcoholism community (2014) 0.98 
    0.9771058 = sum of:
  0.9771058 = product of:
    2.9313173 = sum of:
      2.9313173 = weight(author_txt:chuang in 1179) [ClassicSimilarity], result of:
        2.9313173 = score(doc=1179,freq=1.0), product of:
          0.60123557 = queryWeight, product of:
            1.0926324 = boost
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.05643161 = queryNorm
          4.8754888 = fieldWeight in 1179, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.5 = fieldNorm(doc=1179)
    0.33333334 = coord(1/3)
  2. Schaer, P.: Integration von Open-Access-Repositorien in Fachportale (2010) 0.94 
    0.9363309 = sum of:
  0.9363309 = product of:
    2.8089926 = sum of:
      2.8089926 = weight(author_txt:schaer in 2320) [ClassicSimilarity], result of:
        2.8089926 = score(doc=2320,freq=1.0), product of:
          0.5036125 = queryWeight, product of:
            8.924298 = idf(docFreq=15, maxDocs=44218)
            0.05643161 = queryNorm
          5.5776863 = fieldWeight in 2320, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.924298 = idf(docFreq=15, maxDocs=44218)
            0.625 = fieldNorm(doc=2320)
    0.33333334 = coord(1/3)
  3. Schaer, P.: Sprachmodelle und neuronale Netze im Information Retrieval (2023) 0.94 
    0.9363309 = sum of:
  0.9363309 = product of:
    2.8089926 = sum of:
      2.8089926 = weight(author_txt:schaer in 799) [ClassicSimilarity], result of:
        2.8089926 = score(doc=799,freq=1.0), product of:
          0.5036125 = queryWeight, product of:
            8.924298 = idf(docFreq=15, maxDocs=44218)
            0.05643161 = queryNorm
          5.5776863 = fieldWeight in 799, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.924298 = idf(docFreq=15, maxDocs=44218)
            0.625 = fieldNorm(doc=799)
    0.33333334 = coord(1/3)
  4. Balog, K.; Azzopardi, L.; Rijke, M. de: ¬A language modeling framework for expert finding (2009) 0.77 
    0.76813686 = sum of:
  0.76813686 = product of:
    2.3044105 = sum of:
      2.3044105 = weight(author_txt:balog in 2447) [ClassicSimilarity], result of:
        2.3044105 = score(doc=2447,freq=1.0), product of:
          0.6203953 = queryWeight, product of:
            1.1099055 = boost
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.05643161 = queryNorm
          3.7144227 = fieldWeight in 2447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.375 = fieldNorm(doc=2447)
    0.33333334 = coord(1/3)
  5. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 0.77 
    0.76813686 = sum of:
  0.76813686 = product of:
    2.3044105 = sum of:
      2.3044105 = weight(author_txt:balog in 2672) [ClassicSimilarity], result of:
        2.3044105 = score(doc=2672,freq=1.0), product of:
          0.6203953 = queryWeight, product of:
            1.1099055 = boost
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.05643161 = queryNorm
          3.7144227 = fieldWeight in 2672, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.375 = fieldNorm(doc=2672)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. TREC: experiment and evaluation in information retrieval (2005) 0.23 
    0.22983117 = sum of:
  0.22983117 = product of:
    0.82082564 = sum of:
      0.0068884827 = weight(abstract_txt:with in 636) [ClassicSimilarity], result of:
        0.0068884827 = score(doc=636,freq=1.0), product of:
          0.04409099 = queryWeight, product of:
            1.017952 = boost
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.01732722 = queryNorm
          0.15623334 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.030070094 = weight(abstract_txt:offers in 636) [ClassicSimilarity], result of:
        0.030070094 = score(doc=636,freq=1.0), product of:
          0.09347181 = queryWeight, product of:
            1.0480396 = boost
            5.1472363 = idf(docFreq=698, maxDocs=44218)
            0.01732722 = queryNorm
          0.32170227 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1472363 = idf(docFreq=698, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.032857887 = weight(abstract_txt:engines in 636) [ClassicSimilarity], result of:
        0.032857887 = score(doc=636,freq=1.0), product of:
          0.099163204 = queryWeight, product of:
            1.079475 = boost
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.01732722 = queryNorm
          0.3313516 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.06475833 = weight(abstract_txt:microsoft in 636) [ClassicSimilarity], result of:
        0.06475833 = score(doc=636,freq=1.0), product of:
          0.15587911 = queryWeight, product of:
            1.353416 = boost
            6.6470313 = idf(docFreq=155, maxDocs=44218)
            0.01732722 = queryNorm
          0.41543946 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.6470313 = idf(docFreq=155, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.3751014 = weight(abstract_txt:trec in 636) [ClassicSimilarity], result of:
        0.3751014 = score(doc=636,freq=8.0), product of:
          0.31671593 = queryWeight, product of:
            2.7282698 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.01732722 = queryNorm
          1.1843464 = fieldWeight in 636, product of:
            2.828427 = tf(freq=8.0), with freq of:
              8.0 = termFreq=8.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.22480144 = weight(abstract_txt:track in 636) [ClassicSimilarity], result of:
        0.22480144 = score(doc=636,freq=1.0), product of:
          0.5154232 = queryWeight, product of:
            4.262653 = boost
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.01732722 = queryNorm
          0.43614927 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
      0.08634799 = weight(abstract_txt:search in 636) [ClassicSimilarity], result of:
        0.08634799 = score(doc=636,freq=1.0), product of:
          0.3776785 = queryWeight, product of:
            5.9585896 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.01732722 = queryNorm
          0.22862828 = fieldWeight in 636, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.0625 = fieldNorm(doc=636)
    0.28 = coord(7/25)
  2. Lin, J.; DiCuccio, M.; Grigoryan, V.; Wilbur, W.J.: Navigating information spaces : a case study of related article search in PubMed (2008) 0.18 
    0.18216641 = sum of:
  0.18216641 = product of:
    0.75902677 = sum of:
      0.008610603 = weight(abstract_txt:with in 2124) [ClassicSimilarity], result of:
        0.008610603 = score(doc=2124,freq=1.0), product of:
          0.04409099 = queryWeight, product of:
            1.017952 = boost
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.01732722 = queryNorm
          0.19529167 = fieldWeight in 2124, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
      0.041228276 = weight(abstract_txt:real in 2124) [ClassicSimilarity], result of:
        0.041228276 = score(doc=2124,freq=1.0), product of:
          0.099414 = queryWeight, product of:
            1.0808393 = boost
            5.308326 = idf(docFreq=594, maxDocs=44218)
            0.01732722 = queryNorm
          0.41471297 = fieldWeight in 2124, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.308326 = idf(docFreq=594, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
      0.04654318 = weight(abstract_txt:engine in 2124) [ClassicSimilarity], result of:
        0.04654318 = score(doc=2124,freq=1.0), product of:
          0.10778413 = queryWeight, product of:
            1.1254203 = boost
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.01732722 = queryNorm
          0.4318185 = fieldWeight in 2124, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
      0.16577294 = weight(abstract_txt:trec in 2124) [ClassicSimilarity], result of:
        0.16577294 = score(doc=2124,freq=1.0), product of:
          0.31671593 = queryWeight, product of:
            2.7282698 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.01732722 = queryNorm
          0.5234121 = fieldWeight in 2124, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
      0.2810018 = weight(abstract_txt:track in 2124) [ClassicSimilarity], result of:
        0.2810018 = score(doc=2124,freq=1.0), product of:
          0.5154232 = queryWeight, product of:
            4.262653 = boost
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.01732722 = queryNorm
          0.5451866 = fieldWeight in 2124, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
      0.21586996 = weight(abstract_txt:search in 2124) [ClassicSimilarity], result of:
        0.21586996 = score(doc=2124,freq=4.0), product of:
          0.3776785 = queryWeight, product of:
            5.9585896 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.01732722 = queryNorm
          0.5715707 = fieldWeight in 2124, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.078125 = fieldNorm(doc=2124)
    0.24 = coord(6/25)
  3. Toms, E.G.; Freund, L.; Li, C.: WilRE: the Web Interactive information retrieval experimentation system prototype (2004) 0.18 
    0.18035534 = sum of:
  0.18035534 = product of:
    0.7514806 = sum of:
      0.012177233 = weight(abstract_txt:with in 2534) [ClassicSimilarity], result of:
        0.012177233 = score(doc=2534,freq=2.0), product of:
          0.04409099 = queryWeight, product of:
            1.017952 = boost
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.01732722 = queryNorm
          0.27618414 = fieldWeight in 2534, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
      0.059036538 = weight(abstract_txt:experiments in 2534) [ClassicSimilarity], result of:
        0.059036538 = score(doc=2534,freq=2.0), product of:
          0.10024316 = queryWeight, product of:
            1.0853373 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.01732722 = queryNorm
          0.58893335 = fieldWeight in 2534, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
      0.04654318 = weight(abstract_txt:engine in 2534) [ClassicSimilarity], result of:
        0.04654318 = score(doc=2534,freq=1.0), product of:
          0.10778413 = queryWeight, product of:
            1.1254203 = boost
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.01732722 = queryNorm
          0.4318185 = fieldWeight in 2534, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
      0.16577294 = weight(abstract_txt:trec in 2534) [ClassicSimilarity], result of:
        0.16577294 = score(doc=2534,freq=1.0), product of:
          0.31671593 = queryWeight, product of:
            2.7282698 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.01732722 = queryNorm
          0.5234121 = fieldWeight in 2534, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
      0.2810018 = weight(abstract_txt:track in 2534) [ClassicSimilarity], result of:
        0.2810018 = score(doc=2534,freq=1.0), product of:
          0.5154232 = queryWeight, product of:
            4.262653 = boost
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.01732722 = queryNorm
          0.5451866 = fieldWeight in 2534, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
      0.18694888 = weight(abstract_txt:search in 2534) [ClassicSimilarity], result of:
        0.18694888 = score(doc=2534,freq=3.0), product of:
          0.3776785 = queryWeight, product of:
            5.9585896 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.01732722 = queryNorm
          0.49499476 = fieldWeight in 2534, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.078125 = fieldNorm(doc=2534)
    0.24 = coord(6/25)
  4. Hume, C.: Internet search engines and robots : what they are and how to use them (2000) 0.16 
    0.16272245 = sum of:
  0.16272245 = product of:
    0.5811516 = sum of:
      0.014612678 = weight(abstract_txt:with in 6104) [ClassicSimilarity], result of:
        0.014612678 = score(doc=6104,freq=2.0), product of:
          0.04409099 = queryWeight, product of:
            1.017952 = boost
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.01732722 = queryNorm
          0.33142096 = fieldWeight in 6104, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.4997334 = idf(docFreq=9868, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.04510514 = weight(abstract_txt:offers in 6104) [ClassicSimilarity], result of:
        0.04510514 = score(doc=6104,freq=1.0), product of:
          0.09347181 = queryWeight, product of:
            1.0480396 = boost
            5.1472363 = idf(docFreq=698, maxDocs=44218)
            0.01732722 = queryNorm
          0.48255342 = fieldWeight in 6104, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1472363 = idf(docFreq=698, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.08536729 = weight(abstract_txt:engines in 6104) [ClassicSimilarity], result of:
        0.08536729 = score(doc=6104,freq=3.0), product of:
          0.099163204 = queryWeight, product of:
            1.079475 = boost
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.01732722 = queryNorm
          0.8608767 = fieldWeight in 6104, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.070033245 = weight(abstract_txt:overview in 6104) [ClassicSimilarity], result of:
        0.070033245 = score(doc=6104,freq=2.0), product of:
          0.09947703 = queryWeight, product of:
            1.0811819 = boost
            5.310008 = idf(docFreq=593, maxDocs=44218)
            0.01732722 = queryNorm
          0.70401424 = fieldWeight in 6104, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.310008 = idf(docFreq=593, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.051137436 = weight(abstract_txt:focuses in 6104) [ClassicSimilarity], result of:
        0.051137436 = score(doc=6104,freq=1.0), product of:
          0.10163016 = queryWeight, product of:
            1.09282 = boost
            5.3671665 = idf(docFreq=560, maxDocs=44218)
            0.01732722 = queryNorm
          0.50317186 = fieldWeight in 6104, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3671665 = idf(docFreq=560, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.055851813 = weight(abstract_txt:engine in 6104) [ClassicSimilarity], result of:
        0.055851813 = score(doc=6104,freq=1.0), product of:
          0.10778413 = queryWeight, product of:
            1.1254203 = boost
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.01732722 = queryNorm
          0.51818216 = fieldWeight in 6104, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5272765 = idf(docFreq=477, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
      0.25904396 = weight(abstract_txt:search in 6104) [ClassicSimilarity], result of:
        0.25904396 = score(doc=6104,freq=4.0), product of:
          0.3776785 = queryWeight, product of:
            5.9585896 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.01732722 = queryNorm
          0.68588483 = fieldWeight in 6104, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.09375 = fieldNorm(doc=6104)
    0.28 = coord(7/25)
  5. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.16 
    0.15812866 = sum of:
  0.15812866 = product of:
    0.7906433 = sum of:
      0.05224344 = weight(abstract_txt:task in 4540) [ClassicSimilarity], result of:
        0.05224344 = score(doc=4540,freq=4.0), product of:
          0.08509917 = queryWeight, product of:
            4.9112997 = idf(docFreq=884, maxDocs=44218)
            0.01732722 = queryNorm
          0.61391246 = fieldWeight in 4540, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.9112997 = idf(docFreq=884, maxDocs=44218)
            0.0625 = fieldNorm(doc=4540)
      0.032982618 = weight(abstract_txt:real in 4540) [ClassicSimilarity], result of:
        0.032982618 = score(doc=4540,freq=1.0), product of:
          0.099414 = queryWeight, product of:
            1.0808393 = boost
            5.308326 = idf(docFreq=594, maxDocs=44218)
            0.01732722 = queryNorm
          0.33177036 = fieldWeight in 4540, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.308326 = idf(docFreq=594, maxDocs=44218)
            0.0625 = fieldNorm(doc=4540)
      0.22970174 = weight(abstract_txt:trec in 4540) [ClassicSimilarity], result of:
        0.22970174 = score(doc=4540,freq=3.0), product of:
          0.31671593 = queryWeight, product of:
            2.7282698 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.01732722 = queryNorm
          0.7252611 = fieldWeight in 4540, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0625 = fieldNorm(doc=4540)
      0.3893675 = weight(abstract_txt:track in 4540) [ClassicSimilarity], result of:
        0.3893675 = score(doc=4540,freq=3.0), product of:
          0.5154232 = queryWeight, product of:
            4.262653 = boost
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.01732722 = queryNorm
          0.75543267 = fieldWeight in 4540, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.9783883 = idf(docFreq=111, maxDocs=44218)
            0.0625 = fieldNorm(doc=4540)
      0.08634799 = weight(abstract_txt:search in 4540) [ClassicSimilarity], result of:
        0.08634799 = score(doc=4540,freq=1.0), product of:
          0.3776785 = queryWeight, product of:
            5.9585896 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.01732722 = queryNorm
          0.22862828 = fieldWeight in 4540, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.0625 = fieldNorm(doc=4540)
    0.2 = coord(5/25)