Document (#43045)

Author

Balog, K.
Schuth, A.
Dekker, P.
Tavakolpoursaleh, N.
Schaer, P.
Chuang, P.-Y.

Title

Overview of the TREC 2016 Open Search track Academic Search Edition

Source

TREC 2016, Gaithersburg, Unites States

Year

2016

Abstract

We present the TREC Open Search track, which represents a new evaluation paradigm for information retrieval. It offers the possibility for researchers to evaluate their approaches in a live setting, with real, unsuspecting users of an existing search engine. The first edition of the track focuses on the academic search domain and features the ad-hoc scientific literature search task. We report on experiments with three different academic search engines: Cite-SeerX, SSOAR, and Microsoft Academic Search.

Content

Vgl.: https://www.researchgate.net/publication/345253485_Overview_of_the_TREC_2016_Open_Search_track_Academic_Search_Edition.

Theme

Retrievalstudien

Object

TREC-2016

Similar documents (author)

1. Chuang, K.Y.; Yang, C.C.: Informational support exchanges using different computer-mediated communication formats in a social media alcoholism community (2014) 0.98

   0.98089856 = sum of:
     0.98089856 = product of:
       2.9426956 = sum of:
         2.9426956 = weight(author_txt:chuang in 2179) [ClassicSimilarity], result of:
           2.9426956 = score(doc=2179,freq=1.0), product of:
             0.603286 = queryWeight, product of:
               1.1000538 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.056215655 = queryNorm
             4.8777785 = fieldWeight in 2179, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=2179)
       0.33333334 = coord(1/3)
   

2. Schaer, P.: Integration von Open-Access-Repositorien in Fachportale (2010) 0.92

   0.9210694 = sum of:
     0.9210694 = product of:
       2.7632082 = sum of:
         2.7632082 = weight(author_txt:schaer in 3320) [ClassicSimilarity], result of:
           2.7632082 = score(doc=3320,freq=1.0), product of:
             0.49853474 = queryWeight, product of:
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.056215655 = queryNorm
             5.5426593 = fieldWeight in 3320, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.625 = fieldNorm(doc=3320)
       0.33333334 = coord(1/3)
   

3. Schaer, P.: Sprachmodelle und neuronale Netze im Information Retrieval (2023) 0.92

   0.9210694 = sum of:
     0.9210694 = product of:
       2.7632082 = sum of:
         2.7632082 = weight(author_txt:schaer in 1800) [ClassicSimilarity], result of:
           2.7632082 = score(doc=1800,freq=1.0), product of:
             0.49853474 = queryWeight, product of:
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.056215655 = queryNorm
             5.5426593 = fieldWeight in 1800, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.625 = fieldNorm(doc=1800)
       0.33333334 = coord(1/3)
   

4. Balog, K.; Azzopardi, L.; Rijke, M. de: ¬A language modeling framework for expert finding (2009) 0.77

   0.77110183 = sum of:
     0.77110183 = product of:
       2.3133054 = sum of:
         2.3133054 = weight(author_txt:balog in 3447) [ClassicSimilarity], result of:
           2.3133054 = score(doc=3447,freq=1.0), product of:
             0.62250215 = queryWeight, product of:
               1.1174362 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.056215655 = queryNorm
             3.7161405 = fieldWeight in 3447, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.375 = fieldNorm(doc=3447)
       0.33333334 = coord(1/3)
   

5. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 0.77

   0.77110183 = sum of:
     0.77110183 = product of:
       2.3133054 = sum of:
         2.3133054 = weight(author_txt:balog in 3672) [ClassicSimilarity], result of:
           2.3133054 = score(doc=3672,freq=1.0), product of:
             0.62250215 = queryWeight, product of:
               1.1174362 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.056215655 = queryNorm
             3.7161405 = fieldWeight in 3672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.375 = fieldNorm(doc=3672)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. TREC: experiment and evaluation in information retrieval (2005) 0.23

   0.23024991 = sum of:
     0.23024991 = product of:
       0.8223211 = sum of:
         0.0068647806 = weight(abstract_txt:with in 761) [ClassicSimilarity], result of:
           0.0068647806 = score(doc=761,freq=1.0), product of:
             0.04400254 = queryWeight, product of:
               1.017636 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.017322732 = queryNorm
             0.15600874 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.03002672 = weight(abstract_txt:offers in 761) [ClassicSimilarity], result of:
           0.03002672 = score(doc=761,freq=1.0), product of:
             0.093408965 = queryWeight, product of:
               1.0484141 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.017322732 = queryNorm
             0.32145438 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.032664098 = weight(abstract_txt:engines in 761) [ClassicSimilarity], result of:
           0.032664098 = score(doc=761,freq=1.0), product of:
             0.098801546 = queryWeight, product of:
               1.0782524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.017322732 = queryNorm
             0.3306031 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.06494874 = weight(abstract_txt:microsoft in 761) [ClassicSimilarity], result of:
           0.06494874 = score(doc=761,freq=1.0), product of:
             0.15622976 = queryWeight, product of:
               1.3558775 = boost
               6.651612 = idf(docFreq=155, maxDocs=44421)
               0.017322732 = queryNorm
             0.41572574 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.651612 = idf(docFreq=155, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.37619802 = weight(abstract_txt:trec in 761) [ClassicSimilarity], result of:
           0.37619802 = score(doc=761,freq=8.0), product of:
             0.3174249 = queryWeight, product of:
               2.7332168 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.017322732 = queryNorm
             1.185156 = fieldWeight in 761, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.22544026 = weight(abstract_txt:track in 761) [ClassicSimilarity], result of:
           0.22544026 = score(doc=761,freq=1.0), product of:
             0.5165488 = queryWeight, product of:
               4.2702656 = boost
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.017322732 = queryNorm
             0.43643555 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.08617847 = weight(abstract_txt:search in 761) [ClassicSimilarity], result of:
           0.08617847 = score(doc=761,freq=1.0), product of:
             0.37729335 = queryWeight, product of:
               5.959683 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.017322732 = queryNorm
             0.22841237 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
       0.28 = coord(7/25)
   

2. Lin, J.; DiCuccio, M.; Grigoryan, V.; Wilbur, W.J.: Navigating information spaces : a case study of related article search in PubMed (2008) 0.18

   0.18227752 = sum of:
     0.18227752 = product of:
       0.75948966 = sum of:
         0.008580975 = weight(abstract_txt:with in 3124) [ClassicSimilarity], result of:
           0.008580975 = score(doc=3124,freq=1.0), product of:
             0.04400254 = queryWeight, product of:
               1.017636 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.017322732 = queryNorm
             0.19501092 = fieldWeight in 3124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
         0.041175853 = weight(abstract_txt:real in 3124) [ClassicSimilarity], result of:
           0.041175853 = score(doc=3124,freq=1.0), product of:
             0.0993585 = queryWeight, product of:
               1.0812873 = boost
               5.304538 = idf(docFreq=599, maxDocs=44421)
               0.017322732 = queryNorm
             0.41441703 = fieldWeight in 3124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.304538 = idf(docFreq=599, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
         0.046228737 = weight(abstract_txt:engine in 3124) [ClassicSimilarity], result of:
           0.046228737 = score(doc=3124,freq=1.0), product of:
             0.10732922 = queryWeight, product of:
               1.1238221 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.017322732 = queryNorm
             0.43071902 = fieldWeight in 3124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
         0.1662576 = weight(abstract_txt:trec in 3124) [ClassicSimilarity], result of:
           0.1662576 = score(doc=3124,freq=1.0), product of:
             0.3174249 = queryWeight, product of:
               2.7332168 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.017322732 = queryNorm
             0.5237699 = fieldWeight in 3124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
         0.28180033 = weight(abstract_txt:track in 3124) [ClassicSimilarity], result of:
           0.28180033 = score(doc=3124,freq=1.0), product of:
             0.5165488 = queryWeight, product of:
               4.2702656 = boost
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.017322732 = queryNorm
             0.54554445 = fieldWeight in 3124, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
         0.21544616 = weight(abstract_txt:search in 3124) [ClassicSimilarity], result of:
           0.21544616 = score(doc=3124,freq=4.0), product of:
             0.37729335 = queryWeight, product of:
               5.959683 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.017322732 = queryNorm
             0.5710309 = fieldWeight in 3124, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=3124)
       0.24 = coord(6/25)
   

3. Toms, E.G.; Freund, L.; Li, C.: WilRE: the Web Interactive information retrieval experimentation system prototype (2004) 0.18

   0.18045676 = sum of:
     0.18045676 = product of:
       0.7519032 = sum of:
         0.012135332 = weight(abstract_txt:with in 3534) [ClassicSimilarity], result of:
           0.012135332 = score(doc=3534,freq=2.0), product of:
             0.04400254 = queryWeight, product of:
               1.017636 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.017322732 = queryNorm
             0.2757871 = fieldWeight in 3534, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
         0.058899336 = weight(abstract_txt:experiments in 3534) [ClassicSimilarity], result of:
           0.058899336 = score(doc=3534,freq=2.0), product of:
             0.10011678 = queryWeight, product of:
               1.0854055 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.017322732 = queryNorm
             0.5883063 = fieldWeight in 3534, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
         0.046228737 = weight(abstract_txt:engine in 3534) [ClassicSimilarity], result of:
           0.046228737 = score(doc=3534,freq=1.0), product of:
             0.10732922 = queryWeight, product of:
               1.1238221 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.017322732 = queryNorm
             0.43071902 = fieldWeight in 3534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
         0.1662576 = weight(abstract_txt:trec in 3534) [ClassicSimilarity], result of:
           0.1662576 = score(doc=3534,freq=1.0), product of:
             0.3174249 = queryWeight, product of:
               2.7332168 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.017322732 = queryNorm
             0.5237699 = fieldWeight in 3534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
         0.28180033 = weight(abstract_txt:track in 3534) [ClassicSimilarity], result of:
           0.28180033 = score(doc=3534,freq=1.0), product of:
             0.5165488 = queryWeight, product of:
               4.2702656 = boost
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.017322732 = queryNorm
             0.54554445 = fieldWeight in 3534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
         0.18658185 = weight(abstract_txt:search in 3534) [ClassicSimilarity], result of:
           0.18658185 = score(doc=3534,freq=3.0), product of:
             0.37729335 = queryWeight, product of:
               5.959683 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.017322732 = queryNorm
             0.49452728 = fieldWeight in 3534, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=3534)
       0.24 = coord(6/25)
   

4. Hume, C.: Internet search engines and robots : what they are and how to use them (2000) 0.16

   0.16221726 = sum of:
     0.16221726 = product of:
       0.5793474 = sum of:
         0.014562398 = weight(abstract_txt:with in 104) [ClassicSimilarity], result of:
           0.014562398 = score(doc=104,freq=2.0), product of:
             0.04400254 = queryWeight, product of:
               1.017636 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.017322732 = queryNorm
             0.33094448 = fieldWeight in 104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.04504008 = weight(abstract_txt:offers in 104) [ClassicSimilarity], result of:
           0.04504008 = score(doc=104,freq=1.0), product of:
             0.093408965 = queryWeight, product of:
               1.0484141 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.017322732 = queryNorm
             0.48218155 = fieldWeight in 104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.08486381 = weight(abstract_txt:engines in 104) [ClassicSimilarity], result of:
           0.08486381 = score(doc=104,freq=3.0), product of:
             0.098801546 = queryWeight, product of:
               1.0782524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.017322732 = queryNorm
             0.858932 = fieldWeight in 104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.06981196 = weight(abstract_txt:overview in 104) [ClassicSimilarity], result of:
           0.06981196 = score(doc=104,freq=2.0), product of:
             0.09929614 = queryWeight, product of:
               1.0809479 = boost
               5.3028727 = idf(docFreq=600, maxDocs=44421)
               0.017322732 = queryNorm
             0.70306826 = fieldWeight in 104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3028727 = idf(docFreq=600, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.051059183 = weight(abstract_txt:focuses in 104) [ClassicSimilarity], result of:
           0.051059183 = score(doc=104,freq=1.0), product of:
             0.10155587 = queryWeight, product of:
               1.0931785 = boost
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.017322732 = queryNorm
             0.5027694 = fieldWeight in 104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.05547449 = weight(abstract_txt:engine in 104) [ClassicSimilarity], result of:
           0.05547449 = score(doc=104,freq=1.0), product of:
             0.10732922 = queryWeight, product of:
               1.1238221 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.017322732 = queryNorm
             0.51686287 = fieldWeight in 104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
         0.25853541 = weight(abstract_txt:search in 104) [ClassicSimilarity], result of:
           0.25853541 = score(doc=104,freq=4.0), product of:
             0.37729335 = queryWeight, product of:
               5.959683 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.017322732 = queryNorm
             0.6852371 = fieldWeight in 104, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.09375 = fieldNorm(doc=104)
       0.28 = coord(7/25)
   

5. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.16

   0.15841573 = sum of:
     0.15841573 = product of:
       0.7920787 = sum of:
         0.05211219 = weight(abstract_txt:task in 540) [ClassicSimilarity], result of:
           0.05211219 = score(doc=540,freq=4.0), product of:
             0.084981196 = queryWeight, product of:
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.017322732 = queryNorm
             0.6132202 = fieldWeight in 540, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.032940682 = weight(abstract_txt:real in 540) [ClassicSimilarity], result of:
           0.032940682 = score(doc=540,freq=1.0), product of:
             0.0993585 = queryWeight, product of:
               1.0812873 = boost
               5.304538 = idf(docFreq=599, maxDocs=44421)
               0.017322732 = queryNorm
             0.3315336 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.304538 = idf(docFreq=599, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.23037331 = weight(abstract_txt:trec in 540) [ClassicSimilarity], result of:
           0.23037331 = score(doc=540,freq=3.0), product of:
             0.3174249 = queryWeight, product of:
               2.7332168 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.017322732 = queryNorm
             0.7257569 = fieldWeight in 540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.390474 = weight(abstract_txt:track in 540) [ClassicSimilarity], result of:
           0.390474 = score(doc=540,freq=3.0), product of:
             0.5165488 = queryWeight, product of:
               4.2702656 = boost
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.017322732 = queryNorm
             0.7559285 = fieldWeight in 540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.982969 = idf(docFreq=111, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.08617847 = weight(abstract_txt:search in 540) [ClassicSimilarity], result of:
           0.08617847 = score(doc=540,freq=1.0), product of:
             0.37729335 = queryWeight, product of:
               5.959683 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.017322732 = queryNorm
             0.22841237 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
       0.2 = coord(5/25)