Document (#35892)

Author

Carterette, B.

Title

Test collections

Source

Encyclopedia of library and information sciences. 3rd ed. Ed.: M.J. Bates

Imprint

London : Taylor & Francis

Year

2009

Pages

S.xx-xx

Abstract

Research and development of search engines and other information retrieval (IR) systems proceeds by a cycle of design, implementation, and experimentation, with the results of each experiment influencing design decisions in the next iteration of the cycle. Batch experiments on test collections help ensure that this process goes as smoothly and as quickly as possible. A test collection comprises a collection of documents, a set of information needs, and judgments of the relevance of documents to those needs.

Footnote

Vgl.: http://www.tandfonline.com/doi/book/10.1081/E-ELIS3.

Theme

Retrievalstudien

Similar documents (content)

1. Keen, E.M.: Designing and testing an interactive ranked retrieval system for professional searchers (1994) 0.14

   0.1412728 = sum of:
     0.1412728 = product of:
       0.5886367 = sum of:
         0.09447843 = weight(abstract_txt:experiment in 1134) [ClassicSimilarity], result of:
           0.09447843 = score(doc=1134,freq=5.0), product of:
             0.11946498 = queryWeight, product of:
               1.1479456 = boost
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.018390445 = queryNorm
             0.7908462 = fieldWeight in 1134, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
         0.048588272 = weight(abstract_txt:design in 1134) [ClassicSimilarity], result of:
           0.048588272 = score(doc=1134,freq=3.0), product of:
             0.114551134 = queryWeight, product of:
               1.589702 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.018390445 = queryNorm
             0.4241623 = fieldWeight in 1134, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
         0.14035057 = weight(abstract_txt:batch in 1134) [ClassicSimilarity], result of:
           0.14035057 = score(doc=1134,freq=1.0), product of:
             0.2659612 = queryWeight, product of:
               1.7128139 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.018390445 = queryNorm
             0.5277107 = fieldWeight in 1134, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
         0.081190884 = weight(abstract_txt:collection in 1134) [ClassicSimilarity], result of:
           0.081190884 = score(doc=1134,freq=3.0), product of:
             0.16130579 = queryWeight, product of:
               1.8864313 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.018390445 = queryNorm
             0.50333524 = fieldWeight in 1134, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
         0.068361275 = weight(abstract_txt:collections in 1134) [ClassicSimilarity], result of:
           0.068361275 = score(doc=1134,freq=2.0), product of:
             0.16464515 = queryWeight, product of:
               1.9058578 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.018390445 = queryNorm
             0.4152037 = fieldWeight in 1134, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
         0.15566723 = weight(abstract_txt:test in 1134) [ClassicSimilarity], result of:
           0.15566723 = score(doc=1134,freq=3.0), product of:
             0.28497514 = queryWeight, product of:
               3.0708961 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.018390445 = queryNorm
             0.54624844 = fieldWeight in 1134, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=1134)
       0.24 = coord(6/25)
   

2. Spina, D.; Trippas, J.R.; Cavedon, L.; Sanderson, M.: Extracting audio summaries to support effective spoken document search (2017) 0.14

   0.13717243 = sum of:
     0.13717243 = product of:
       0.4899015 = sum of:
         0.049375176 = weight(abstract_txt:relevance in 4788) [ClassicSimilarity], result of:
           0.049375176 = score(doc=4788,freq=2.0), product of:
             0.09065629 = queryWeight, product of:
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018390445 = queryNorm
             0.5446415 = fieldWeight in 4788, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.052815046 = weight(abstract_txt:experiment in 4788) [ClassicSimilarity], result of:
           0.052815046 = score(doc=4788,freq=1.0), product of:
             0.11946498 = queryWeight, product of:
               1.1479456 = boost
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.018390445 = queryNorm
             0.44209647 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.05667267 = weight(abstract_txt:decisions in 4788) [ClassicSimilarity], result of:
           0.05667267 = score(doc=4788,freq=1.0), product of:
             0.12521353 = queryWeight, product of:
               1.1752403 = boost
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.018390445 = queryNorm
             0.45260817 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.09496563 = weight(abstract_txt:judgments in 4788) [ClassicSimilarity], result of:
           0.09496563 = score(doc=4788,freq=1.0), product of:
             0.1766498 = queryWeight, product of:
               1.3959106 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.018390445 = queryNorm
             0.53759265 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.0408647 = weight(abstract_txt:documents in 4788) [ClassicSimilarity], result of:
           0.0408647 = score(doc=4788,freq=1.0), product of:
             0.126856 = queryWeight, product of:
               1.672906 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018390445 = queryNorm
             0.32213452 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.08286511 = weight(abstract_txt:collection in 4788) [ClassicSimilarity], result of:
           0.08286511 = score(doc=4788,freq=2.0), product of:
             0.16130579 = queryWeight, product of:
               1.8864313 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.018390445 = queryNorm
             0.51371443 = fieldWeight in 4788, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.112343155 = weight(abstract_txt:test in 4788) [ClassicSimilarity], result of:
           0.112343155 = score(doc=4788,freq=1.0), product of:
             0.28497514 = queryWeight, product of:
               3.0708961 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.018390445 = queryNorm
             0.3942209 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
       0.28 = coord(7/25)
   

3. Losada, D.E.; Parapar, J.; Barreiro, A.: When to stop making relevance judgments? : a study of stopping methods for building information retrieval test collections (2019) 0.13

   0.12645844 = sum of:
     0.12645844 = product of:
       0.5269102 = sum of:
         0.048377592 = weight(abstract_txt:relevance in 674) [ClassicSimilarity], result of:
           0.048377592 = score(doc=674,freq=3.0), product of:
             0.09065629 = queryWeight, product of:
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018390445 = queryNorm
             0.53363746 = fieldWeight in 674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
         0.13158824 = weight(abstract_txt:judgments in 674) [ClassicSimilarity], result of:
           0.13158824 = score(doc=674,freq=3.0), product of:
             0.1766498 = queryWeight, product of:
               1.3959106 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.018390445 = queryNorm
             0.74491024 = fieldWeight in 674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
         0.056623787 = weight(abstract_txt:documents in 674) [ClassicSimilarity], result of:
           0.056623787 = score(doc=674,freq=3.0), product of:
             0.126856 = queryWeight, product of:
               1.672906 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018390445 = queryNorm
             0.4463627 = fieldWeight in 674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
         0.066292085 = weight(abstract_txt:collection in 674) [ClassicSimilarity], result of:
           0.066292085 = score(doc=674,freq=2.0), product of:
             0.16130579 = queryWeight, product of:
               1.8864313 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.018390445 = queryNorm
             0.41097152 = fieldWeight in 674, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
         0.068361275 = weight(abstract_txt:collections in 674) [ClassicSimilarity], result of:
           0.068361275 = score(doc=674,freq=2.0), product of:
             0.16464515 = queryWeight, product of:
               1.9058578 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.018390445 = queryNorm
             0.4152037 = fieldWeight in 674, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
         0.15566723 = weight(abstract_txt:test in 674) [ClassicSimilarity], result of:
           0.15566723 = score(doc=674,freq=3.0), product of:
             0.28497514 = queryWeight, product of:
               3.0708961 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.018390445 = queryNorm
             0.54624844 = fieldWeight in 674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=674)
       0.24 = coord(6/25)
   

4. Campos, L.M. de; Fernández-Luna, J.M.; Huete, J.F.: Implementing relevance feedback in the Bayesian network retrieval model (2003) 0.11

   0.11454793 = sum of:
     0.11454793 = product of:
       0.47728306 = sum of:
         0.06982704 = weight(abstract_txt:relevance in 1826) [ClassicSimilarity], result of:
           0.06982704 = score(doc=1826,freq=4.0), product of:
             0.09065629 = queryWeight, product of:
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018390445 = queryNorm
             0.77023935 = fieldWeight in 1826, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
         0.09496563 = weight(abstract_txt:judgments in 1826) [ClassicSimilarity], result of:
           0.09496563 = score(doc=1826,freq=1.0), product of:
             0.1766498 = queryWeight, product of:
               1.3959106 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.018390445 = queryNorm
             0.53759265 = fieldWeight in 1826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
         0.13568111 = weight(abstract_txt:experimentation in 1826) [ClassicSimilarity], result of:
           0.13568111 = score(doc=1826,freq=1.0), product of:
             0.22408618 = queryWeight, product of:
               1.5722028 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.018390445 = queryNorm
             0.6054863 = fieldWeight in 1826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
         0.05779141 = weight(abstract_txt:documents in 1826) [ClassicSimilarity], result of:
           0.05779141 = score(doc=1826,freq=2.0), product of:
             0.126856 = queryWeight, product of:
               1.672906 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018390445 = queryNorm
             0.455567 = fieldWeight in 1826, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
         0.058594476 = weight(abstract_txt:collection in 1826) [ClassicSimilarity], result of:
           0.058594476 = score(doc=1826,freq=1.0), product of:
             0.16130579 = queryWeight, product of:
               1.8864313 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.018390445 = queryNorm
             0.36325094 = fieldWeight in 1826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
         0.060423404 = weight(abstract_txt:collections in 1826) [ClassicSimilarity], result of:
           0.060423404 = score(doc=1826,freq=1.0), product of:
             0.16464515 = queryWeight, product of:
               1.9058578 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.018390445 = queryNorm
             0.3669917 = fieldWeight in 1826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.078125 = fieldNorm(doc=1826)
       0.24 = coord(6/25)
   

5. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.11

   0.11200012 = sum of:
     0.11200012 = product of:
       0.46666718 = sum of:
         0.073897995 = weight(abstract_txt:relevance in 3591) [ClassicSimilarity], result of:
           0.073897995 = score(doc=3591,freq=7.0), product of:
             0.09065629 = queryWeight, product of:
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.018390445 = queryNorm
             0.8151447 = fieldWeight in 3591, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.16987969 = weight(abstract_txt:judgments in 3591) [ClassicSimilarity], result of:
           0.16987969 = score(doc=3591,freq=5.0), product of:
             0.1766498 = queryWeight, product of:
               1.3959106 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.018390445 = queryNorm
             0.961675 = fieldWeight in 3591, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.028052453 = weight(abstract_txt:design in 3591) [ClassicSimilarity], result of:
           0.028052453 = score(doc=3591,freq=1.0), product of:
             0.114551134 = queryWeight, product of:
               1.589702 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.018390445 = queryNorm
             0.24489023 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.056623787 = weight(abstract_txt:documents in 3591) [ClassicSimilarity], result of:
           0.056623787 = score(doc=3591,freq=3.0), product of:
             0.126856 = queryWeight, product of:
               1.672906 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.018390445 = queryNorm
             0.4463627 = fieldWeight in 3591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.048338722 = weight(abstract_txt:collections in 3591) [ClassicSimilarity], result of:
           0.048338722 = score(doc=3591,freq=1.0), product of:
             0.16464515 = queryWeight, product of:
               1.9058578 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.018390445 = queryNorm
             0.29359335 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.08987452 = weight(abstract_txt:test in 3591) [ClassicSimilarity], result of:
           0.08987452 = score(doc=3591,freq=1.0), product of:
             0.28497514 = queryWeight, product of:
               3.0708961 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.018390445 = queryNorm
             0.3153767 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
       0.24 = coord(6/25)