Document (#26799)

Author

Borlund, P.

Title

¬The concept of relevance in IR

Source

Journal of the American Society for Information Science and technology. 54(2003) no.10, S.913-925

Year

2003

Abstract

This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept. The literature an relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no consensus has been reached an the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used-leading to a consistent and compatible understanding of the concept. In addition, special attention is paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval (IIR) evaluation.

Similar documents (author)

1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:borlund in 1922) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 1922, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=1922)
   

2. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:borlund in 3556) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 3556, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=3556)
   

3. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:borlund in 5549) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 5549, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=5549)
   

4. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:borlund in 3880) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 3880, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=3880)
   

5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.46

   4.4644394 = sum of:
     4.4644394 = weight(author_txt:borlund in 538) [ClassicSimilarity], result of:
       4.4644394 = fieldWeight in 538, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.5 = fieldNorm(doc=538)
   

Similar documents (content)

1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.36

   0.35552108 = sum of:
     0.35552108 = product of:
       1.2697182 = sum of:
         0.06583348 = weight(abstract_txt:consensus in 3620) [ClassicSimilarity], result of:
           0.06583348 = score(doc=3620,freq=1.0), product of:
             0.10156584 = queryWeight, product of:
               1.1173129 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.013147555 = queryNorm
             0.64818525 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.06680665 = weight(abstract_txt:multidimensional in 3620) [ClassicSimilarity], result of:
           0.06680665 = score(doc=3620,freq=1.0), product of:
             0.10256431 = queryWeight, product of:
               1.1227915 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.013147555 = queryNorm
             0.6513635 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.08107653 = weight(abstract_txt:reached in 3620) [ClassicSimilarity], result of:
           0.08107653 = score(doc=3620,freq=1.0), product of:
             0.11669348 = queryWeight, product of:
               1.1976345 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.013147555 = queryNorm
             0.694782 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.035811316 = weight(abstract_txt:evaluation in 3620) [ClassicSimilarity], result of:
           0.035811316 = score(doc=3620,freq=1.0), product of:
             0.085272044 = queryWeight, product of:
               1.4478358 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.013147555 = queryNorm
             0.4199655 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.26134357 = weight(abstract_txt:situational in 3620) [ClassicSimilarity], result of:
           0.26134357 = score(doc=3620,freq=1.0), product of:
             0.3672525 = queryWeight, product of:
               3.6799676 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.013147555 = queryNorm
             0.7116182 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.18025918 = weight(abstract_txt:concept in 3620) [ClassicSimilarity], result of:
           0.18025918 = score(doc=3620,freq=2.0), product of:
             0.30181265 = queryWeight, product of:
               5.0958743 = boost
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.013147555 = queryNorm
             0.59725523 = fieldWeight in 3620, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.5785874 = weight(abstract_txt:relevance in 3620) [ClassicSimilarity], result of:
           0.5785874 = score(doc=3620,freq=3.0), product of:
             0.72282207 = queryWeight, product of:
               11.152718 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013147555 = queryNorm
             0.80045617 = fieldWeight in 3620, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
       0.28 = coord(7/25)
   

2. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.27

   0.273051 = sum of:
     0.273051 = product of:
       1.365255 = sum of:
         0.044956885 = weight(abstract_txt:nature in 4268) [ClassicSimilarity], result of:
           0.044956885 = score(doc=4268,freq=1.0), product of:
             0.09923326 = queryWeight, product of:
               1.561869 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.013147555 = queryNorm
             0.4530425 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.076286845 = weight(abstract_txt:dynamic in 4268) [ClassicSimilarity], result of:
           0.076286845 = score(doc=4268,freq=1.0), product of:
             0.14117558 = queryWeight, product of:
               1.8629267 = boost
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.013147555 = queryNorm
             0.54036856 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.3695956 = weight(abstract_txt:situational in 4268) [ClassicSimilarity], result of:
           0.3695956 = score(doc=4268,freq=2.0), product of:
             0.3672525 = queryWeight, product of:
               3.6799676 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.013147555 = queryNorm
             1.0063801 = fieldWeight in 4268, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.12746249 = weight(abstract_txt:concept in 4268) [ClassicSimilarity], result of:
           0.12746249 = score(doc=4268,freq=1.0), product of:
             0.30181265 = queryWeight, product of:
               5.0958743 = boost
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.013147555 = queryNorm
             0.42232323 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.7469532 = weight(abstract_txt:relevance in 4268) [ClassicSimilarity], result of:
           0.7469532 = score(doc=4268,freq=5.0), product of:
             0.72282207 = queryWeight, product of:
               11.152718 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013147555 = queryNorm
             1.0333846 = fieldWeight in 4268, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
       0.2 = coord(5/25)
   

3. Huang, X.; Soergel, D.: Relevance: an improved framework for explicating the notion (2013) 0.23

   0.22681932 = sum of:
     0.22681932 = product of:
       1.1340966 = sum of:
         0.029131303 = weight(abstract_txt:article in 1527) [ClassicSimilarity], result of:
           0.029131303 = score(doc=1527,freq=4.0), product of:
             0.06133955 = queryWeight, product of:
               1.2279658 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.013147555 = queryNorm
             0.47491875 = fieldWeight in 1527, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.0625 = fieldNorm(doc=1527)
         0.029971257 = weight(abstract_txt:nature in 1527) [ClassicSimilarity], result of:
           0.029971257 = score(doc=1527,freq=1.0), product of:
             0.09923326 = queryWeight, product of:
               1.561869 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.013147555 = queryNorm
             0.30202833 = fieldWeight in 1527, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.0625 = fieldNorm(doc=1527)
         0.038257733 = weight(abstract_txt:many in 1527) [ClassicSimilarity], result of:
           0.038257733 = score(doc=1527,freq=2.0), product of:
             0.106093116 = queryWeight, product of:
               1.9779041 = boost
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.013147555 = queryNorm
             0.36060524 = fieldWeight in 1527, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.0625 = fieldNorm(doc=1527)
         0.17422904 = weight(abstract_txt:situational in 1527) [ClassicSimilarity], result of:
           0.17422904 = score(doc=1527,freq=1.0), product of:
             0.3672525 = queryWeight, product of:
               3.6799676 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.013147555 = queryNorm
             0.4744121 = fieldWeight in 1527, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.0625 = fieldNorm(doc=1527)
         0.8625072 = weight(abstract_txt:relevance in 1527) [ClassicSimilarity], result of:
           0.8625072 = score(doc=1527,freq=15.0), product of:
             0.72282207 = queryWeight, product of:
               11.152718 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013147555 = queryNorm
             1.1932497 = fieldWeight in 1527, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1527)
       0.2 = coord(5/25)
   

4. White, H.D.: Relevance in theory (2009) 0.19

   0.18884705 = sum of:
     0.18884705 = product of:
       0.78686273 = sum of:
         0.033403326 = weight(abstract_txt:multidimensional in 859) [ClassicSimilarity], result of:
           0.033403326 = score(doc=859,freq=1.0), product of:
             0.10256431 = queryWeight, product of:
               1.1227915 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.013147555 = queryNorm
             0.32568175 = fieldWeight in 859, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
         0.017905658 = weight(abstract_txt:evaluation in 859) [ClassicSimilarity], result of:
           0.017905658 = score(doc=859,freq=1.0), product of:
             0.085272044 = queryWeight, product of:
               1.4478358 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.013147555 = queryNorm
             0.20998275 = fieldWeight in 859, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
         0.038143422 = weight(abstract_txt:dynamic in 859) [ClassicSimilarity], result of:
           0.038143422 = score(doc=859,freq=1.0), product of:
             0.14117558 = queryWeight, product of:
               1.8629267 = boost
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.013147555 = queryNorm
             0.27018428 = fieldWeight in 859, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
         0.0286933 = weight(abstract_txt:many in 859) [ClassicSimilarity], result of:
           0.0286933 = score(doc=859,freq=2.0), product of:
             0.106093116 = queryWeight, product of:
               1.9779041 = boost
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.013147555 = queryNorm
             0.27045393 = fieldWeight in 859, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
         0.09012959 = weight(abstract_txt:concept in 859) [ClassicSimilarity], result of:
           0.09012959 = score(doc=859,freq=2.0), product of:
             0.30181265 = queryWeight, product of:
               5.0958743 = boost
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.013147555 = queryNorm
             0.29862761 = fieldWeight in 859, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
         0.5785874 = weight(abstract_txt:relevance in 859) [ClassicSimilarity], result of:
           0.5785874 = score(doc=859,freq=12.0), product of:
             0.72282207 = queryWeight, product of:
               11.152718 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013147555 = queryNorm
             0.80045617 = fieldWeight in 859, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.046875 = fieldNorm(doc=859)
       0.24 = coord(6/25)
   

5. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.19

   0.18879177 = sum of:
     0.18879177 = product of:
       0.78663236 = sum of:
         0.031465244 = weight(abstract_txt:argue in 3072) [ClassicSimilarity], result of:
           0.031465244 = score(doc=3072,freq=1.0), product of:
             0.08135758 = queryWeight, product of:
               6.188039 = idf(docFreq=247, maxDocs=44421)
               0.013147555 = queryNorm
             0.38675243 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.188039 = idf(docFreq=247, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.014565651 = weight(abstract_txt:article in 3072) [ClassicSimilarity], result of:
           0.014565651 = score(doc=3072,freq=1.0), product of:
             0.06133955 = queryWeight, product of:
               1.2279658 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.013147555 = queryNorm
             0.23745938 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.041351344 = weight(abstract_txt:evaluation in 3072) [ClassicSimilarity], result of:
           0.041351344 = score(doc=3072,freq=3.0), product of:
             0.085272044 = queryWeight, product of:
               1.4478358 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.013147555 = queryNorm
             0.48493436 = fieldWeight in 3072, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.027052302 = weight(abstract_txt:many in 3072) [ClassicSimilarity], result of:
           0.027052302 = score(doc=3072,freq=1.0), product of:
             0.106093116 = queryWeight, product of:
               1.9779041 = boost
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.013147555 = queryNorm
             0.2549864 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.17422904 = weight(abstract_txt:situational in 3072) [ClassicSimilarity], result of:
           0.17422904 = score(doc=3072,freq=1.0), product of:
             0.3672525 = queryWeight, product of:
               3.6799676 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.013147555 = queryNorm
             0.4744121 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.4979688 = weight(abstract_txt:relevance in 3072) [ClassicSimilarity], result of:
           0.4979688 = score(doc=3072,freq=5.0), product of:
             0.72282207 = queryWeight, product of:
               11.152718 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013147555 = queryNorm
             0.68892306 = fieldWeight in 3072, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
       0.24 = coord(6/25)