Document (#12072)

Author

Ellis, D.

Title

¬The dilemma of measurement in information retrieval research

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.23-36

Year

1996

Abstract

The problem of measurement in information retrieval research is traced to its source in the first retrieval tests. The problem is seen as presenting a chronic dilemma for the field. This dilemma has taken 3 forms as the discipline has evloved: (1) the dilemma of measurement in the archetypal approach: stated relevance versus user relevance; (2) the dilemma of measurement in the probabilistic approach: realism versus formalism; and (3) the dilemma of measurement in the Information Retrieval-Expert System (IR-ES) approach: linear measures of relevance versus logarithmic measures of knowledge. It is argued that the dilemma of measurement has remained intractable even given the different assumptions of the different approaches for 3 connecte reasons - the nature of the subject matter of the field; the nature of relevance jidgement; and the nature of cognition and knowledge. Finally, it is concluded that the original vision of information retrieval research as a discipline founded on quantification proved restricting for its theoretical and methodological development and that increasing recognition of this is reflected in growing interest in qualitative methods in information retrieval research in relation to cognitive, behavioral, and affective aspects of the information retrieval interaction

Theme

Retrievalstudien

Similar documents (author)

1. Ellis, D.: ¬A behavioral approach to information system design (1989) 4.91

   4.907075 = sum of:
     4.907075 = weight(author_txt:ellis in 2705) [ClassicSimilarity], result of:
       4.907075 = fieldWeight in 2705, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.85132 = idf(docFreq=46, maxDocs=44421)
         0.625 = fieldNorm(doc=2705)
   

2. Ellis, D.: ¬A behavioral model for information retrieval system design (1989) 4.91

   4.907075 = sum of:
     4.907075 = weight(author_txt:ellis in 2706) [ClassicSimilarity], result of:
       4.907075 = fieldWeight in 2706, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.85132 = idf(docFreq=46, maxDocs=44421)
         0.625 = fieldNorm(doc=2706)
   

3. Ellis, D.: Hypertext; origins and use (1991) 4.91

   4.907075 = sum of:
     4.907075 = weight(author_txt:ellis in 4915) [ClassicSimilarity], result of:
       4.907075 = fieldWeight in 4915, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.85132 = idf(docFreq=46, maxDocs=44421)
         0.625 = fieldNorm(doc=4915)
   

4. Ellis, D.: Theory and explanation in information retrieval research (1984) 4.91

   4.907075 = sum of:
     4.907075 = weight(author_txt:ellis in 5336) [ClassicSimilarity], result of:
       4.907075 = fieldWeight in 5336, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.85132 = idf(docFreq=46, maxDocs=44421)
         0.625 = fieldNorm(doc=5336)
   

5. Ellis, D.: ¬The physical and cognitive paradigms in information retrieval research (1992) 4.91

   4.907075 = sum of:
     4.907075 = weight(author_txt:ellis in 8160) [ClassicSimilarity], result of:
       4.907075 = fieldWeight in 8160, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.85132 = idf(docFreq=46, maxDocs=44421)
         0.625 = fieldNorm(doc=8160)
   

Similar documents (content)

1. Thornley, C.: Dilemmas in information science (IS) and information retrieval (IR) : recurring challenges or new solutions? (2009) 0.25

   0.24914241 = sum of:
     0.24914241 = product of:
       0.6920622 = sum of:
         0.024439268 = weight(abstract_txt:problem in 3964) [ClassicSimilarity], result of:
           0.024439268 = score(doc=3964,freq=2.0), product of:
             0.06200378 = queryWeight, product of:
               1.238433 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.011227178 = queryNorm
             0.3941577 = fieldWeight in 3964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.017621107 = weight(abstract_txt:field in 3964) [ClassicSimilarity], result of:
           0.017621107 = score(doc=3964,freq=1.0), product of:
             0.06281425 = queryWeight, product of:
               1.2465007 = boost
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.011227178 = queryNorm
             0.28052723 = fieldWeight in 3964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.14488766 = weight(abstract_txt:intractable in 3964) [ClassicSimilarity], result of:
           0.14488766 = score(doc=3964,freq=3.0), product of:
             0.14082287 = queryWeight, product of:
               1.3197299 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.011227178 = queryNorm
             1.0288645 = fieldWeight in 3964, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.015305679 = weight(abstract_txt:approach in 3964) [ClassicSimilarity], result of:
           0.015305679 = score(doc=3964,freq=1.0), product of:
             0.06545882 = queryWeight, product of:
               1.558451 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.011227178 = queryNorm
             0.2338215 = fieldWeight in 3964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.017385293 = weight(abstract_txt:research in 3964) [ClassicSimilarity], result of:
           0.017385293 = score(doc=3964,freq=2.0), product of:
             0.06225258 = queryWeight, product of:
               1.7549192 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.011227178 = queryNorm
             0.27927023 = fieldWeight in 3964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.04665062 = weight(abstract_txt:nature in 3964) [ClassicSimilarity], result of:
           0.04665062 = score(doc=3964,freq=2.0), product of:
             0.10921813 = queryWeight, product of:
               2.0130587 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.011227178 = queryNorm
             0.42713255 = fieldWeight in 3964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.01654828 = weight(abstract_txt:information in 3964) [ClassicSimilarity], result of:
           0.01654828 = score(doc=3964,freq=4.0), product of:
             0.054729946 = queryWeight, product of:
               2.0152855 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.011227178 = queryNorm
             0.30236244 = fieldWeight in 3964, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.040528253 = weight(abstract_txt:retrieval in 3964) [ClassicSimilarity], result of:
           0.040528253 = score(doc=3964,freq=2.0), product of:
             0.13189267 = queryWeight, product of:
               3.3791525 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.011227178 = queryNorm
             0.3072821 = fieldWeight in 3964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
         0.36869603 = weight(abstract_txt:dilemma in 3964) [ClassicSimilarity], result of:
           0.36869603 = score(doc=3964,freq=1.0), product of:
             0.72416526 = queryWeight, product of:
               7.918015 = boost
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.011227178 = queryNorm
             0.50913244 = fieldWeight in 3964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.0625 = fieldNorm(doc=3964)
       0.36 = coord(9/25)
   

2. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.12

   0.12376885 = sum of:
     0.12376885 = product of:
       0.51570356 = sum of:
         0.017281173 = weight(abstract_txt:problem in 3072) [ClassicSimilarity], result of:
           0.017281173 = score(doc=3072,freq=1.0), product of:
             0.06200378 = queryWeight, product of:
               1.238433 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.011227178 = queryNorm
             0.2787116 = fieldWeight in 3072, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.043996707 = weight(abstract_txt:measures in 3072) [ClassicSimilarity], result of:
           0.043996707 = score(doc=3072,freq=2.0), product of:
             0.09175706 = queryWeight, product of:
               1.5065488 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.011227178 = queryNorm
             0.47949123 = fieldWeight in 3072, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.011701401 = weight(abstract_txt:information in 3072) [ClassicSimilarity], result of:
           0.011701401 = score(doc=3072,freq=2.0), product of:
             0.054729946 = queryWeight, product of:
               2.0152855 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.011227178 = queryNorm
             0.21380253 = fieldWeight in 3072, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.10439513 = weight(abstract_txt:relevance in 3072) [ClassicSimilarity], result of:
           0.10439513 = score(doc=3072,freq=5.0), product of:
             0.1515338 = queryWeight, product of:
               2.7379985 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011227178 = queryNorm
             0.68892306 = fieldWeight in 3072, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.0640808 = weight(abstract_txt:retrieval in 3072) [ClassicSimilarity], result of:
           0.0640808 = score(doc=3072,freq=5.0), product of:
             0.13189267 = queryWeight, product of:
               3.3791525 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.011227178 = queryNorm
             0.48585567 = fieldWeight in 3072, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
         0.27424833 = weight(abstract_txt:measurement in 3072) [ClassicSimilarity], result of:
           0.27424833 = score(doc=3072,freq=2.0), product of:
             0.4482247 = queryWeight, product of:
               5.7672925 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.011227178 = queryNorm
             0.61185455 = fieldWeight in 3072, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.0625 = fieldNorm(doc=3072)
       0.24 = coord(6/25)
   

3. Hjoerland, B.: Arguments for philosophical realism in library and information science (2004) 0.11

   0.113682926 = sum of:
     0.113682926 = product of:
       0.35525915 = sum of:
         0.03639281 = weight(abstract_txt:founded in 957) [ClassicSimilarity], result of:
           0.03639281 = score(doc=957,freq=1.0), product of:
             0.0808543 = queryWeight, product of:
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.011227178 = queryNorm
             0.4501036 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.03673457 = weight(abstract_txt:behavioral in 957) [ClassicSimilarity], result of:
           0.03673457 = score(doc=957,freq=1.0), product of:
             0.0813597 = queryWeight, product of:
               1.0031205 = boost
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.011227178 = queryNorm
             0.45150816 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.1224837 = weight(abstract_txt:realism in 957) [ClassicSimilarity], result of:
           0.1224837 = score(doc=957,freq=4.0), product of:
             0.114390925 = queryWeight, product of:
               1.1894447 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.011227178 = queryNorm
             1.0707467 = fieldWeight in 957, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.017385293 = weight(abstract_txt:research in 957) [ClassicSimilarity], result of:
           0.017385293 = score(doc=957,freq=2.0), product of:
             0.06225258 = queryWeight, product of:
               1.7549192 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.011227178 = queryNorm
             0.27927023 = fieldWeight in 957, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.04665062 = weight(abstract_txt:nature in 957) [ClassicSimilarity], result of:
           0.04665062 = score(doc=957,freq=2.0), product of:
             0.10921813 = queryWeight, product of:
               2.0130587 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.011227178 = queryNorm
             0.42713255 = fieldWeight in 957, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.020267421 = weight(abstract_txt:information in 957) [ClassicSimilarity], result of:
           0.020267421 = score(doc=957,freq=6.0), product of:
             0.054729946 = queryWeight, product of:
               2.0152855 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.011227178 = queryNorm
             0.37031686 = fieldWeight in 957, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.04668692 = weight(abstract_txt:relevance in 957) [ClassicSimilarity], result of:
           0.04668692 = score(doc=957,freq=1.0), product of:
             0.1515338 = queryWeight, product of:
               2.7379985 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011227178 = queryNorm
             0.30809575 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
         0.028657803 = weight(abstract_txt:retrieval in 957) [ClassicSimilarity], result of:
           0.028657803 = score(doc=957,freq=1.0), product of:
             0.13189267 = queryWeight, product of:
               3.3791525 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.011227178 = queryNorm
             0.21728125 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=957)
       0.32 = coord(8/25)
   

4. Skyrme, D.J.: Valuing information : is it worth it? (1998) 0.11

   0.10660177 = sum of:
     0.10660177 = product of:
       0.6662611 = sum of:
         0.035242215 = weight(abstract_txt:field in 2752) [ClassicSimilarity], result of:
           0.035242215 = score(doc=2752,freq=1.0), product of:
             0.06281425 = queryWeight, product of:
               1.2465007 = boost
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.011227178 = queryNorm
             0.56105447 = fieldWeight in 2752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.125 = fieldNorm(doc=2752)
         0.06597394 = weight(abstract_txt:nature in 2752) [ClassicSimilarity], result of:
           0.06597394 = score(doc=2752,freq=1.0), product of:
             0.10921813 = queryWeight, product of:
               2.0130587 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.011227178 = queryNorm
             0.60405666 = fieldWeight in 2752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.125 = fieldNorm(doc=2752)
         0.01654828 = weight(abstract_txt:information in 2752) [ClassicSimilarity], result of:
           0.01654828 = score(doc=2752,freq=1.0), product of:
             0.054729946 = queryWeight, product of:
               2.0152855 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.011227178 = queryNorm
             0.30236244 = fieldWeight in 2752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.125 = fieldNorm(doc=2752)
         0.54849666 = weight(abstract_txt:measurement in 2752) [ClassicSimilarity], result of:
           0.54849666 = score(doc=2752,freq=2.0), product of:
             0.4482247 = queryWeight, product of:
               5.7672925 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.011227178 = queryNorm
             1.2237091 = fieldWeight in 2752, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.125 = fieldNorm(doc=2752)
       0.16 = coord(4/25)
   

5. Houston, R.D.; Harmon, E.G.: Re-envisioning the information concept : systematic definitions (2002) 0.11

   0.105098225 = sum of:
     0.105098225 = product of:
       0.6568639 = sum of:
         0.035242215 = weight(abstract_txt:field in 1136) [ClassicSimilarity], result of:
           0.035242215 = score(doc=1136,freq=1.0), product of:
             0.06281425 = queryWeight, product of:
               1.2465007 = boost
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.011227178 = queryNorm
             0.56105447 = fieldWeight in 1136, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.125 = fieldNorm(doc=1136)
         0.20511353 = weight(abstract_txt:quantification in 1136) [ClassicSimilarity], result of:
           0.20511353 = score(doc=1136,freq=2.0), product of:
             0.12803409 = queryWeight, product of:
               1.2583784 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011227178 = queryNorm
             1.6020229 = fieldWeight in 1136, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.125 = fieldNorm(doc=1136)
         0.02866246 = weight(abstract_txt:information in 1136) [ClassicSimilarity], result of:
           0.02866246 = score(doc=1136,freq=3.0), product of:
             0.054729946 = queryWeight, product of:
               2.0152855 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.011227178 = queryNorm
             0.5237071 = fieldWeight in 1136, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.125 = fieldNorm(doc=1136)
         0.3878457 = weight(abstract_txt:measurement in 1136) [ClassicSimilarity], result of:
           0.3878457 = score(doc=1136,freq=1.0), product of:
             0.4482247 = queryWeight, product of:
               5.7672925 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.011227178 = queryNorm
             0.865293 = fieldWeight in 1136, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.125 = fieldNorm(doc=1136)
       0.16 = coord(4/25)