Document (#19627)

Author

Sugano, I.

Title

¬The study of criteria for evaluating OPACs as information retrieval systems

Source

Library and information science. 1996, no.35, S.41-49

Year

1996

Abstract

Most of the criteria proposed to date for the evaluation of OPACs focus on evaluation of their retrieval function. Argues that the storage function is more important because the quality of information retrieval systems is dependent on the quality of stored information as well as the description and depth of indexing of stored information. States that OPACs should therefore be evaluated from the perspectives of both storage and retrieval functions. Examines 4 studies on criteria for evaluating OPACs and suggests a new evaluation framework based on the work of C.R. Hildreth

Footnote

[Japanisch]

Theme

OPAC

Similar documents (content)

1. Cherry, J.M.: OPACs in twelve Canadian academic libraries : an evaluation of functional capabilities and interface features (1994) 0.24

   0.24143818 = sum of:
     0.24143818 = product of:
       1.0059924 = sum of:
         0.0109632015 = weight(abstract_txt:that in 3774) [ClassicSimilarity], result of:
           0.0109632015 = score(doc=3774,freq=1.0), product of:
             0.04238382 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017921768 = queryNorm
             0.2586648 = fieldWeight in 3774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
         0.0532067 = weight(abstract_txt:suggests in 3774) [ClassicSimilarity], result of:
           0.0532067 = score(doc=3774,freq=1.0), product of:
             0.096429385 = queryWeight, product of:
               1.0665708 = boost
               5.044741 = idf(docFreq=777, maxDocs=44421)
               0.017921768 = queryNorm
             0.55176854 = fieldWeight in 3774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.044741 = idf(docFreq=777, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
         0.07745962 = weight(abstract_txt:evaluated in 3774) [ClassicSimilarity], result of:
           0.07745962 = score(doc=3774,freq=1.0), product of:
             0.12386504 = queryWeight, product of:
               1.2088135 = boost
               5.717531 = idf(docFreq=396, maxDocs=44421)
               0.017921768 = queryNorm
             0.625355 = fieldWeight in 3774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.717531 = idf(docFreq=396, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
         0.16490558 = weight(abstract_txt:evaluating in 3774) [ClassicSimilarity], result of:
           0.16490558 = score(doc=3774,freq=1.0), product of:
             0.2582649 = queryWeight, product of:
               2.4684973 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.017921768 = queryNorm
             0.6385133 = fieldWeight in 3774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
         0.11176296 = weight(abstract_txt:evaluation in 3774) [ClassicSimilarity], result of:
           0.11176296 = score(doc=3774,freq=1.0), product of:
             0.22810642 = queryWeight, product of:
               2.8412821 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017921768 = queryNorm
             0.48995975 = fieldWeight in 3774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
         0.58769435 = weight(abstract_txt:opacs in 3774) [ClassicSimilarity], result of:
           0.58769435 = score(doc=3774,freq=3.0), product of:
             0.5263958 = queryWeight, product of:
               4.983921 = boost
               5.8933253 = idf(docFreq=332, maxDocs=44421)
               0.017921768 = queryNorm
             1.1164496 = fieldWeight in 3774, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8933253 = idf(docFreq=332, maxDocs=44421)
               0.109375 = fieldNorm(doc=3774)
       0.24 = coord(6/25)
   

2. O'Brien, A.: Relevance as an aid to evaluation in OPACs (1990) 0.24

   0.23686774 = sum of:
     0.23686774 = product of:
       0.8459562 = sum of:
         0.013289407 = weight(abstract_txt:that in 2132) [ClassicSimilarity], result of:
           0.013289407 = score(doc=2132,freq=2.0), product of:
             0.04238382 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017921768 = queryNorm
             0.31354907 = fieldWeight in 2132, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.056399453 = weight(abstract_txt:systems in 2132) [ClassicSimilarity], result of:
           0.056399453 = score(doc=2132,freq=4.0), product of:
             0.0881799 = queryWeight, product of:
               1.4423969 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.017921768 = queryNorm
             0.6395953 = fieldWeight in 2132, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.028440118 = weight(abstract_txt:information in 2132) [ClassicSimilarity], result of:
           0.028440118 = score(doc=2132,freq=2.0), product of:
             0.08868033 = queryWeight, product of:
               2.0456371 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017921768 = queryNorm
             0.3207038 = fieldWeight in 2132, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.14134763 = weight(abstract_txt:evaluating in 2132) [ClassicSimilarity], result of:
           0.14134763 = score(doc=2132,freq=1.0), product of:
             0.2582649 = queryWeight, product of:
               2.4684973 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.017921768 = queryNorm
             0.5472971 = fieldWeight in 2132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.13547717 = weight(abstract_txt:evaluation in 2132) [ClassicSimilarity], result of:
           0.13547717 = score(doc=2132,freq=2.0), product of:
             0.22810642 = queryWeight, product of:
               2.8412821 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017921768 = queryNorm
             0.5939209 = fieldWeight in 2132, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.059702102 = weight(abstract_txt:retrieval in 2132) [ClassicSimilarity], result of:
           0.059702102 = score(doc=2132,freq=1.0), product of:
             0.18317917 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017921768 = queryNorm
             0.3259219 = fieldWeight in 2132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
         0.41130036 = weight(abstract_txt:opacs in 2132) [ClassicSimilarity], result of:
           0.41130036 = score(doc=2132,freq=2.0), product of:
             0.5263958 = queryWeight, product of:
               4.983921 = boost
               5.8933253 = idf(docFreq=332, maxDocs=44421)
               0.017921768 = queryNorm
             0.7813519 = fieldWeight in 2132, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8933253 = idf(docFreq=332, maxDocs=44421)
               0.09375 = fieldNorm(doc=2132)
       0.28 = coord(7/25)
   

3. Qin, T.; Zhang, X.-D.; Tsai, M.-F.; Wang, D.-S.; Liu, T.-Y.; Li, H.: Query-level loss functions for information retrieval (2008) 0.21

   0.20521396 = sum of:
     0.20521396 = product of:
       0.64129364 = sum of:
         0.012529373 = weight(abstract_txt:that in 3066) [ClassicSimilarity], result of:
           0.012529373 = score(doc=3066,freq=4.0), product of:
             0.04238382 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017921768 = queryNorm
             0.2956169 = fieldWeight in 3066, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.037885495 = weight(abstract_txt:therefore in 3066) [ClassicSimilarity], result of:
           0.037885495 = score(doc=3066,freq=1.0), product of:
             0.11166211 = queryWeight, product of:
               1.1477251 = boost
               5.428591 = idf(docFreq=529, maxDocs=44421)
               0.017921768 = queryNorm
             0.33928692 = fieldWeight in 3066, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.428591 = idf(docFreq=529, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.11040276 = weight(abstract_txt:functions in 3066) [ClassicSimilarity], result of:
           0.11040276 = score(doc=3066,freq=8.0), product of:
             0.113906145 = queryWeight, product of:
               1.1592004 = boost
               5.4828677 = idf(docFreq=501, maxDocs=44421)
               0.017921768 = queryNorm
             0.9692432 = fieldWeight in 3066, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.4828677 = idf(docFreq=501, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.0134068 = weight(abstract_txt:information in 3066) [ClassicSimilarity], result of:
           0.0134068 = score(doc=3066,freq=1.0), product of:
             0.08868033 = queryWeight, product of:
               2.0456371 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017921768 = queryNorm
             0.15118122 = fieldWeight in 3066, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.1639089 = weight(abstract_txt:function in 3066) [ClassicSimilarity], result of:
           0.1639089 = score(doc=3066,freq=4.0), product of:
             0.23531461 = queryWeight, product of:
               2.3562665 = boost
               5.5724173 = idf(docFreq=458, maxDocs=44421)
               0.017921768 = queryNorm
             0.69655216 = fieldWeight in 3066, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5724173 = idf(docFreq=458, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.09031811 = weight(abstract_txt:evaluation in 3066) [ClassicSimilarity], result of:
           0.09031811 = score(doc=3066,freq=2.0), product of:
             0.22810642 = queryWeight, product of:
               2.8412821 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017921768 = queryNorm
             0.39594725 = fieldWeight in 3066, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.0398014 = weight(abstract_txt:retrieval in 3066) [ClassicSimilarity], result of:
           0.0398014 = score(doc=3066,freq=1.0), product of:
             0.18317917 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017921768 = queryNorm
             0.21728125 = fieldWeight in 3066, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
         0.17304082 = weight(abstract_txt:criteria in 3066) [ClassicSimilarity], result of:
           0.17304082 = score(doc=3066,freq=2.0), product of:
             0.35187358 = queryWeight, product of:
               3.5288966 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.017921768 = queryNorm
             0.49176985 = fieldWeight in 3066, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=3066)
       0.32 = coord(8/25)
   

4. Lesk, M.E.; Salton, G.: Relevance assements and retrieval system evaluation (1969) 0.20

   0.20416316 = sum of:
     0.20416316 = product of:
       0.6380099 = sum of:
         0.016276132 = weight(abstract_txt:that in 4219) [ClassicSimilarity], result of:
           0.016276132 = score(doc=4219,freq=3.0), product of:
             0.04238382 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017921768 = queryNorm
             0.3840176 = fieldWeight in 4219, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.093039796 = weight(abstract_txt:dependent in 4219) [ClassicSimilarity], result of:
           0.093039796 = score(doc=4219,freq=1.0), product of:
             0.15511085 = queryWeight, product of:
               1.3527142 = boost
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.017921768 = queryNorm
             0.59982777 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.028199727 = weight(abstract_txt:systems in 4219) [ClassicSimilarity], result of:
           0.028199727 = score(doc=4219,freq=1.0), product of:
             0.0881799 = queryWeight, product of:
               1.4423969 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.017921768 = queryNorm
             0.31979766 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.0201102 = weight(abstract_txt:information in 4219) [ClassicSimilarity], result of:
           0.0201102 = score(doc=4219,freq=1.0), product of:
             0.08868033 = queryWeight, product of:
               2.0456371 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017921768 = queryNorm
             0.22677183 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.14134763 = weight(abstract_txt:evaluating in 4219) [ClassicSimilarity], result of:
           0.14134763 = score(doc=4219,freq=1.0), product of:
             0.2582649 = queryWeight, product of:
               2.4684973 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.017921768 = queryNorm
             0.5472971 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.09579683 = weight(abstract_txt:evaluation in 4219) [ClassicSimilarity], result of:
           0.09579683 = score(doc=4219,freq=1.0), product of:
             0.22810642 = queryWeight, product of:
               2.8412821 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017921768 = queryNorm
             0.4199655 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.059702102 = weight(abstract_txt:retrieval in 4219) [ClassicSimilarity], result of:
           0.059702102 = score(doc=4219,freq=1.0), product of:
             0.18317917 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017921768 = queryNorm
             0.3259219 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
         0.18353751 = weight(abstract_txt:criteria in 4219) [ClassicSimilarity], result of:
           0.18353751 = score(doc=4219,freq=1.0), product of:
             0.35187358 = queryWeight, product of:
               3.5288966 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.017921768 = queryNorm
             0.5216007 = fieldWeight in 4219, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.09375 = fieldNorm(doc=4219)
       0.32 = coord(8/25)
   

5. Sieverts, E.G.; Zwart, B.D.: ¬A picture of retrieval software for systems with images (1994) 0.20

   0.19590285 = sum of:
     0.19590285 = product of:
       0.8162619 = sum of:
         0.028199727 = weight(abstract_txt:systems in 2028) [ClassicSimilarity], result of:
           0.028199727 = score(doc=2028,freq=1.0), product of:
             0.0881799 = queryWeight, product of:
               1.4423969 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.017921768 = queryNorm
             0.31979766 = fieldWeight in 2028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
         0.028440118 = weight(abstract_txt:information in 2028) [ClassicSimilarity], result of:
           0.028440118 = score(doc=2028,freq=2.0), product of:
             0.08868033 = queryWeight, product of:
               2.0456371 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017921768 = queryNorm
             0.3207038 = fieldWeight in 2028, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
         0.24517946 = weight(abstract_txt:storage in 2028) [ClassicSimilarity], result of:
           0.24517946 = score(doc=2028,freq=3.0), product of:
             0.25851673 = queryWeight, product of:
               2.4697006 = boost
               5.8406816 = idf(docFreq=350, maxDocs=44421)
               0.017921768 = queryNorm
             0.9484085 = fieldWeight in 2028, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8406816 = idf(docFreq=350, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
         0.13547717 = weight(abstract_txt:evaluation in 2028) [ClassicSimilarity], result of:
           0.13547717 = score(doc=2028,freq=2.0), product of:
             0.22810642 = queryWeight, product of:
               2.8412821 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017921768 = queryNorm
             0.5939209 = fieldWeight in 2028, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
         0.119404204 = weight(abstract_txt:retrieval in 2028) [ClassicSimilarity], result of:
           0.119404204 = score(doc=2028,freq=4.0), product of:
             0.18317917 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017921768 = queryNorm
             0.6518438 = fieldWeight in 2028, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
         0.25956124 = weight(abstract_txt:criteria in 2028) [ClassicSimilarity], result of:
           0.25956124 = score(doc=2028,freq=2.0), product of:
             0.35187358 = queryWeight, product of:
               3.5288966 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.017921768 = queryNorm
             0.7376548 = fieldWeight in 2028, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.09375 = fieldNorm(doc=2028)
       0.24 = coord(6/25)