Document (#13328)

Author

Pair, C.I.

Title

Formal evaluation methods : their utility and limitations

Source

International forum on information and documentation. 20(1995) no.4, S.16-24

Year

1995

Abstract

Discusses evaluation techniques as an integral part of science with the emphasis on evalution for policy purposes. Outlines early attempts to validate the use of biliometric indicators. Concludes that: best results are obtained by applying a variety of methods simultaneously; reliable results can be obtained from citation analysis for purely scientific subfields such as physics; and citation analysis tends to give unreliable results for technological subjects. Concludes that bibliometrics as a technique for determining policy should never be used on its own. Describes an evaluation method used for selecting research projects for financial support, as applied by STW, the technology branch of the Netherlands' research council, NWO

Theme

Citation indexing
Informetrie

Similar documents (content)

1. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.18

   0.18094064 = sum of:
     0.18094064 = product of:
       0.75391936 = sum of:
         0.022696216 = weight(abstract_txt:used in 1942) [ClassicSimilarity], result of:
           0.022696216 = score(doc=1942,freq=1.0), product of:
             0.08653388 = queryWeight, product of:
               1.031634 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.024985228 = queryNorm
             0.26228127 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.073905334 = weight(abstract_txt:methods in 1942) [ClassicSimilarity], result of:
           0.073905334 = score(doc=1942,freq=3.0), product of:
             0.13181373 = queryWeight, product of:
               1.2732476 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.024985228 = queryNorm
             0.5606801 = fieldWeight in 1942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.20140119 = weight(abstract_txt:unreliable in 1942) [ClassicSimilarity], result of:
           0.20140119 = score(doc=1942,freq=1.0), product of:
             0.29438472 = queryWeight, product of:
               1.3454735 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.024985228 = queryNorm
             0.6841428 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.06560004 = weight(abstract_txt:results in 1942) [ClassicSimilarity], result of:
           0.06560004 = score(doc=1942,freq=3.0), product of:
             0.13936165 = queryWeight, product of:
               1.6034293 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024985228 = queryNorm
             0.47071803 = fieldWeight in 1942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.16155402 = weight(abstract_txt:obtained in 1942) [ClassicSimilarity], result of:
           0.16155402 = score(doc=1942,freq=2.0), product of:
             0.25414744 = queryWeight, product of:
               1.7679721 = boost
               5.7534328 = idf(docFreq=382, maxDocs=44421)
               0.024985228 = queryNorm
             0.6356705 = fieldWeight in 1942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7534328 = idf(docFreq=382, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.22876254 = weight(abstract_txt:evaluation in 1942) [ClassicSimilarity], result of:
           0.22876254 = score(doc=1942,freq=8.0), product of:
             0.23110406 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024985228 = queryNorm
             0.9898681 = fieldWeight in 1942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
       0.24 = coord(6/25)
   

2. Osareh, F.: Bibliometrics, citation analysis and co-citation analysis : a review of literature II (1996) 0.13

   0.13029006 = sum of:
     0.13029006 = product of:
       0.6514503 = sum of:
         0.036313944 = weight(abstract_txt:used in 174) [ClassicSimilarity], result of:
           0.036313944 = score(doc=174,freq=1.0), product of:
             0.08653388 = queryWeight, product of:
               1.031634 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.024985228 = queryNorm
             0.41965002 = fieldWeight in 174, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.125 = fieldNorm(doc=174)
         0.16796482 = weight(abstract_txt:bibliometrics in 174) [ClassicSimilarity], result of:
           0.16796482 = score(doc=174,freq=1.0), product of:
             0.19066578 = queryWeight, product of:
               1.0828141 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.024985228 = queryNorm
             0.8809384 = fieldWeight in 174, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.125 = fieldNorm(doc=174)
         0.1039826 = weight(abstract_txt:analysis in 174) [ClassicSimilarity], result of:
           0.1039826 = score(doc=174,freq=5.0), product of:
             0.102044046 = queryWeight, product of:
               1.1202794 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.024985228 = queryNorm
             1.0189972 = fieldWeight in 174, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.125 = fieldNorm(doc=174)
         0.068270825 = weight(abstract_txt:methods in 174) [ClassicSimilarity], result of:
           0.068270825 = score(doc=174,freq=1.0), product of:
             0.13181373 = queryWeight, product of:
               1.2732476 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.024985228 = queryNorm
             0.5179341 = fieldWeight in 174, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.125 = fieldNorm(doc=174)
         0.2749181 = weight(abstract_txt:citation in 174) [ClassicSimilarity], result of:
           0.2749181 = score(doc=174,freq=6.0), product of:
             0.18360691 = queryWeight, product of:
               1.5027164 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.024985228 = queryNorm
             1.497319 = fieldWeight in 174, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.125 = fieldNorm(doc=174)
       0.2 = coord(5/25)
   

3. Bar-Ilan, J.: Informetrics (2009) 0.13

   0.1301846 = sum of:
     0.1301846 = product of:
       0.650923 = sum of:
         0.14846133 = weight(abstract_txt:bibliometrics in 809) [ClassicSimilarity], result of:
           0.14846133 = score(doc=809,freq=2.0), product of:
             0.19066578 = queryWeight, product of:
               1.0828141 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.024985228 = queryNorm
             0.77864695 = fieldWeight in 809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=809)
         0.05034036 = weight(abstract_txt:analysis in 809) [ClassicSimilarity], result of:
           0.05034036 = score(doc=809,freq=3.0), product of:
             0.102044046 = queryWeight, product of:
               1.1202794 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.024985228 = queryNorm
             0.4933199 = fieldWeight in 809, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.078125 = fieldNorm(doc=809)
         0.19744653 = weight(abstract_txt:subfields in 809) [ClassicSimilarity], result of:
           0.19744653 = score(doc=809,freq=2.0), product of:
             0.23058455 = queryWeight, product of:
               1.190783 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.024985228 = queryNorm
             0.8562869 = fieldWeight in 809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.078125 = fieldNorm(doc=809)
         0.14029355 = weight(abstract_txt:citation in 809) [ClassicSimilarity], result of:
           0.14029355 = score(doc=809,freq=4.0), product of:
             0.18360691 = queryWeight, product of:
               1.5027164 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.024985228 = queryNorm
             0.76409733 = fieldWeight in 809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=809)
         0.11438127 = weight(abstract_txt:evaluation in 809) [ClassicSimilarity], result of:
           0.11438127 = score(doc=809,freq=2.0), product of:
             0.23110406 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024985228 = queryNorm
             0.49493405 = fieldWeight in 809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=809)
       0.2 = coord(5/25)
   

4. Wan, X.; Liu, F.: Are all literature citations equally important? : automatic citation strength estimation and its applications (2014) 0.13

   0.13014825 = sum of:
     0.13014825 = product of:
       0.54228437 = sum of:
         0.10497801 = weight(abstract_txt:bibliometrics in 2350) [ClassicSimilarity], result of:
           0.10497801 = score(doc=2350,freq=1.0), product of:
             0.19066578 = queryWeight, product of:
               1.0828141 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.024985228 = queryNorm
             0.5505865 = fieldWeight in 2350, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
         0.04110273 = weight(abstract_txt:analysis in 2350) [ClassicSimilarity], result of:
           0.04110273 = score(doc=2350,freq=2.0), product of:
             0.102044046 = queryWeight, product of:
               1.1202794 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.024985228 = queryNorm
             0.402794 = fieldWeight in 2350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
         0.042669266 = weight(abstract_txt:methods in 2350) [ClassicSimilarity], result of:
           0.042669266 = score(doc=2350,freq=1.0), product of:
             0.13181373 = queryWeight, product of:
               1.2732476 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.024985228 = queryNorm
             0.3237088 = fieldWeight in 2350, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
         0.18559091 = weight(abstract_txt:citation in 2350) [ClassicSimilarity], result of:
           0.18559091 = score(doc=2350,freq=7.0), product of:
             0.18360691 = queryWeight, product of:
               1.5027164 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.024985228 = queryNorm
             1.0108057 = fieldWeight in 2350, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
         0.05356221 = weight(abstract_txt:results in 2350) [ClassicSimilarity], result of:
           0.05356221 = score(doc=2350,freq=2.0), product of:
             0.13936165 = queryWeight, product of:
               1.6034293 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024985228 = queryNorm
             0.38433966 = fieldWeight in 2350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
         0.11438127 = weight(abstract_txt:evaluation in 2350) [ClassicSimilarity], result of:
           0.11438127 = score(doc=2350,freq=2.0), product of:
             0.23110406 = queryWeight, product of:
               2.0648189 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024985228 = queryNorm
             0.49493405 = fieldWeight in 2350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=2350)
       0.24 = coord(6/25)
   

5. Osareh, F.: Bibliometrics, citation analysis and co-citation analysis : a review of literature I (1996) 0.11

   0.11332226 = sum of:
     0.11332226 = product of:
       0.5666113 = sum of:
         0.036313944 = weight(abstract_txt:used in 239) [ClassicSimilarity], result of:
           0.036313944 = score(doc=239,freq=1.0), product of:
             0.08653388 = queryWeight, product of:
               1.031634 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.024985228 = queryNorm
             0.41965002 = fieldWeight in 239, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.125 = fieldNorm(doc=239)
         0.23753811 = weight(abstract_txt:bibliometrics in 239) [ClassicSimilarity], result of:
           0.23753811 = score(doc=239,freq=2.0), product of:
             0.19066578 = queryWeight, product of:
               1.0828141 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.024985228 = queryNorm
             1.2458351 = fieldWeight in 239, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.125 = fieldNorm(doc=239)
         0.06576437 = weight(abstract_txt:analysis in 239) [ClassicSimilarity], result of:
           0.06576437 = score(doc=239,freq=2.0), product of:
             0.102044046 = queryWeight, product of:
               1.1202794 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.024985228 = queryNorm
             0.6444704 = fieldWeight in 239, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.125 = fieldNorm(doc=239)
         0.068270825 = weight(abstract_txt:methods in 239) [ClassicSimilarity], result of:
           0.068270825 = score(doc=239,freq=1.0), product of:
             0.13181373 = queryWeight, product of:
               1.2732476 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.024985228 = queryNorm
             0.5179341 = fieldWeight in 239, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.125 = fieldNorm(doc=239)
         0.15872404 = weight(abstract_txt:citation in 239) [ClassicSimilarity], result of:
           0.15872404 = score(doc=239,freq=2.0), product of:
             0.18360691 = queryWeight, product of:
               1.5027164 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.024985228 = queryNorm
             0.86447746 = fieldWeight in 239, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.125 = fieldNorm(doc=239)
       0.2 = coord(5/25)