Document (#17328)

Author

So, C.Y.K.

Title

Citation ranking versus expert judgement in evaluating communication scholars : effects of research specialty size and individual prominence

Source

Scientometrics. 41(1998) no.3, S.325-333

Year

1998

Abstract

Numerous attempts have been made to validate the use of citations as an evaluation method by comparing it with peer review. Unlike past studies using journals, research articles or universities as the subject matter, the present study extends the comparison to the ranking of individual scholars. Results show that citation ranking and expert judgement of communication scholars are highly correlated. The citation methods and the expert judgement method are found to work better in smaller research areas and yield more valid evaluation results for more prominent scholars

Theme

Informetrie
Citation indexing

Similar documents (content)

1. Meho, L.I.; Rogers, Y.: Citation counting, citation ranking, and h-index of human-computer interaction researchers : a comparison of Scopus and Web of Science (2008) 0.22

   0.22443944 = sum of:
     0.22443944 = product of:
       0.6234429 = sum of:
         0.0487275 = weight(abstract_txt:peer in 3352) [ClassicSimilarity], result of:
           0.0487275 = score(doc=3352,freq=1.0), product of:
             0.120294176 = queryWeight, product of:
               1.0049492 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.018469322 = queryNorm
             0.4050695 = fieldWeight in 3352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.019831795 = weight(abstract_txt:more in 3352) [ClassicSimilarity], result of:
           0.019831795 = score(doc=3352,freq=2.0), product of:
             0.06606476 = queryWeight, product of:
               1.0532264 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.018469322 = queryNorm
             0.3001872 = fieldWeight in 3352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.015069056 = weight(abstract_txt:results in 3352) [ClassicSimilarity], result of:
           0.015069056 = score(doc=3352,freq=1.0), product of:
             0.069309995 = queryWeight, product of:
               1.0787846 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.018469322 = queryNorm
             0.21741535 = fieldWeight in 3352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.03217974 = weight(abstract_txt:evaluation in 3352) [ClassicSimilarity], result of:
           0.03217974 = score(doc=3352,freq=1.0), product of:
             0.11493709 = queryWeight, product of:
               1.3892068 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018469322 = queryNorm
             0.279977 = fieldWeight in 3352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.023952488 = weight(abstract_txt:research in 3352) [ClassicSimilarity], result of:
           0.023952488 = score(doc=3352,freq=2.0), product of:
             0.08576814 = queryWeight, product of:
               1.4697566 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018469322 = queryNorm
             0.27927023 = fieldWeight in 3352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.05868994 = weight(abstract_txt:individual in 3352) [ClassicSimilarity], result of:
           0.05868994 = score(doc=3352,freq=2.0), product of:
             0.13617717 = queryWeight, product of:
               1.5121293 = boost
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.018469322 = queryNorm
             0.43098223 = fieldWeight in 3352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.15381846 = weight(abstract_txt:citation in 3352) [ClassicSimilarity], result of:
           0.15381846 = score(doc=3352,freq=6.0), product of:
             0.2054585 = queryWeight, product of:
               2.2748067 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.018469322 = queryNorm
             0.7486595 = fieldWeight in 3352, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.13312265 = weight(abstract_txt:ranking in 3352) [ClassicSimilarity], result of:
           0.13312265 = score(doc=3352,freq=2.0), product of:
             0.26910818 = queryWeight, product of:
               2.6034298 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.018469322 = queryNorm
             0.4946808 = fieldWeight in 3352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
         0.13805127 = weight(abstract_txt:scholars in 3352) [ClassicSimilarity], result of:
           0.13805127 = score(doc=3352,freq=1.0), product of:
             0.38233328 = queryWeight, product of:
               3.5832148 = boost
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.018469322 = queryNorm
             0.36107573 = fieldWeight in 3352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.0625 = fieldNorm(doc=3352)
       0.36 = coord(9/25)
   

2. Sen, B.K.; Pandalai, T.A.; Karanjai, A.: Ranking of scientists - a new approach (1998) 0.20

   0.19940832 = sum of:
     0.19940832 = product of:
       0.9970416 = sum of:
         0.085273124 = weight(abstract_txt:peer in 6113) [ClassicSimilarity], result of:
           0.085273124 = score(doc=6113,freq=1.0), product of:
             0.120294176 = queryWeight, product of:
               1.0049492 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.018469322 = queryNorm
             0.7088716 = fieldWeight in 6113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.109375 = fieldNorm(doc=6113)
         0.05704079 = weight(abstract_txt:method in 6113) [ClassicSimilarity], result of:
           0.05704079 = score(doc=6113,freq=1.0), product of:
             0.11592314 = queryWeight, product of:
               1.395153 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018469322 = queryNorm
             0.49205697 = fieldWeight in 6113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.109375 = fieldNorm(doc=6113)
         0.15541247 = weight(abstract_txt:citation in 6113) [ClassicSimilarity], result of:
           0.15541247 = score(doc=6113,freq=2.0), product of:
             0.2054585 = queryWeight, product of:
               2.2748067 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.018469322 = queryNorm
             0.75641775 = fieldWeight in 6113, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.109375 = fieldNorm(doc=6113)
         0.23296462 = weight(abstract_txt:ranking in 6113) [ClassicSimilarity], result of:
           0.23296462 = score(doc=6113,freq=2.0), product of:
             0.26910818 = queryWeight, product of:
               2.6034298 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.018469322 = queryNorm
             0.86569136 = fieldWeight in 6113, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.109375 = fieldNorm(doc=6113)
         0.46635056 = weight(abstract_txt:judgement in 6113) [ClassicSimilarity], result of:
           0.46635056 = score(doc=6113,freq=1.0), product of:
             0.5385407 = queryWeight, product of:
               3.682915 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.018469322 = queryNorm
             0.86595225 = fieldWeight in 6113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.109375 = fieldNorm(doc=6113)
       0.2 = coord(5/25)
   

3. Meho, L.I.; Sonnenwald, D.H.: Citation ranking versus peer evaluation of senior faculty research performance : a case study of Kurdish scholarship (2000) 0.19

   0.19041036 = sum of:
     0.19041036 = product of:
       0.7933765 = sum of:
         0.12181875 = weight(abstract_txt:peer in 5382) [ClassicSimilarity], result of:
           0.12181875 = score(doc=5382,freq=4.0), product of:
             0.120294176 = queryWeight, product of:
               1.0049492 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.018469322 = queryNorm
             1.0126737 = fieldWeight in 5382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.073946744 = weight(abstract_txt:valid in 5382) [ClassicSimilarity], result of:
           0.073946744 = score(doc=5382,freq=1.0), product of:
             0.13689929 = queryWeight, product of:
               1.0720682 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.018469322 = queryNorm
             0.54015434 = fieldWeight in 5382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.08044935 = weight(abstract_txt:evaluation in 5382) [ClassicSimilarity], result of:
           0.08044935 = score(doc=5382,freq=4.0), product of:
             0.11493709 = queryWeight, product of:
               1.3892068 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018469322 = queryNorm
             0.69994247 = fieldWeight in 5382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.03666961 = weight(abstract_txt:research in 5382) [ClassicSimilarity], result of:
           0.03666961 = score(doc=5382,freq=3.0), product of:
             0.08576814 = queryWeight, product of:
               1.4697566 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018469322 = queryNorm
             0.42754346 = fieldWeight in 5382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.19227308 = weight(abstract_txt:citation in 5382) [ClassicSimilarity], result of:
           0.19227308 = score(doc=5382,freq=6.0), product of:
             0.2054585 = queryWeight, product of:
               2.2748067 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.018469322 = queryNorm
             0.9358244 = fieldWeight in 5382, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.28821898 = weight(abstract_txt:ranking in 5382) [ClassicSimilarity], result of:
           0.28821898 = score(doc=5382,freq=6.0), product of:
             0.26910818 = queryWeight, product of:
               2.6034298 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.018469322 = queryNorm
             1.0710154 = fieldWeight in 5382, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
       0.24 = coord(6/25)
   

4. Serenko, A.; Bontis, N.: ¬A critical evaluation of expert survey-based journal rankings : the role of personal research interests (2018) 0.13

   0.13082218 = sum of:
     0.13082218 = product of:
       0.54509246 = sum of:
         0.017528998 = weight(abstract_txt:more in 228) [ClassicSimilarity], result of:
           0.017528998 = score(doc=228,freq=1.0), product of:
             0.06606476 = queryWeight, product of:
               1.0532264 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.018469322 = queryNorm
             0.26533052 = fieldWeight in 228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
         0.02663858 = weight(abstract_txt:results in 228) [ClassicSimilarity], result of:
           0.02663858 = score(doc=228,freq=2.0), product of:
             0.069309995 = queryWeight, product of:
               1.0787846 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.018469322 = queryNorm
             0.38433966 = fieldWeight in 228, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
         0.03666961 = weight(abstract_txt:research in 228) [ClassicSimilarity], result of:
           0.03666961 = score(doc=228,freq=3.0), product of:
             0.08576814 = queryWeight, product of:
               1.4697566 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018469322 = queryNorm
             0.42754346 = fieldWeight in 228, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
         0.16640331 = weight(abstract_txt:ranking in 228) [ClassicSimilarity], result of:
           0.16640331 = score(doc=228,freq=2.0), product of:
             0.26910818 = queryWeight, product of:
               2.6034298 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.018469322 = queryNorm
             0.618351 = fieldWeight in 228, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
         0.12528788 = weight(abstract_txt:expert in 228) [ClassicSimilarity], result of:
           0.12528788 = score(doc=228,freq=1.0), product of:
             0.280609 = queryWeight, product of:
               2.658479 = boost
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.018469322 = queryNorm
             0.44648558 = fieldWeight in 228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
         0.17256409 = weight(abstract_txt:scholars in 228) [ClassicSimilarity], result of:
           0.17256409 = score(doc=228,freq=1.0), product of:
             0.38233328 = queryWeight, product of:
               3.5832148 = boost
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.018469322 = queryNorm
             0.45134467 = fieldWeight in 228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.078125 = fieldNorm(doc=228)
       0.24 = coord(6/25)
   

5. Zhu, J.; Song, D.; Rüger, S.: Integrating multiple windows and document features for expert finding (2009) 0.13

   0.12855199 = sum of:
     0.12855199 = product of:
       0.45911425 = sum of:
         0.014023198 = weight(abstract_txt:more in 3755) [ClassicSimilarity], result of:
           0.014023198 = score(doc=3755,freq=1.0), product of:
             0.06606476 = queryWeight, product of:
               1.0532264 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.018469322 = queryNorm
             0.21226442 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.015069056 = weight(abstract_txt:results in 3755) [ClassicSimilarity], result of:
           0.015069056 = score(doc=3755,freq=1.0), product of:
             0.069309995 = queryWeight, product of:
               1.0787846 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.018469322 = queryNorm
             0.21741535 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.06265159 = weight(abstract_txt:prominent in 3755) [ClassicSimilarity], result of:
           0.06265159 = score(doc=3755,freq=1.0), product of:
             0.1422383 = queryWeight, product of:
               1.0927733 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.018469322 = queryNorm
             0.4404692 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.03217974 = weight(abstract_txt:evaluation in 3755) [ClassicSimilarity], result of:
           0.03217974 = score(doc=3755,freq=1.0), product of:
             0.11493709 = queryWeight, product of:
               1.3892068 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018469322 = queryNorm
             0.279977 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.016936967 = weight(abstract_txt:research in 3755) [ClassicSimilarity], result of:
           0.016936967 = score(doc=3755,freq=1.0), product of:
             0.08576814 = queryWeight, product of:
               1.4697566 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018469322 = queryNorm
             0.19747387 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.09413193 = weight(abstract_txt:ranking in 3755) [ClassicSimilarity], result of:
           0.09413193 = score(doc=3755,freq=1.0), product of:
             0.26910818 = queryWeight, product of:
               2.6034298 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.018469322 = queryNorm
             0.34979215 = fieldWeight in 3755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
         0.22412178 = weight(abstract_txt:expert in 3755) [ClassicSimilarity], result of:
           0.22412178 = score(doc=3755,freq=5.0), product of:
             0.280609 = queryWeight, product of:
               2.658479 = boost
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.018469322 = queryNorm
             0.7986977 = fieldWeight in 3755, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.0625 = fieldNorm(doc=3755)
       0.28 = coord(7/25)