Document (#35124)

Author

Abramo, G.
D'Angelo, C.A.

Title

¬A decision support system for public research organizations participating in national research assessment exercises

Source

Journal of the American Society for Information Science and Technology. 60(2009) no.10, S.2095-2106

Year

2009

Abstract

We are witnessing a rapid trend toward the adoption of exercises for evaluation of national research systems, generally based on peer review. They respond to two main needs: stimulating higher efficiency in research activities by public laboratories, and realizing better allocative efficiency in government funding of such institutions. However, the peer review approach is typified by several limitations that raise doubts for the achievement of the ultimate objectives. In particular, subjectivity of judgment, which occurs during the step of selecting research outputs to be submitted for the evaluations, risks heavily distorting both the final ratings of the organizations evaluated and the ultimate funding they receive. These distortions become ever more relevant if the evaluation is limited to small samples of the scientific production of the research institutions. The objective of the current study is to propose a quantitative methodology based on bibliometric data that would provide a reliable support for the process of selecting the best products of a laboratory, and thus limit distortions. Benefits are twofold: single research institutions can maximize the probability of receiving a fair evaluation coherent with the real quality of their research. At the same time, broader adoptions of this approach could also provide strong advantages at the macroeconomic level, since it guarantees financial allocations based on the real value of the institutions under evaluation. In this study the proposed methodology was applied to the hard science sectors of the Italian university research system for the period 2004-2006.

Theme

Informetrie

Location

I

Similar documents (author)

1. Abramo, G.; D'Angelo, C.A.: ¬The VQR, Italy's second national research assessment : methodological failures and ranking distortions (2015) 6.68

   6.6800256 = sum of:
     6.6800256 = sum of:
       3.2841418 = weight(author_txt:d'angelo in 2256) [ClassicSimilarity], result of:
         3.2841418 = score(doc=2256,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           4.697151 = fieldWeight in 2256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.5 = fieldNorm(doc=2256)
       3.3958838 = weight(author_txt:abramo in 2256) [ClassicSimilarity], result of:
         3.3958838 = score(doc=2256,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           4.749831 = fieldWeight in 2256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.5 = fieldNorm(doc=2256)
   

2. Abramo, G.; D'Angelo, C.A.; Di Costa, F.: Testing the trade-off between productivity and quality in research activities (2009) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 3317) [ClassicSimilarity], result of:
         2.4631064 = score(doc=3317,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 3317, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=3317)
       2.546913 = weight(author_txt:abramo in 3317) [ClassicSimilarity], result of:
         2.546913 = score(doc=3317,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 3317, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=3317)
   

3. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 3470) [ClassicSimilarity], result of:
         2.4631064 = score(doc=3470,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 3470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=3470)
       2.546913 = weight(author_txt:abramo in 3470) [ClassicSimilarity], result of:
         2.546913 = score(doc=3470,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 3470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=3470)
   

4. D'Angelo, C.A.; Giuffrida, C.; Abramo, G.: ¬A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments (2011) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 4190) [ClassicSimilarity], result of:
         2.4631064 = score(doc=4190,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 4190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=4190)
       2.546913 = weight(author_txt:abramo in 4190) [ClassicSimilarity], result of:
         2.546913 = score(doc=4190,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 4190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=4190)
   

5. Abramo, G.; D'Angelo, C.A.; Costa, F. Di: Identifying interdisciplinarity through the disciplinary classification of coauthors of scientific publications (2012) 5.01

   5.0100193 = sum of:
     5.0100193 = sum of:
       2.4631064 = weight(author_txt:d'angelo in 491) [ClassicSimilarity], result of:
         2.4631064 = score(doc=491,freq=1.0), product of:
           0.6991774 = queryWeight, product of:
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.07442568 = queryNorm
           3.5228634 = fieldWeight in 491, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.394302 = idf(docFreq=9, maxDocs=44218)
             0.375 = fieldNorm(doc=491)
       2.546913 = weight(author_txt:abramo in 491) [ClassicSimilarity], result of:
         2.546913 = score(doc=491,freq=1.0), product of:
           0.7149483 = queryWeight, product of:
             1.0112153 = boost
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.07442568 = queryNorm
           3.5623734 = fieldWeight in 491, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.499662 = idf(docFreq=8, maxDocs=44218)
             0.375 = fieldNorm(doc=491)
   

Similar documents (content)

1. Mutz, R.; Bornmann, L.; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund (2015) 0.25

   0.2525117 = sum of:
     0.2525117 = product of:
       0.7014214 = sum of:
         0.014080305 = weight(abstract_txt:based in 2270) [ClassicSimilarity], result of:
           0.014080305 = score(doc=2270,freq=1.0), product of:
             0.07066812 = queryWeight, product of:
               1.1053375 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020054886 = queryNorm
             0.19924548 = fieldWeight in 2270, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.046990726 = weight(abstract_txt:review in 2270) [ClassicSimilarity], result of:
           0.046990726 = score(doc=2270,freq=2.0), product of:
             0.109425 = queryWeight, product of:
               1.1230414 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.020054886 = queryNorm
             0.42943317 = fieldWeight in 2270, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.061289083 = weight(abstract_txt:real in 2270) [ClassicSimilarity], result of:
           0.061289083 = score(doc=2270,freq=2.0), product of:
             0.13062628 = queryWeight, product of:
               1.2270231 = boost
               5.308326 = idf(docFreq=594, maxDocs=44218)
               0.020054886 = queryNorm
             0.46919414 = fieldWeight in 2270, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.308326 = idf(docFreq=594, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.047531743 = weight(abstract_txt:organizations in 2270) [ClassicSimilarity], result of:
           0.047531743 = score(doc=2270,freq=1.0), product of:
             0.13892303 = queryWeight, product of:
               1.2653906 = boost
               5.474311 = idf(docFreq=503, maxDocs=44218)
               0.020054886 = queryNorm
             0.34214443 = fieldWeight in 2270, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.474311 = idf(docFreq=503, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.1353142 = weight(abstract_txt:funding in 2270) [ClassicSimilarity], result of:
           0.1353142 = score(doc=2270,freq=3.0), product of:
             0.19348186 = queryWeight, product of:
               1.4933363 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.020054886 = queryNorm
             0.6993637 = fieldWeight in 2270, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.1590167 = weight(abstract_txt:peer in 2270) [ClassicSimilarity], result of:
           0.1590167 = score(doc=2270,freq=4.0), product of:
             0.19576134 = queryWeight, product of:
               1.5021073 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.020054886 = queryNorm
             0.8122988 = fieldWeight in 2270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.08012342 = weight(abstract_txt:selecting in 2270) [ClassicSimilarity], result of:
           0.08012342 = score(doc=2270,freq=1.0), product of:
             0.19676964 = queryWeight, product of:
               1.5059707 = boost
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.020054886 = queryNorm
             0.407194 = fieldWeight in 2270, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.07398406 = weight(abstract_txt:evaluation in 2270) [ClassicSimilarity], result of:
           0.07398406 = score(doc=2270,freq=2.0), product of:
             0.1865852 = queryWeight, product of:
               2.0739157 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020054886 = queryNorm
             0.3965162 = fieldWeight in 2270, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.08309111 = weight(abstract_txt:research in 2270) [ClassicSimilarity], result of:
           0.08309111 = score(doc=2270,freq=4.0), product of:
             0.2096713 = queryWeight, product of:
               3.297716 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020054886 = queryNorm
             0.39629224 = fieldWeight in 2270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
       0.36 = coord(9/25)
   

2. Thelwall, M.; Klitkou, A.; Verbeek, A.; Stuart, D.; Vincent, C.: Policy-relevant Webometrics for individual scientific fields (2010) 0.14

   0.14223893 = sum of:
     0.14223893 = product of:
       0.5079962 = sum of:
         0.030397385 = weight(abstract_txt:support in 3574) [ClassicSimilarity], result of:
           0.030397385 = score(doc=3574,freq=1.0), product of:
             0.08886606 = queryWeight, product of:
               1.0120581 = boost
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.020054886 = queryNorm
             0.34205842 = fieldWeight in 3574, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.01760038 = weight(abstract_txt:based in 3574) [ClassicSimilarity], result of:
           0.01760038 = score(doc=3574,freq=1.0), product of:
             0.07066812 = queryWeight, product of:
               1.1053375 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020054886 = queryNorm
             0.24905685 = fieldWeight in 3574, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.041534327 = weight(abstract_txt:review in 3574) [ClassicSimilarity], result of:
           0.041534327 = score(doc=3574,freq=1.0), product of:
             0.109425 = queryWeight, product of:
               1.1230414 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.020054886 = queryNorm
             0.3795689 = fieldWeight in 3574, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.08402505 = weight(abstract_txt:organizations in 3574) [ClassicSimilarity], result of:
           0.08402505 = score(doc=3574,freq=2.0), product of:
             0.13892303 = queryWeight, product of:
               1.2653906 = boost
               5.474311 = idf(docFreq=503, maxDocs=44218)
               0.020054886 = queryNorm
             0.60483164 = fieldWeight in 3574, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.474311 = idf(docFreq=503, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.09765461 = weight(abstract_txt:funding in 3574) [ClassicSimilarity], result of:
           0.09765461 = score(doc=3574,freq=1.0), product of:
             0.19348186 = queryWeight, product of:
               1.4933363 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.020054886 = queryNorm
             0.5047223 = fieldWeight in 3574, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.09938543 = weight(abstract_txt:peer in 3574) [ClassicSimilarity], result of:
           0.09938543 = score(doc=3574,freq=1.0), product of:
             0.19576134 = queryWeight, product of:
               1.5021073 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.020054886 = queryNorm
             0.50768673 = fieldWeight in 3574, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
         0.137399 = weight(abstract_txt:research in 3574) [ClassicSimilarity], result of:
           0.137399 = score(doc=3574,freq=7.0), product of:
             0.2096713 = queryWeight, product of:
               3.297716 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020054886 = queryNorm
             0.65530664 = fieldWeight in 3574, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=3574)
       0.28 = coord(7/25)
   

3. Holsapple, C.W.; O'Leary, D.: How much and where? : private versus public universities' publication patterns in the information systems discipline (2009) 0.14

   0.13556181 = sum of:
     0.13556181 = product of:
       0.48414934 = sum of:
         0.027770232 = weight(abstract_txt:methodology in 2719) [ClassicSimilarity], result of:
           0.027770232 = score(doc=2719,freq=1.0), product of:
             0.09708932 = queryWeight, product of:
               1.0578479 = boost
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.020054886 = queryNorm
             0.28602767 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5764427 = idf(docFreq=1236, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.06946143 = weight(abstract_txt:public in 2719) [ClassicSimilarity], result of:
           0.06946143 = score(doc=2719,freq=6.0), product of:
             0.09845334 = queryWeight, product of:
               1.0652529 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.020054886 = queryNorm
             0.70552635 = fieldWeight in 2719, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.024387803 = weight(abstract_txt:based in 2719) [ClassicSimilarity], result of:
           0.024387803 = score(doc=2719,freq=3.0), product of:
             0.07066812 = queryWeight, product of:
               1.1053375 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.020054886 = queryNorm
             0.3451033 = fieldWeight in 2719, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.11771228 = weight(abstract_txt:exercises in 2719) [ClassicSimilarity], result of:
           0.11771228 = score(doc=2719,freq=1.0), product of:
             0.25429216 = queryWeight, product of:
               1.7120008 = boost
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.020054886 = queryNorm
             0.46290174 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.07398406 = weight(abstract_txt:evaluation in 2719) [ClassicSimilarity], result of:
           0.07398406 = score(doc=2719,freq=2.0), product of:
             0.1865852 = queryWeight, product of:
               2.0739157 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020054886 = queryNorm
             0.3965162 = fieldWeight in 2719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.12928799 = weight(abstract_txt:institutions in 2719) [ClassicSimilarity], result of:
           0.12928799 = score(doc=2719,freq=2.0), product of:
             0.27070144 = queryWeight, product of:
               2.4980307 = boost
               5.403468 = idf(docFreq=540, maxDocs=44218)
               0.020054886 = queryNorm
             0.4776036 = fieldWeight in 2719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.403468 = idf(docFreq=540, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
         0.041545555 = weight(abstract_txt:research in 2719) [ClassicSimilarity], result of:
           0.041545555 = score(doc=2719,freq=1.0), product of:
             0.2096713 = queryWeight, product of:
               3.297716 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020054886 = queryNorm
             0.19814612 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2719)
       0.28 = coord(7/25)
   

4. D'Angelo, C.A.; Giuffrida, C.; Abramo, G.: ¬A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments (2011) 0.13

   0.13284028 = sum of:
     0.13284028 = product of:
       0.5535012 = sum of:
         0.0352364 = weight(abstract_txt:national in 4190) [ClassicSimilarity], result of:
           0.0352364 = score(doc=4190,freq=1.0), product of:
             0.098063216 = queryWeight, product of:
               1.0631403 = boost
               4.5993385 = idf(docFreq=1208, maxDocs=44218)
               0.020054886 = queryNorm
             0.35932332 = fieldWeight in 4190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5993385 = idf(docFreq=1208, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
         0.041534327 = weight(abstract_txt:review in 4190) [ClassicSimilarity], result of:
           0.041534327 = score(doc=4190,freq=1.0), product of:
             0.109425 = queryWeight, product of:
               1.1230414 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.020054886 = queryNorm
             0.3795689 = fieldWeight in 4190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
         0.09938543 = weight(abstract_txt:peer in 4190) [ClassicSimilarity], result of:
           0.09938543 = score(doc=4190,freq=1.0), product of:
             0.19576134 = queryWeight, product of:
               1.5021073 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.020054886 = queryNorm
             0.50768673 = fieldWeight in 4190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
         0.20808788 = weight(abstract_txt:exercises in 4190) [ClassicSimilarity], result of:
           0.20808788 = score(doc=4190,freq=2.0), product of:
             0.25429216 = queryWeight, product of:
               1.7120008 = boost
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.020054886 = queryNorm
             0.8183024 = fieldWeight in 4190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
         0.065393284 = weight(abstract_txt:evaluation in 4190) [ClassicSimilarity], result of:
           0.065393284 = score(doc=4190,freq=1.0), product of:
             0.1865852 = queryWeight, product of:
               2.0739157 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020054886 = queryNorm
             0.35047412 = fieldWeight in 4190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
         0.10386389 = weight(abstract_txt:research in 4190) [ClassicSimilarity], result of:
           0.10386389 = score(doc=4190,freq=4.0), product of:
             0.2096713 = queryWeight, product of:
               3.297716 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020054886 = queryNorm
             0.4953653 = fieldWeight in 4190, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=4190)
       0.24 = coord(6/25)
   

5. Brahms, E.: Digital library initiatives of the Deutsche Forschungsgemeinschaft (2001) 0.13

   0.13060611 = sum of:
     0.13060611 = product of:
       0.54419214 = sum of:
         0.042988393 = weight(abstract_txt:support in 1190) [ClassicSimilarity], result of:
           0.042988393 = score(doc=1190,freq=2.0), product of:
             0.08886606 = queryWeight, product of:
               1.0120581 = boost
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.020054886 = queryNorm
             0.48374367 = fieldWeight in 1190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.378348 = idf(docFreq=1507, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
         0.0352364 = weight(abstract_txt:national in 1190) [ClassicSimilarity], result of:
           0.0352364 = score(doc=1190,freq=1.0), product of:
             0.098063216 = queryWeight, product of:
               1.0631403 = boost
               4.5993385 = idf(docFreq=1208, maxDocs=44218)
               0.020054886 = queryNorm
             0.35932332 = fieldWeight in 1190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5993385 = idf(docFreq=1208, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
         0.050129466 = weight(abstract_txt:public in 1190) [ClassicSimilarity], result of:
           0.050129466 = score(doc=1190,freq=2.0), product of:
             0.09845334 = queryWeight, product of:
               1.0652529 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.020054886 = queryNorm
             0.50916976 = fieldWeight in 1190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
         0.13810448 = weight(abstract_txt:funding in 1190) [ClassicSimilarity], result of:
           0.13810448 = score(doc=1190,freq=2.0), product of:
             0.19348186 = queryWeight, product of:
               1.4933363 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.020054886 = queryNorm
             0.7137852 = fieldWeight in 1190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
         0.16160999 = weight(abstract_txt:institutions in 1190) [ClassicSimilarity], result of:
           0.16160999 = score(doc=1190,freq=2.0), product of:
             0.27070144 = queryWeight, product of:
               2.4980307 = boost
               5.403468 = idf(docFreq=540, maxDocs=44218)
               0.020054886 = queryNorm
             0.59700453 = fieldWeight in 1190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.403468 = idf(docFreq=540, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
         0.11612336 = weight(abstract_txt:research in 1190) [ClassicSimilarity], result of:
           0.11612336 = score(doc=1190,freq=5.0), product of:
             0.2096713 = queryWeight, product of:
               3.297716 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.020054886 = queryNorm
             0.5538353 = fieldWeight in 1190, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=1190)
       0.24 = coord(6/25)