Document (#39257)

Author

Abramo, G.
D'Angelo, C.A.

Title

¬The VQR, Italy's second national research assessment : methodological failures and ranking distortions

Source

Journal of the Association for Information Science and Technology. 66(2015) no.11, S.2202-2214

Year

2015

Series

Advances in information science

Abstract

The 2004-2010 VQR (Research Quality Evaluation), completed in July 2013, was Italy's second national research assessment exercise. The VQR performance evaluation followed a pattern also seen in other nations, as it was based on a selected subset of products. In this work, we identify the exercise's methodological weaknesses and measure the distortions that result from them in the university performance rankings. First, we create a scenario in which we assume the efficient selection of the products to be submitted by the universities and, from this, simulate a set of rankings applying the precise VQR rating criteria. Next, we compare these "VQR rankings" with those that would derive from the application of more-appropriate bibliometrics. Finally, we extend the comparison to university rankings based on the entire scientific production for the period, as indexed in the Web of Science.

Content

http://onlinelibrary.wiley.com/doi/10.1002/asi.23323/abstract.

Theme

Informetrie

Location

I

Similar documents (author)

1. Abramo, G.; D'Angelo, C.A.: ¬A decision support system for public research organizations participating in national research assessment exercises (2009) 6.68

   6.6832643 = sum of:
     6.6832643 = sum of:
       3.2857614 = weight(author_txt:d'angelo in 110) [ClassicSimilarity], result of:
         3.2857614 = score(doc=110,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           4.6994414 = fieldWeight in 110, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.5 = fieldNorm(doc=110)
       3.397503 = weight(author_txt:abramo in 110) [ClassicSimilarity], result of:
         3.397503 = score(doc=110,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           4.7521214 = fieldWeight in 110, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.5 = fieldNorm(doc=110)
   

2. Abramo, G.; D'Angelo, C.A.; Di Costa, F.: Testing the trade-off between productivity and quality in research activities (2009) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 304) [ClassicSimilarity], result of:
         2.464321 = score(doc=304,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 304, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=304)
       2.5481274 = weight(author_txt:abramo in 304) [ClassicSimilarity], result of:
         2.5481274 = score(doc=304,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 304, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=304)
   

3. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 457) [ClassicSimilarity], result of:
         2.464321 = score(doc=457,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=457)
       2.5481274 = weight(author_txt:abramo in 457) [ClassicSimilarity], result of:
         2.5481274 = score(doc=457,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=457)
   

4. D'Angelo, C.A.; Giuffrida, C.; Abramo, G.: ¬A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments (2011) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 190) [ClassicSimilarity], result of:
         2.464321 = score(doc=190,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=190)
       2.5481274 = weight(author_txt:abramo in 190) [ClassicSimilarity], result of:
         2.5481274 = score(doc=190,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=190)
   

5. Abramo, G.; D'Angelo, C.A.; Costa, F. Di: Identifying interdisciplinarity through the disciplinary classification of coauthors of scientific publications (2012) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 1491) [ClassicSimilarity], result of:
         2.464321 = score(doc=1491,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 1491, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=1491)
       2.5481274 = weight(author_txt:abramo in 1491) [ClassicSimilarity], result of:
         2.5481274 = score(doc=1491,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 1491, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=1491)
   

Similar documents (content)

1. Abramo, G.; D'Angelo, C.A.: ¬A decision support system for public research organizations participating in national research assessment exercises (2009) 0.20

   0.20166914 = sum of:
     0.20166914 = product of:
       0.7202469 = sum of:
         0.05772924 = weight(abstract_txt:submitted in 110) [ClassicSimilarity], result of:
           0.05772924 = score(doc=110,freq=1.0), product of:
             0.13193394 = queryWeight, product of:
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.018845048 = queryNorm
             0.4375617 = fieldWeight in 110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.02613363 = weight(abstract_txt:university in 110) [ClassicSimilarity], result of:
           0.02613363 = score(doc=110,freq=1.0), product of:
             0.098002195 = queryWeight, product of:
               1.2188623 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.018845048 = queryNorm
             0.26666373 = fieldWeight in 110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.060492977 = weight(abstract_txt:evaluation in 110) [ClassicSimilarity], result of:
           0.060492977 = score(doc=110,freq=4.0), product of:
             0.10803205 = queryWeight, product of:
               1.2797143 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018845048 = queryNorm
             0.559954 = fieldWeight in 110, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.032781545 = weight(abstract_txt:national in 110) [ClassicSimilarity], result of:
           0.032781545 = score(doc=110,freq=1.0), product of:
             0.113987066 = queryWeight, product of:
               1.3145119 = boost
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.018845048 = queryNorm
             0.28759003 = fieldWeight in 110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.042118907 = weight(abstract_txt:research in 110) [ClassicSimilarity], result of:
           0.042118907 = score(doc=110,freq=7.0), product of:
             0.08061548 = queryWeight, product of:
               1.3539156 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018845048 = queryNorm
             0.5224667 = fieldWeight in 110, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.059197225 = weight(abstract_txt:products in 110) [ClassicSimilarity], result of:
           0.059197225 = score(doc=110,freq=1.0), product of:
             0.1690325 = queryWeight, product of:
               1.6007439 = boost
               5.6033936 = idf(docFreq=444, maxDocs=44421)
               0.018845048 = queryNorm
             0.3502121 = fieldWeight in 110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6033936 = idf(docFreq=444, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
         0.44179338 = weight(abstract_txt:distortions in 110) [ClassicSimilarity], result of:
           0.44179338 = score(doc=110,freq=2.0), product of:
             0.51235634 = queryWeight, product of:
               2.786909 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.018845048 = queryNorm
             0.86227757 = fieldWeight in 110, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.0625 = fieldNorm(doc=110)
       0.28 = coord(7/25)
   

2. Kulczycki, E.; Huang, Y.; Zuccala, A.A.; Engels, T.C.E.; Ferrara, A.; Guns, R.; Pölönen, J.; Sivertsen, G.; Taskin, Z.; Zhang, L.: Uses of the Journal Impact Factor in national journal rankings in China and Europe (2022) 0.11

   0.110855445 = sum of:
     0.110855445 = product of:
       0.69284654 = sum of:
         0.010604317 = weight(abstract_txt:from in 1770) [ClassicSimilarity], result of:
           0.010604317 = score(doc=1770,freq=1.0), product of:
             0.061487693 = queryWeight, product of:
               1.1824328 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.018845048 = queryNorm
             0.17246243 = fieldWeight in 1770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.056779295 = weight(abstract_txt:national in 1770) [ClassicSimilarity], result of:
           0.056779295 = score(doc=1770,freq=3.0), product of:
             0.113987066 = queryWeight, product of:
               1.3145119 = boost
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.018845048 = queryNorm
             0.49812052 = fieldWeight in 1770, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.09025598 = weight(abstract_txt:assessment in 1770) [ClassicSimilarity], result of:
           0.09025598 = score(doc=1770,freq=2.0), product of:
             0.17772287 = queryWeight, product of:
               1.6413772 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.018845048 = queryNorm
             0.5078468 = fieldWeight in 1770, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.535207 = weight(abstract_txt:rankings in 1770) [ClassicSimilarity], result of:
           0.535207 = score(doc=1770,freq=6.0), product of:
             0.50863945 = queryWeight, product of:
               3.9269626 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.018845048 = queryNorm
             1.0522325 = fieldWeight in 1770, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
       0.16 = coord(4/25)
   

3. Huang, M.-H.; Lin, C.-S.; Chen, D.-Z.: Counting methods, country rank changes, and counting inflation in the assessment of national research productivity and impact (2011) 0.11

   0.10959626 = sum of:
     0.10959626 = product of:
       0.4566511 = sum of:
         0.010604317 = weight(abstract_txt:from in 942) [ClassicSimilarity], result of:
           0.010604317 = score(doc=942,freq=1.0), product of:
             0.061487693 = queryWeight, product of:
               1.1824328 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.018845048 = queryNorm
             0.17246243 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
         0.052388452 = weight(abstract_txt:evaluation in 942) [ClassicSimilarity], result of:
           0.052388452 = score(doc=942,freq=3.0), product of:
             0.10803205 = queryWeight, product of:
               1.2797143 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018845048 = queryNorm
             0.48493436 = fieldWeight in 942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
         0.032781545 = weight(abstract_txt:national in 942) [ClassicSimilarity], result of:
           0.032781545 = score(doc=942,freq=1.0), product of:
             0.113987066 = queryWeight, product of:
               1.3145119 = boost
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.018845048 = queryNorm
             0.28759003 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6014404 = idf(docFreq=1211, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
         0.0318389 = weight(abstract_txt:research in 942) [ClassicSimilarity], result of:
           0.0318389 = score(doc=942,freq=4.0), product of:
             0.08061548 = queryWeight, product of:
               1.3539156 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018845048 = queryNorm
             0.39494774 = fieldWeight in 942, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
         0.110540554 = weight(abstract_txt:assessment in 942) [ClassicSimilarity], result of:
           0.110540554 = score(doc=942,freq=3.0), product of:
             0.17772287 = queryWeight, product of:
               1.6413772 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.018845048 = queryNorm
             0.6219827 = fieldWeight in 942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
         0.21849732 = weight(abstract_txt:rankings in 942) [ClassicSimilarity], result of:
           0.21849732 = score(doc=942,freq=1.0), product of:
             0.50863945 = queryWeight, product of:
               3.9269626 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.018845048 = queryNorm
             0.4295721 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=942)
       0.24 = coord(6/25)
   

4. Gu, X.; Blackmore, K.L.: Developing a scholar classification scheme from publication patterns in academic science : a cluster analysis approach (2019) 0.11

   0.10858857 = sum of:
     0.10858857 = product of:
       0.4524524 = sum of:
         0.014996769 = weight(abstract_txt:from in 420) [ClassicSimilarity], result of:
           0.014996769 = score(doc=420,freq=2.0), product of:
             0.061487693 = queryWeight, product of:
               1.1824328 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.018845048 = queryNorm
             0.2438987 = fieldWeight in 420, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
         0.05226726 = weight(abstract_txt:university in 420) [ClassicSimilarity], result of:
           0.05226726 = score(doc=420,freq=4.0), product of:
             0.098002195 = queryWeight, product of:
               1.2188623 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.018845048 = queryNorm
             0.53332746 = fieldWeight in 420, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
         0.11100291 = weight(abstract_txt:simulate in 420) [ClassicSimilarity], result of:
           0.11100291 = score(doc=420,freq=1.0), product of:
             0.20400879 = queryWeight, product of:
               1.2435011 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.018845048 = queryNorm
             0.54410845 = fieldWeight in 420, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
         0.033174623 = weight(abstract_txt:performance in 420) [ClassicSimilarity], result of:
           0.033174623 = score(doc=420,freq=1.0), product of:
             0.114896454 = queryWeight, product of:
               1.3197451 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.018845048 = queryNorm
             0.28873494 = fieldWeight in 420, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
         0.022513505 = weight(abstract_txt:research in 420) [ClassicSimilarity], result of:
           0.022513505 = score(doc=420,freq=2.0), product of:
             0.08061548 = queryWeight, product of:
               1.3539156 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018845048 = queryNorm
             0.27927023 = fieldWeight in 420, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
         0.21849732 = weight(abstract_txt:rankings in 420) [ClassicSimilarity], result of:
           0.21849732 = score(doc=420,freq=1.0), product of:
             0.50863945 = queryWeight, product of:
               3.9269626 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.018845048 = queryNorm
             0.4295721 = fieldWeight in 420, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=420)
       0.24 = coord(6/25)
   

5. Arroyo-Machado, W.; Díaz-Faes, A.A.; Herrera-Viedma, E.; Costas, R.: From academic to media capital : to what extent does the scientific reputation of universities translate into Wikipedia attention? (2024) 0.09

   0.09425189 = sum of:
     0.09425189 = product of:
       0.39271623 = sum of:
         0.010604317 = weight(abstract_txt:from in 2261) [ClassicSimilarity], result of:
           0.010604317 = score(doc=2261,freq=1.0), product of:
             0.061487693 = queryWeight, product of:
               1.1824328 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.018845048 = queryNorm
             0.17246243 = fieldWeight in 2261, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.036958534 = weight(abstract_txt:university in 2261) [ClassicSimilarity], result of:
           0.036958534 = score(doc=2261,freq=2.0), product of:
             0.098002195 = queryWeight, product of:
               1.2188623 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.018845048 = queryNorm
             0.37711945 = fieldWeight in 2261, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.046915997 = weight(abstract_txt:performance in 2261) [ClassicSimilarity], result of:
           0.046915997 = score(doc=2261,freq=2.0), product of:
             0.114896454 = queryWeight, product of:
               1.3197451 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.018845048 = queryNorm
             0.40833285 = fieldWeight in 2261, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.01591945 = weight(abstract_txt:research in 2261) [ClassicSimilarity], result of:
           0.01591945 = score(doc=2261,freq=1.0), product of:
             0.08061548 = queryWeight, product of:
               1.3539156 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018845048 = queryNorm
             0.19747387 = fieldWeight in 2261, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.06382062 = weight(abstract_txt:assessment in 2261) [ClassicSimilarity], result of:
           0.06382062 = score(doc=2261,freq=1.0), product of:
             0.17772287 = queryWeight, product of:
               1.6413772 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.018845048 = queryNorm
             0.3591019 = fieldWeight in 2261, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
         0.21849732 = weight(abstract_txt:rankings in 2261) [ClassicSimilarity], result of:
           0.21849732 = score(doc=2261,freq=1.0), product of:
             0.50863945 = queryWeight, product of:
               3.9269626 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.018845048 = queryNorm
             0.4295721 = fieldWeight in 2261, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2261)
       0.24 = coord(6/25)