Document (#40312)

Author

Golub, K.
Soergel, D.
Buchanan, G.
Tudhope, D.
Lykke, M.
Hiom, D.

Title

¬A framework for evaluating automatic indexing or classification in the context of retrieval

Source

Journal of the Association for Information Science and Technology. 67(2016) no.1, S.3-16

Year

2016

Series

Advances in information science

Abstract

Tools for automatic subject assignment help deal with scale and sustainability in creating and enriching metadata, establishing more connections across and between resources and enhancing consistency. Although some software vendors and experimental researchers claim the tools can replace manual subject indexing, hard scientific evidence of their performance in operating information environments is scarce. A major reason for this is that research is usually conducted in laboratory conditions, excluding the complexities of real-life systems and situations. The article reviews and discusses issues with existing evaluation approaches such as problems of aboutness and relevance assessments, implying the need to use more than a single "gold standard" method when evaluating indexing and retrieval, and proposes a comprehensive evaluation framework. The framework is informed by a systematic review of the literature on evaluation approaches: evaluating indexing quality directly through assessment by an evaluator or through comparison with a gold standard, evaluating the quality of computer-assisted indexing directly in the context of an indexing workflow, and evaluating indexing quality indirectly through analyzing retrieval performance.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23600/abstract.

Theme

Automatisches Indexieren
Automatisches Klassifizieren

Similar documents (author)

1. Golub, K.; Lykke, M.; Tudhope, D.: Enhancing social tagging with automated keywords from the Dewey Decimal Classification (2014) 1.90

   1.9030375 = sum of:
     1.9030375 = product of:
       3.806075 = sum of:
         1.0528708 = weight(author_txt:tudhope in 3918) [ClassicSimilarity], result of:
           1.0528708 = score(doc=3918,freq=1.0), product of:
             0.347029 = queryWeight, product of:
               1.0065495 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.04261403 = queryNorm
             3.033956 = fieldWeight in 3918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.375 = fieldNorm(doc=3918)
         1.196709 = weight(author_txt:golub in 3918) [ClassicSimilarity], result of:
           1.196709 = score(doc=3918,freq=1.0), product of:
             0.37795618 = queryWeight, product of:
               1.0504441 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.04261403 = queryNorm
             3.166264 = fieldWeight in 3918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.375 = fieldNorm(doc=3918)
         1.5564952 = weight(author_txt:lykke in 3918) [ClassicSimilarity], result of:
           1.5564952 = score(doc=3918,freq=1.0), product of:
             0.4503473 = queryWeight, product of:
               1.1466372 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.04261403 = queryNorm
             3.4562106 = fieldWeight in 3918, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.375 = fieldNorm(doc=3918)
       0.5 = coord(3/6)
   

2. Golub, K.; Hansson, J.; Soergel, D.; Tudhope, D.: Managing classification in libraries : a methodological outline for evaluating automatic subject indexing and classification in Swedish library catalogues (2015) 1.37

   1.3675132 = sum of:
     1.3675132 = product of:
       2.7350264 = sum of:
         0.86037636 = weight(author_txt:soergel in 3300) [ClassicSimilarity], result of:
           0.86037636 = score(doc=3300,freq=1.0), product of:
             0.34252757 = queryWeight, product of:
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.04261403 = queryNorm
             2.5118456 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.3125 = fieldNorm(doc=3300)
         0.8773923 = weight(author_txt:tudhope in 3300) [ClassicSimilarity], result of:
           0.8773923 = score(doc=3300,freq=1.0), product of:
             0.347029 = queryWeight, product of:
               1.0065495 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.04261403 = queryNorm
             2.5282967 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=3300)
         0.9972576 = weight(author_txt:golub in 3300) [ClassicSimilarity], result of:
           0.9972576 = score(doc=3300,freq=1.0), product of:
             0.37795618 = queryWeight, product of:
               1.0504441 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.04261403 = queryNorm
             2.6385534 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.3125 = fieldNorm(doc=3300)
       0.5 = coord(3/6)
   

3. Golub, K.; Lykke, M.: Automated classification of web pages in hierarchical browsing (2009) 1.22

   1.2236463 = sum of:
     1.2236463 = product of:
       3.6709387 = sum of:
         1.595612 = weight(author_txt:golub in 601) [ClassicSimilarity], result of:
           1.595612 = score(doc=601,freq=1.0), product of:
             0.37795618 = queryWeight, product of:
               1.0504441 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.04261403 = queryNorm
             4.2216854 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.5 = fieldNorm(doc=601)
         2.0753267 = weight(author_txt:lykke in 601) [ClassicSimilarity], result of:
           2.0753267 = score(doc=601,freq=1.0), product of:
             0.4503473 = queryWeight, product of:
               1.1466372 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.04261403 = queryNorm
             4.6082807 = fieldWeight in 601, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.5 = fieldNorm(doc=601)
       0.33333334 = coord(2/6)
   

4. Golub, K.; Moon, J.; Nielsen, M.L.; Tudhope, D.: EnTag: Enhanced Tagging for Discovery (2008) 0.62

   0.6248833 = sum of:
     0.6248833 = product of:
       1.8746499 = sum of:
         0.8773923 = weight(author_txt:tudhope in 3294) [ClassicSimilarity], result of:
           0.8773923 = score(doc=3294,freq=1.0), product of:
             0.347029 = queryWeight, product of:
               1.0065495 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.04261403 = queryNorm
             2.5282967 = fieldWeight in 3294, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=3294)
         0.9972576 = weight(author_txt:golub in 3294) [ClassicSimilarity], result of:
           0.9972576 = score(doc=3294,freq=1.0), product of:
             0.37795618 = queryWeight, product of:
               1.0504441 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.04261403 = queryNorm
             2.6385534 = fieldWeight in 3294, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.3125 = fieldNorm(doc=3294)
       0.33333334 = coord(2/6)
   

5. Golub, K.; Tudhope, D.; Zeng, M.L.; Zumer, M.: Terminology registries for knowledge organization systems : functionality, use, and attributes (2014) 0.62

   0.6248833 = sum of:
     0.6248833 = product of:
       1.8746499 = sum of:
         0.8773923 = weight(author_txt:tudhope in 2347) [ClassicSimilarity], result of:
           0.8773923 = score(doc=2347,freq=1.0), product of:
             0.347029 = queryWeight, product of:
               1.0065495 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.04261403 = queryNorm
             2.5282967 = fieldWeight in 2347, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=2347)
         0.9972576 = weight(author_txt:golub in 2347) [ClassicSimilarity], result of:
           0.9972576 = score(doc=2347,freq=1.0), product of:
             0.37795618 = queryWeight, product of:
               1.0504441 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.04261403 = queryNorm
             2.6385534 = fieldWeight in 2347, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.3125 = fieldNorm(doc=2347)
       0.33333334 = coord(2/6)
   

Similar documents (content)

1. Golub, K.; Hansson, J.; Soergel, D.; Tudhope, D.: Managing classification in libraries : a methodological outline for evaluating automatic subject indexing and classification in Swedish library catalogues (2015) 0.41

   0.40599495 = sum of:
     0.40599495 = product of:
       0.8458228 = sum of:
         0.046061113 = weight(abstract_txt:subject in 3300) [ClassicSimilarity], result of:
           0.046061113 = score(doc=3300,freq=5.0), product of:
             0.08429441 = queryWeight, product of:
               1.0442643 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.020645134 = queryNorm
             0.5464314 = fieldWeight in 3300, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.084081315 = weight(abstract_txt:sustainability in 3300) [ClassicSimilarity], result of:
           0.084081315 = score(doc=3300,freq=1.0), product of:
             0.17087905 = queryWeight, product of:
               1.0513334 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.020645134 = queryNorm
             0.49205163 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.0429095 = weight(abstract_txt:tools in 3300) [ClassicSimilarity], result of:
           0.0429095 = score(doc=3300,freq=2.0), product of:
             0.10912514 = queryWeight, product of:
               1.188156 = boost
               4.448705 = idf(docFreq=1411, maxDocs=44421)
               0.020645134 = queryNorm
             0.3932137 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.448705 = idf(docFreq=1411, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.033503152 = weight(abstract_txt:approaches in 3300) [ClassicSimilarity], result of:
           0.033503152 = score(doc=3300,freq=1.0), product of:
             0.116579704 = queryWeight, product of:
               1.2280684 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.020645134 = queryNorm
             0.2873841 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.051537372 = weight(abstract_txt:standard in 3300) [ClassicSimilarity], result of:
           0.051537372 = score(doc=3300,freq=2.0), product of:
             0.12330216 = queryWeight, product of:
               1.2629799 = boost
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.020645134 = queryNorm
             0.41797623 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.068356626 = weight(abstract_txt:automatic in 3300) [ClassicSimilarity], result of:
           0.068356626 = score(doc=3300,freq=2.0), product of:
             0.14884797 = queryWeight, product of:
               1.3876582 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.020645134 = queryNorm
             0.45923787 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.030716417 = weight(abstract_txt:retrieval in 3300) [ClassicSimilarity], result of:
           0.030716417 = score(doc=3300,freq=2.0), product of:
             0.09996162 = queryWeight, product of:
               1.3927506 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020645134 = queryNorm
             0.3072821 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.033078715 = weight(abstract_txt:through in 3300) [ClassicSimilarity], result of:
           0.033078715 = score(doc=3300,freq=1.0), product of:
             0.13232097 = queryWeight, product of:
               1.6024003 = boost
               3.9998152 = idf(docFreq=2211, maxDocs=44421)
               0.020645134 = queryNorm
             0.24998845 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9998152 = idf(docFreq=2211, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.06861284 = weight(abstract_txt:framework in 3300) [ClassicSimilarity], result of:
           0.06861284 = score(doc=3300,freq=2.0), product of:
             0.17081389 = queryWeight, product of:
               1.8206156 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.020645134 = queryNorm
             0.40168184 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.05178766 = weight(abstract_txt:quality in 3300) [ClassicSimilarity], result of:
           0.05178766 = score(doc=3300,freq=1.0), product of:
             0.17840777 = queryWeight, product of:
               1.8606453 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.020645134 = queryNorm
             0.2902769 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.23587428 = weight(abstract_txt:gold in 3300) [ClassicSimilarity], result of:
           0.23587428 = score(doc=3300,freq=2.0), product of:
             0.33989352 = queryWeight, product of:
               2.096923 = boost
               7.85132 = idf(docFreq=46, maxDocs=44421)
               0.020645134 = queryNorm
             0.6939652 = fieldWeight in 3300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.85132 = idf(docFreq=46, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
         0.099303834 = weight(abstract_txt:indexing in 3300) [ClassicSimilarity], result of:
           0.099303834 = score(doc=3300,freq=1.0), product of:
             0.36522952 = queryWeight, product of:
               4.066568 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.020645134 = queryNorm
             0.27189434 = fieldWeight in 3300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=3300)
       0.48 = coord(12/25)
   

2. Bodoff, D.; Kambil, A.: Partial coordination : II. A preliminary evaluation and failure analysis (1998) 0.26

   0.25536194 = sum of:
     0.25536194 = product of:
       0.7093387 = sum of:
         0.014212174 = weight(abstract_txt:with in 3323) [ClassicSimilarity], result of:
           0.014212174 = score(doc=3323,freq=2.0), product of:
             0.05153314 = queryWeight, product of:
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020645134 = queryNorm
             0.2757871 = fieldWeight in 3323, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.025748946 = weight(abstract_txt:subject in 3323) [ClassicSimilarity], result of:
           0.025748946 = score(doc=3323,freq=1.0), product of:
             0.08429441 = queryWeight, product of:
               1.0442643 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.020645134 = queryNorm
             0.30546445 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.060419288 = weight(abstract_txt:automatic in 3323) [ClassicSimilarity], result of:
           0.060419288 = score(doc=3323,freq=1.0), product of:
             0.14884797 = queryWeight, product of:
               1.3876582 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.020645134 = queryNorm
             0.40591276 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.060708653 = weight(abstract_txt:retrieval in 3323) [ClassicSimilarity], result of:
           0.060708653 = score(doc=3323,freq=5.0), product of:
             0.09996162 = queryWeight, product of:
               1.3927506 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020645134 = queryNorm
             0.6073196 = fieldWeight in 3323, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.09112776 = weight(abstract_txt:directly in 3323) [ClassicSimilarity], result of:
           0.09112776 = score(doc=3323,freq=1.0), product of:
             0.19576105 = queryWeight, product of:
               1.5913811 = boost
               5.9584646 = idf(docFreq=311, maxDocs=44421)
               0.020645134 = queryNorm
             0.46550506 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9584646 = idf(docFreq=311, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.058085248 = weight(abstract_txt:evaluation in 3323) [ClassicSimilarity], result of:
           0.058085248 = score(doc=3323,freq=1.0), product of:
             0.16597149 = queryWeight, product of:
               1.7946239 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020645134 = queryNorm
             0.34997123 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.060645755 = weight(abstract_txt:framework in 3323) [ClassicSimilarity], result of:
           0.060645755 = score(doc=3323,freq=1.0), product of:
             0.17081389 = queryWeight, product of:
               1.8206156 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.020645134 = queryNorm
             0.35503995 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.2142611 = weight(abstract_txt:evaluating in 3323) [ClassicSimilarity], result of:
           0.2142611 = score(doc=3323,freq=1.0), product of:
             0.46978742 = queryWeight, product of:
               3.8979096 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020645134 = queryNorm
             0.45608097 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
         0.124129795 = weight(abstract_txt:indexing in 3323) [ClassicSimilarity], result of:
           0.124129795 = score(doc=3323,freq=1.0), product of:
             0.36522952 = queryWeight, product of:
               4.066568 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.020645134 = queryNorm
             0.33986792 = fieldWeight in 3323, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=3323)
       0.36 = coord(9/25)
   

3. Rada, R.: Connecting and evaluating thesauri : issues and cases (1987) 0.20

   0.20448741 = sum of:
     0.20448741 = product of:
       0.73031217 = sum of:
         0.012059431 = weight(abstract_txt:with in 822) [ClassicSimilarity], result of:
           0.012059431 = score(doc=822,freq=1.0), product of:
             0.05153314 = queryWeight, product of:
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020645134 = queryNorm
             0.23401311 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.030898733 = weight(abstract_txt:subject in 822) [ClassicSimilarity], result of:
           0.030898733 = score(doc=822,freq=1.0), product of:
             0.08429441 = queryWeight, product of:
               1.0442643 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.020645134 = queryNorm
             0.36655733 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.07250315 = weight(abstract_txt:automatic in 822) [ClassicSimilarity], result of:
           0.07250315 = score(doc=822,freq=1.0), product of:
             0.14884797 = queryWeight, product of:
               1.3876582 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.020645134 = queryNorm
             0.48709533 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.032579683 = weight(abstract_txt:retrieval in 822) [ClassicSimilarity], result of:
           0.032579683 = score(doc=822,freq=1.0), product of:
             0.09996162 = queryWeight, product of:
               1.3927506 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020645134 = queryNorm
             0.3259219 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.0697023 = weight(abstract_txt:evaluation in 822) [ClassicSimilarity], result of:
           0.0697023 = score(doc=822,freq=1.0), product of:
             0.16597149 = queryWeight, product of:
               1.7946239 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020645134 = queryNorm
             0.4199655 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.36361313 = weight(abstract_txt:evaluating in 822) [ClassicSimilarity], result of:
           0.36361313 = score(doc=822,freq=2.0), product of:
             0.46978742 = queryWeight, product of:
               3.8979096 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020645134 = queryNorm
             0.77399504 = fieldWeight in 822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
         0.14895576 = weight(abstract_txt:indexing in 822) [ClassicSimilarity], result of:
           0.14895576 = score(doc=822,freq=1.0), product of:
             0.36522952 = queryWeight, product of:
               4.066568 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.020645134 = queryNorm
             0.4078415 = fieldWeight in 822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.09375 = fieldNorm(doc=822)
       0.28 = coord(7/25)
   

4. Chung, E.-K.; Miksa, S.; Hastings, S.K.: ¬A framework of automatic subject term assignment for text categorization : an indexing conception-based approach (2010) 0.19

   0.19403087 = sum of:
     0.19403087 = product of:
       0.6063465 = sum of:
         0.012184402 = weight(abstract_txt:with in 421) [ClassicSimilarity], result of:
           0.012184402 = score(doc=421,freq=3.0), product of:
             0.05153314 = queryWeight, product of:
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020645134 = queryNorm
             0.23643818 = fieldWeight in 421, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.04768771 = weight(abstract_txt:subject in 421) [ClassicSimilarity], result of:
           0.04768771 = score(doc=421,freq=7.0), product of:
             0.08429441 = queryWeight, product of:
               1.0442643 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.020645134 = queryNorm
             0.565728 = fieldWeight in 421, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.034694858 = weight(abstract_txt:context in 421) [ClassicSimilarity], result of:
           0.034694858 = score(doc=421,freq=2.0), product of:
             0.10352865 = queryWeight, product of:
               1.1572877 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.020645134 = queryNorm
             0.33512327 = fieldWeight in 421, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.06555091 = weight(abstract_txt:approaches in 421) [ClassicSimilarity], result of:
           0.06555091 = score(doc=421,freq=5.0), product of:
             0.116579704 = queryWeight, product of:
               1.2280684 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.020645134 = queryNorm
             0.56228405 = fieldWeight in 421, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.08458701 = weight(abstract_txt:automatic in 421) [ClassicSimilarity], result of:
           0.08458701 = score(doc=421,freq=4.0), product of:
             0.14884797 = queryWeight, product of:
               1.3876582 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.020645134 = queryNorm
             0.5682779 = fieldWeight in 421, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.04093282 = weight(abstract_txt:through in 421) [ClassicSimilarity], result of:
           0.04093282 = score(doc=421,freq=2.0), product of:
             0.13232097 = queryWeight, product of:
               1.6024003 = boost
               3.9998152 = idf(docFreq=2211, maxDocs=44421)
               0.020645134 = queryNorm
             0.30934492 = fieldWeight in 421, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9998152 = idf(docFreq=2211, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.06003623 = weight(abstract_txt:framework in 421) [ClassicSimilarity], result of:
           0.06003623 = score(doc=421,freq=2.0), product of:
             0.17081389 = queryWeight, product of:
               1.8206156 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.020645134 = queryNorm
             0.3514716 = fieldWeight in 421, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
         0.26067257 = weight(abstract_txt:indexing in 421) [ClassicSimilarity], result of:
           0.26067257 = score(doc=421,freq=9.0), product of:
             0.36522952 = queryWeight, product of:
               4.066568 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.020645134 = queryNorm
             0.71372265 = fieldWeight in 421, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0546875 = fieldNorm(doc=421)
       0.32 = coord(8/25)
   

5. Ménard, E.: Image retrieval : a comparative study on the influence of indexing vocabularies (2009) 0.19

   0.19030863 = sum of:
     0.19030863 = product of:
       0.6796737 = sum of:
         0.019692967 = weight(abstract_txt:with in 237) [ClassicSimilarity], result of:
           0.019692967 = score(doc=237,freq=6.0), product of:
             0.05153314 = queryWeight, product of:
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020645134 = queryNorm
             0.3821418 = fieldWeight in 237, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.068678014 = weight(abstract_txt:context in 237) [ClassicSimilarity], result of:
           0.068678014 = score(doc=237,freq=6.0), product of:
             0.10352865 = queryWeight, product of:
               1.1572877 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.020645134 = queryNorm
             0.66337204 = fieldWeight in 237, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.033503152 = weight(abstract_txt:approaches in 237) [ClassicSimilarity], result of:
           0.033503152 = score(doc=237,freq=1.0), product of:
             0.116579704 = queryWeight, product of:
               1.2280684 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.020645134 = queryNorm
             0.2873841 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.048051894 = weight(abstract_txt:performance in 237) [ClassicSimilarity], result of:
           0.048051894 = score(doc=237,freq=2.0), product of:
             0.11767825 = queryWeight, product of:
               1.2338408 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.020645134 = queryNorm
             0.40833285 = fieldWeight in 237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.05746515 = weight(abstract_txt:retrieval in 237) [ClassicSimilarity], result of:
           0.05746515 = score(doc=237,freq=7.0), product of:
             0.09996162 = queryWeight, product of:
               1.3927506 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020645134 = queryNorm
             0.57487214 = fieldWeight in 237, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.17140888 = weight(abstract_txt:evaluating in 237) [ClassicSimilarity], result of:
           0.17140888 = score(doc=237,freq=1.0), product of:
             0.46978742 = queryWeight, product of:
               3.8979096 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.020645134 = queryNorm
             0.36486477 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
         0.28087366 = weight(abstract_txt:indexing in 237) [ClassicSimilarity], result of:
           0.28087366 = score(doc=237,freq=8.0), product of:
             0.36522952 = queryWeight, product of:
               4.066568 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.020645134 = queryNorm
             0.7690333 = fieldWeight in 237, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=237)
       0.28 = coord(7/25)