Document (#43970)

Author

Han, K.
Rezapour, R.
Nakamura, K.
Devkota, D.
Miller, D.C.
Diesner, J.

Title

¬An expert-in-the-loop method for domain-specific document categorization based on small training data

Source

Journal of the Association for Information Science and Technology. 74(2023) no.6, S.669-684

Year

2023

Abstract

Automated text categorization methods are of broad relevance for domain experts since they free researchers and practitioners from manual labeling, save their resources (e.g., time, labor), and enrich the data with information helpful to study substantive questions. Despite a variety of newly developed categorization methods that require substantial amounts of annotated data, little is known about how to build models when (a) labeling texts with categories requires substantial domain expertise and/or in-depth reading, (b) only a few annotated documents are available for model training, and (c) no relevant computational resources, such as pretrained models, are available. In a collaboration with environmental scientists who study the socio-ecological impact of funded biodiversity conservation projects, we develop a method that integrates deep domain expertise with computational models to automatically categorize project reports based on a small sample of 93 annotated documents. Our results suggest that domain expertise can improve automated categorization and that the magnitude of these improvements is influenced by the experts' understanding of categories and their confidence in their annotation, as well as data sparsity and additional category characteristics such as the portion of exclusive keywords that can identify a category.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24714. Vgl.: https://doi.org/10.1002/asi.24714.

Theme

Automatisches Klassifizieren

Similar documents (author)

1. Nakamura, Y.: Expression of concepts in a classification system (1987) 2.69

   2.68783 = sum of:
     2.68783 = product of:
       5.37566 = sum of:
         5.37566 = weight(author_txt:nakamura in 659) [ClassicSimilarity], result of:
           5.37566 = score(doc=659,freq=1.0), product of:
             0.88165706 = queryWeight, product of:
               1.366876 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.066117816 = queryNorm
             6.0972233 = fieldWeight in 659, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.625 = fieldNorm(doc=659)
       0.5 = coord(1/2)
   

2. Nakamura, Y.: Subdivisions vs. conjunctions : a discussion on concept theory (1998) 2.69

   2.68783 = sum of:
     2.68783 = product of:
       5.37566 = sum of:
         5.37566 = weight(author_txt:nakamura in 1069) [ClassicSimilarity], result of:
           5.37566 = score(doc=1069,freq=1.0), product of:
             0.88165706 = queryWeight, product of:
               1.366876 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.066117816 = queryNorm
             6.0972233 = fieldWeight in 1069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.625 = fieldNorm(doc=1069)
       0.5 = coord(1/2)
   

3. Ishikawa, T.; Nakamura, H.; Nakamura, Y.: UDC number automatic combination system (1994) 2.28

   2.2806995 = sum of:
     2.2806995 = product of:
       4.561399 = sum of:
         4.561399 = weight(author_txt:nakamura in 7731) [ClassicSimilarity], result of:
           4.561399 = score(doc=7731,freq=2.0), product of:
             0.88165706 = queryWeight, product of:
               1.366876 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.066117816 = queryNorm
             5.1736655 = fieldWeight in 7731, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.375 = fieldNorm(doc=7731)
       0.5 = coord(1/2)
   

4. Nakamura, Y.; Ishikawa, T.: Expert systems for automatic UDC number assignment (1990) 2.15

   2.150264 = sum of:
     2.150264 = product of:
       4.300528 = sum of:
         4.300528 = weight(author_txt:nakamura in 256) [ClassicSimilarity], result of:
           4.300528 = score(doc=256,freq=1.0), product of:
             0.88165706 = queryWeight, product of:
               1.366876 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.066117816 = queryNorm
             4.8777785 = fieldWeight in 256, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=256)
       0.5 = coord(1/2)
   

5. Osborne, L.N.; Nakamura, M.: Systems analysis for librarians and information professionals (1995) 2.15

   2.150264 = sum of:
     2.150264 = product of:
       4.300528 = sum of:
         4.300528 = weight(author_txt:nakamura in 4314) [ClassicSimilarity], result of:
           4.300528 = score(doc=4314,freq=1.0), product of:
             0.88165706 = queryWeight, product of:
               1.366876 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.066117816 = queryNorm
             4.8777785 = fieldWeight in 4314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.5 = fieldNorm(doc=4314)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Yang, Y.; Wilbur, J.: Using corpus statistics to remove redundant words in text categorization (1996) 0.31

   0.3130213 = sum of:
     0.3130213 = product of:
       0.9781916 = sum of:
         0.04769866 = weight(abstract_txt:method in 4267) [ClassicSimilarity], result of:
           0.04769866 = score(doc=4267,freq=2.0), product of:
             0.095963 = queryWeight, product of:
               1.05039 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.020307474 = queryNorm
             0.4970526 = fieldWeight in 4267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.01629487 = weight(abstract_txt:with in 4267) [ClassicSimilarity], result of:
           0.01629487 = score(doc=4267,freq=2.0), product of:
             0.059084967 = queryWeight, product of:
               1.1656071 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020307474 = queryNorm
             0.2757871 = fieldWeight in 4267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.06509244 = weight(abstract_txt:automated in 4267) [ClassicSimilarity], result of:
           0.06509244 = score(doc=4267,freq=1.0), product of:
             0.1487522 = queryWeight, product of:
               1.307767 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.020307474 = queryNorm
             0.43758973 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.012248895 = weight(abstract_txt:that in 4267) [ClassicSimilarity], result of:
           0.012248895 = score(doc=4267,freq=1.0), product of:
             0.06629605 = queryWeight, product of:
               1.380424 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020307474 = queryNorm
             0.18476056 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.0902684 = weight(abstract_txt:category in 4267) [ClassicSimilarity], result of:
           0.0902684 = score(doc=4267,freq=1.0), product of:
             0.18498373 = queryWeight, product of:
               1.4583623 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.020307474 = queryNorm
             0.48798022 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.13410819 = weight(abstract_txt:computational in 4267) [ClassicSimilarity], result of:
           0.13410819 = score(doc=4267,freq=2.0), product of:
             0.19116272 = queryWeight, product of:
               1.482519 = boost
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.020307474 = queryNorm
             0.7015394 = fieldWeight in 4267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.13849178 = weight(abstract_txt:domain in 4267) [ClassicSimilarity], result of:
           0.13849178 = score(doc=4267,freq=2.0), product of:
             0.2650711 = queryWeight, product of:
               2.7602592 = boost
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.020307474 = queryNorm
             0.5224703 = fieldWeight in 4267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.47398838 = weight(abstract_txt:categorization in 4267) [ClassicSimilarity], result of:
           0.47398838 = score(doc=4267,freq=5.0), product of:
             0.41175747 = queryWeight, product of:
               3.077049 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.020307474 = queryNorm
             1.1511348 = fieldWeight in 4267, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
       0.32 = coord(8/25)
   

2. Yang, Y.; Liu, X.: ¬A re-examination of text categorization methods (1999) 0.23

   0.22914806 = sum of:
     0.22914806 = product of:
       0.7160877 = sum of:
         0.020887712 = weight(abstract_txt:their in 4386) [ClassicSimilarity], result of:
           0.020887712 = score(doc=4386,freq=1.0), product of:
             0.07067729 = queryWeight, product of:
               1.1040386 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020307474 = queryNorm
             0.2955364 = fieldWeight in 4386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.019553844 = weight(abstract_txt:with in 4386) [ClassicSimilarity], result of:
           0.019553844 = score(doc=4386,freq=2.0), product of:
             0.059084967 = queryWeight, product of:
               1.1656071 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020307474 = queryNorm
             0.33094448 = fieldWeight in 4386, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.08360065 = weight(abstract_txt:training in 4386) [ClassicSimilarity], result of:
           0.08360065 = score(doc=4386,freq=2.0), product of:
             0.12353366 = queryWeight, product of:
               1.191767 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.020307474 = queryNorm
             0.67674387 = fieldWeight in 4386, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.06170818 = weight(abstract_txt:categories in 4386) [ClassicSimilarity], result of:
           0.06170818 = score(doc=4386,freq=1.0), product of:
             0.12712102 = queryWeight, product of:
               1.2089473 = boost
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.020307474 = queryNorm
             0.4854286 = fieldWeight in 4386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.06756206 = weight(abstract_txt:small in 4386) [ClassicSimilarity], result of:
           0.06756206 = score(doc=4386,freq=1.0), product of:
             0.13503845 = queryWeight, product of:
               1.2460269 = boost
               5.3367167 = idf(docFreq=580, maxDocs=44421)
               0.020307474 = queryNorm
             0.5003172 = fieldWeight in 4386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3367167 = idf(docFreq=580, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.020787064 = weight(abstract_txt:that in 4386) [ClassicSimilarity], result of:
           0.020787064 = score(doc=4386,freq=2.0), product of:
             0.06629605 = queryWeight, product of:
               1.380424 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020307474 = queryNorm
             0.31354907 = fieldWeight in 4386, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.18761936 = weight(abstract_txt:category in 4386) [ClassicSimilarity], result of:
           0.18761936 = score(doc=4386,freq=3.0), product of:
             0.18498373 = queryWeight, product of:
               1.4583623 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.020307474 = queryNorm
             1.0142479 = fieldWeight in 4386, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
         0.25436884 = weight(abstract_txt:categorization in 4386) [ClassicSimilarity], result of:
           0.25436884 = score(doc=4386,freq=1.0), product of:
             0.41175747 = queryWeight, product of:
               3.077049 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.020307474 = queryNorm
             0.61776376 = fieldWeight in 4386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.09375 = fieldNorm(doc=4386)
       0.32 = coord(8/25)
   

3. Westman, S.; Laine-Hernandez, M.; Oittinen, P.: Development and evaluation of a multifaceted magazine image categorization model (2011) 0.21

   0.21256381 = sum of:
     0.21256381 = product of:
       0.66426194 = sum of:
         0.013925141 = weight(abstract_txt:their in 193) [ClassicSimilarity], result of:
           0.013925141 = score(doc=193,freq=1.0), product of:
             0.07067729 = queryWeight, product of:
               1.1040386 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020307474 = queryNorm
             0.19702427 = fieldWeight in 193, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.015965648 = weight(abstract_txt:with in 193) [ClassicSimilarity], result of:
           0.015965648 = score(doc=193,freq=3.0), product of:
             0.059084967 = queryWeight, product of:
               1.1656071 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020307474 = queryNorm
             0.27021506 = fieldWeight in 193, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.013858043 = weight(abstract_txt:that in 193) [ClassicSimilarity], result of:
           0.013858043 = score(doc=193,freq=2.0), product of:
             0.06629605 = queryWeight, product of:
               1.380424 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020307474 = queryNorm
             0.20903271 = fieldWeight in 193, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.06228791 = weight(abstract_txt:experts in 193) [ClassicSimilarity], result of:
           0.06228791 = score(doc=193,freq=1.0), product of:
             0.16761732 = queryWeight, product of:
               1.3882195 = boost
               5.9457254 = idf(docFreq=315, maxDocs=44421)
               0.020307474 = queryNorm
             0.37160784 = fieldWeight in 193, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9457254 = idf(docFreq=315, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.07221472 = weight(abstract_txt:category in 193) [ClassicSimilarity], result of:
           0.07221472 = score(doc=193,freq=1.0), product of:
             0.18498373 = queryWeight, product of:
               1.4583623 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.020307474 = queryNorm
             0.39038417 = fieldWeight in 193, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.07586304 = weight(abstract_txt:computational in 193) [ClassicSimilarity], result of:
           0.07586304 = score(doc=193,freq=1.0), product of:
             0.19116272 = queryWeight, product of:
               1.482519 = boost
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.020307474 = queryNorm
             0.3968506 = fieldWeight in 193, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3496094 = idf(docFreq=210, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.030956732 = weight(abstract_txt:data in 193) [ClassicSimilarity], result of:
           0.030956732 = score(doc=193,freq=2.0), product of:
             0.105168685 = queryWeight, product of:
               1.555095 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.020307474 = queryNorm
             0.29435313 = fieldWeight in 193, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
         0.37919068 = weight(abstract_txt:categorization in 193) [ClassicSimilarity], result of:
           0.37919068 = score(doc=193,freq=5.0), product of:
             0.41175747 = queryWeight, product of:
               3.077049 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.020307474 = queryNorm
             0.92090786 = fieldWeight in 193, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.0625 = fieldNorm(doc=193)
       0.32 = coord(8/25)
   

4. Goren-Bar, D.; Kuflik, T.: Supporting user-subjective categorization with self-organizing maps and learning vector quantization (2005) 0.18

   0.18459578 = sum of:
     0.18459578 = product of:
       0.7691491 = sum of:
         0.026982436 = weight(abstract_txt:method in 4325) [ClassicSimilarity], result of:
           0.026982436 = score(doc=4325,freq=1.0), product of:
             0.095963 = queryWeight, product of:
               1.05039 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.020307474 = queryNorm
             0.2811754 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.013925141 = weight(abstract_txt:their in 4325) [ClassicSimilarity], result of:
           0.013925141 = score(doc=4325,freq=1.0), product of:
             0.07067729 = queryWeight, product of:
               1.1040386 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020307474 = queryNorm
             0.19702427 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.013035896 = weight(abstract_txt:with in 4325) [ClassicSimilarity], result of:
           0.013035896 = score(doc=4325,freq=2.0), product of:
             0.059084967 = queryWeight, product of:
               1.1656071 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020307474 = queryNorm
             0.22062966 = fieldWeight in 4325, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.016972566 = weight(abstract_txt:that in 4325) [ClassicSimilarity], result of:
           0.016972566 = score(doc=4325,freq=3.0), product of:
             0.06629605 = queryWeight, product of:
               1.380424 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020307474 = queryNorm
             0.25601172 = fieldWeight in 4325, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.11079342 = weight(abstract_txt:domain in 4325) [ClassicSimilarity], result of:
           0.11079342 = score(doc=4325,freq=2.0), product of:
             0.2650711 = queryWeight, product of:
               2.7602592 = boost
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.020307474 = queryNorm
             0.41797623 = fieldWeight in 4325, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.58743966 = weight(abstract_txt:categorization in 4325) [ClassicSimilarity], result of:
           0.58743966 = score(doc=4325,freq=12.0), product of:
             0.41175747 = queryWeight, product of:
               3.077049 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.020307474 = queryNorm
             1.4266642 = fieldWeight in 4325, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
       0.24 = coord(6/25)
   

5. Zhang, X.; Liu, J.; Cole, M.; Belkin, N.: Predicting users' domain knowledge in information retrieval using multiple regression analysis of search behaviors (2015) 0.17

   0.17320812 = sum of:
     0.17320812 = product of:
       0.48113364 = sum of:
         0.038158927 = weight(abstract_txt:method in 2822) [ClassicSimilarity], result of:
           0.038158927 = score(doc=2822,freq=2.0), product of:
             0.095963 = queryWeight, product of:
               1.05039 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.020307474 = queryNorm
             0.39764208 = fieldWeight in 2822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.013925141 = weight(abstract_txt:their in 2822) [ClassicSimilarity], result of:
           0.013925141 = score(doc=2822,freq=1.0), product of:
             0.07067729 = queryWeight, product of:
               1.1040386 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020307474 = queryNorm
             0.19702427 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.015965648 = weight(abstract_txt:with in 2822) [ClassicSimilarity], result of:
           0.015965648 = score(doc=2822,freq=3.0), product of:
             0.059084967 = queryWeight, product of:
               1.1656071 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.020307474 = queryNorm
             0.27021506 = fieldWeight in 2822, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.041138783 = weight(abstract_txt:categories in 2822) [ClassicSimilarity], result of:
           0.041138783 = score(doc=2822,freq=1.0), product of:
             0.12712102 = queryWeight, product of:
               1.2089473 = boost
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.020307474 = queryNorm
             0.32361907 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.013858043 = weight(abstract_txt:that in 2822) [ClassicSimilarity], result of:
           0.013858043 = score(doc=2822,freq=2.0), product of:
             0.06629605 = queryWeight, product of:
               1.380424 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020307474 = queryNorm
             0.20903271 = fieldWeight in 2822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.021889715 = weight(abstract_txt:data in 2822) [ClassicSimilarity], result of:
           0.021889715 = score(doc=2822,freq=1.0), product of:
             0.105168685 = queryWeight, product of:
               1.555095 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.020307474 = queryNorm
             0.20813909 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.06211588 = weight(abstract_txt:models in 2822) [ClassicSimilarity], result of:
           0.06211588 = score(doc=2822,freq=2.0), product of:
             0.15200992 = queryWeight, product of:
               1.6191247 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.020307474 = queryNorm
             0.40863046 = fieldWeight in 2822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.09890173 = weight(abstract_txt:expertise in 2822) [ClassicSimilarity], result of:
           0.09890173 = score(doc=2822,freq=1.0), product of:
             0.2611456 = queryWeight, product of:
               2.122197 = boost
               6.059561 = idf(docFreq=281, maxDocs=44421)
               0.020307474 = queryNorm
             0.37872255 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.059561 = idf(docFreq=281, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
         0.17517978 = weight(abstract_txt:domain in 2822) [ClassicSimilarity], result of:
           0.17517978 = score(doc=2822,freq=5.0), product of:
             0.2650711 = queryWeight, product of:
               2.7602592 = boost
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.020307474 = queryNorm
             0.6608785 = fieldWeight in 2822, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.0625 = fieldNorm(doc=2822)
       0.36 = coord(9/25)