Document (#34757)

Author

Kim, S.
Oh, S.

Title

Users' relevance criteria for evaluating answers in a social Q&A site

Source

Journal of the American Society for Information Science and Technology. 60(2009) no.4, S.716-727

Year

2009

Abstract

This study examines the criteria questioners use to select the best answers in a social Q&A site (Yahoo! Answers) within the theoretical framework of relevance research. A social Q&A site is a novel environment where people voluntarily ask and answer questions. In Yahoo! Answers, the questioner selects the answer that best satisfies his or her question and leaves comments on it. Under the assumption that the comments reflect the reasons why questioners select particular answers as the best, this study analyzed 2,140 comments collected from Yahoo! Answers during December 2007. The content analysis identified 23 individual relevance criteria in six classes: Content, Cognitive, Utility, Information Sources, Extrinsic, and Socioemotional. A major finding is that the selection criteria used in a social Q&A site have considerable overlap with many relevance criteria uncovered in previous relevance studies, but that the scope of socio-emotional criteria has been expanded to include the social aspect of this environment. Another significant finding is that the relative importance of individual criteria varies according to topic categories. Socioemotional criteria are popular in discussion-oriented categories, content-oriented criteria in topic-oriented categories, and utility criteria in self-help categories. This study generalizes previous relevance studies to a new environment by going beyond an academic setting.

Theme

Internet

Object

Yahoo! Answers

Similar documents (content)

1. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.29

   0.29144982 = sum of:
     0.29144982 = product of:
       0.9107807 = sum of:
         0.010784281 = weight(abstract_txt:this in 909) [ClassicSimilarity], result of:
           0.010784281 = score(doc=909,freq=3.0), product of:
             0.041401166 = queryWeight, product of:
               1.105586 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015562596 = queryNorm
             0.26048255 = fieldWeight in 909, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.028842663 = weight(abstract_txt:topic in 909) [ClassicSimilarity], result of:
           0.028842663 = score(doc=909,freq=1.0), product of:
             0.09131436 = queryWeight, product of:
               1.1610229 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.015562596 = queryNorm
             0.3158612 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.013351362 = weight(abstract_txt:study in 909) [ClassicSimilarity], result of:
           0.013351362 = score(doc=909,freq=1.0), product of:
             0.062550336 = queryWeight, product of:
               1.1768787 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.015562596 = queryNorm
             0.21344988 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.012798082 = weight(abstract_txt:that in 909) [ClassicSimilarity], result of:
           0.012798082 = score(doc=909,freq=3.0), product of:
             0.049990218 = queryWeight, product of:
               1.3582627 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015562596 = queryNorm
             0.25601172 = fieldWeight in 909, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.024472853 = weight(abstract_txt:content in 909) [ClassicSimilarity], result of:
           0.024472853 = score(doc=909,freq=1.0), product of:
             0.09368477 = queryWeight, product of:
               1.4402947 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.015562596 = queryNorm
             0.26122552 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.08265859 = weight(abstract_txt:site in 909) [ClassicSimilarity], result of:
           0.08265859 = score(doc=909,freq=1.0), product of:
             0.23212264 = queryWeight, product of:
               2.6178515 = boost
               5.6975803 = idf(docFreq=404, maxDocs=44421)
               0.015562596 = queryNorm
             0.35609877 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6975803 = idf(docFreq=404, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.16060348 = weight(abstract_txt:relevance in 909) [ClassicSimilarity], result of:
           0.16060348 = score(doc=909,freq=4.0), product of:
             0.2606389 = queryWeight, product of:
               3.3974376 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015562596 = queryNorm
             0.6161915 = fieldWeight in 909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.57726943 = weight(abstract_txt:criteria in 909) [ClassicSimilarity], result of:
           0.57726943 = score(doc=909,freq=9.0), product of:
             0.5533633 = queryWeight, product of:
               6.390891 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015562596 = queryNorm
             1.0432014 = fieldWeight in 909, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
       0.32 = coord(8/25)
   

2. Li, L.; He, D.; Zhang, C.; Geng, L.; Zhang, K.: Characterizing peer-judged answer quality on academic Q&A sites : a cross-disciplinary case study on ResearchGate (2018) 0.24

   0.24189836 = sum of:
     0.24189836 = product of:
       0.67193985 = sum of:
         0.0062263077 = weight(abstract_txt:this in 637) [ClassicSimilarity], result of:
           0.0062263077 = score(doc=637,freq=1.0), product of:
             0.041401166 = queryWeight, product of:
               1.105586 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015562596 = queryNorm
             0.15038967 = fieldWeight in 637, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.013351362 = weight(abstract_txt:study in 637) [ClassicSimilarity], result of:
           0.013351362 = score(doc=637,freq=1.0), product of:
             0.062550336 = queryWeight, product of:
               1.1768787 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.015562596 = queryNorm
             0.21344988 = fieldWeight in 637, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.11307251 = weight(abstract_txt:answer in 637) [ClassicSimilarity], result of:
           0.11307251 = score(doc=637,freq=6.0), product of:
             0.12494046 = queryWeight, product of:
               1.358072 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.015562596 = queryNorm
             0.9050111 = fieldWeight in 637, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.010449591 = weight(abstract_txt:that in 637) [ClassicSimilarity], result of:
           0.010449591 = score(doc=637,freq=2.0), product of:
             0.049990218 = queryWeight, product of:
               1.3582627 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015562596 = queryNorm
             0.20903271 = fieldWeight in 637, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.05423088 = weight(abstract_txt:select in 637) [ClassicSimilarity], result of:
           0.05423088 = score(doc=637,freq=1.0), product of:
             0.13910624 = queryWeight, product of:
               1.4329946 = boost
               6.2376356 = idf(docFreq=235, maxDocs=44421)
               0.015562596 = queryNorm
             0.38985223 = fieldWeight in 637, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2376356 = idf(docFreq=235, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.024472853 = weight(abstract_txt:content in 637) [ClassicSimilarity], result of:
           0.024472853 = score(doc=637,freq=1.0), product of:
             0.09368477 = queryWeight, product of:
               1.4402947 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.015562596 = queryNorm
             0.26122552 = fieldWeight in 637, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.06204101 = weight(abstract_txt:categories in 637) [ClassicSimilarity], result of:
           0.06204101 = score(doc=637,freq=1.0), product of:
             0.19171 = queryWeight, product of:
               2.3790777 = boost
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.015562596 = queryNorm
             0.32361907 = fieldWeight in 637, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.058663346 = weight(abstract_txt:social in 637) [ClassicSimilarity], result of:
           0.058663346 = score(doc=637,freq=2.0), product of:
             0.15790531 = queryWeight, product of:
               2.4140131 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.015562596 = queryNorm
             0.37150964 = fieldWeight in 637, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
         0.32943204 = weight(abstract_txt:answers in 637) [ClassicSimilarity], result of:
           0.32943204 = score(doc=637,freq=4.0), product of:
             0.42077166 = queryWeight, product of:
               4.3167324 = boost
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.015562596 = queryNorm
             0.7829235 = fieldWeight in 637, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0625 = fieldNorm(doc=637)
       0.36 = coord(9/25)
   

3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.23

   0.23409177 = sum of:
     0.23409177 = product of:
       0.83604205 = sum of:
         0.0062263077 = weight(abstract_txt:this in 739) [ClassicSimilarity], result of:
           0.0062263077 = score(doc=739,freq=1.0), product of:
             0.041401166 = queryWeight, product of:
               1.105586 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015562596 = queryNorm
             0.15038967 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.03663487 = weight(abstract_txt:individual in 739) [ClassicSimilarity], result of:
           0.03663487 = score(doc=739,freq=2.0), product of:
             0.085003205 = queryWeight, product of:
               1.1201829 = boost
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.015562596 = queryNorm
             0.43098223 = fieldWeight in 739, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.026702724 = weight(abstract_txt:study in 739) [ClassicSimilarity], result of:
           0.026702724 = score(doc=739,freq=4.0), product of:
             0.062550336 = queryWeight, product of:
               1.1768787 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.015562596 = queryNorm
             0.42689976 = fieldWeight in 739, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.0073889764 = weight(abstract_txt:that in 739) [ClassicSimilarity], result of:
           0.0073889764 = score(doc=739,freq=1.0), product of:
             0.049990218 = queryWeight, product of:
               1.3582627 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015562596 = queryNorm
             0.14780845 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.05423088 = weight(abstract_txt:select in 739) [ClassicSimilarity], result of:
           0.05423088 = score(doc=739,freq=1.0), product of:
             0.13910624 = queryWeight, product of:
               1.4329946 = boost
               6.2376356 = idf(docFreq=235, maxDocs=44421)
               0.015562596 = queryNorm
             0.38985223 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2376356 = idf(docFreq=235, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.16060348 = weight(abstract_txt:relevance in 739) [ClassicSimilarity], result of:
           0.16060348 = score(doc=739,freq=4.0), product of:
             0.2606389 = queryWeight, product of:
               3.3974376 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015562596 = queryNorm
             0.6161915 = fieldWeight in 739, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.5442548 = weight(abstract_txt:criteria in 739) [ClassicSimilarity], result of:
           0.5442548 = score(doc=739,freq=8.0), product of:
             0.5533633 = queryWeight, product of:
               6.390891 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015562596 = queryNorm
             0.9835397 = fieldWeight in 739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
       0.28 = coord(7/25)
   

4. Qu, B.; Cong, G.; Li, C.; Sun, A.; Chen, H.: ¬An evaluation of classification models for question topic categorization (2012) 0.23

   0.22619803 = sum of:
     0.22619803 = product of:
       0.5654951 = sum of:
         0.008805329 = weight(abstract_txt:this in 1237) [ClassicSimilarity], result of:
           0.008805329 = score(doc=1237,freq=2.0), product of:
             0.041401166 = queryWeight, product of:
               1.105586 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015562596 = queryNorm
             0.21268311 = fieldWeight in 1237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.049956955 = weight(abstract_txt:topic in 1237) [ClassicSimilarity], result of:
           0.049956955 = score(doc=1237,freq=3.0), product of:
             0.09131436 = queryWeight, product of:
               1.1610229 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.015562596 = queryNorm
             0.5470876 = fieldWeight in 1237, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.018881677 = weight(abstract_txt:study in 1237) [ClassicSimilarity], result of:
           0.018881677 = score(doc=1237,freq=2.0), product of:
             0.062550336 = queryWeight, product of:
               1.1768787 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.015562596 = queryNorm
             0.3018637 = fieldWeight in 1237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.046161655 = weight(abstract_txt:answer in 1237) [ClassicSimilarity], result of:
           0.046161655 = score(doc=1237,freq=1.0), product of:
             0.12494046 = queryWeight, product of:
               1.358072 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.015562596 = queryNorm
             0.36946923 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.0073889764 = weight(abstract_txt:that in 1237) [ClassicSimilarity], result of:
           0.0073889764 = score(doc=1237,freq=1.0), product of:
             0.049990218 = queryWeight, product of:
               1.3582627 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015562596 = queryNorm
             0.14780845 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.024472853 = weight(abstract_txt:content in 1237) [ClassicSimilarity], result of:
           0.024472853 = score(doc=1237,freq=1.0), product of:
             0.09368477 = queryWeight, product of:
               1.4402947 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.015562596 = queryNorm
             0.26122552 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.05985325 = weight(abstract_txt:best in 1237) [ClassicSimilarity], result of:
           0.05985325 = score(doc=1237,freq=2.0), product of:
             0.13497742 = queryWeight, product of:
               1.7288107 = boost
               5.0168557 = idf(docFreq=799, maxDocs=44421)
               0.015562596 = queryNorm
             0.4434316 = fieldWeight in 1237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0168557 = idf(docFreq=799, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.09751915 = weight(abstract_txt:yahoo in 1237) [ClassicSimilarity], result of:
           0.09751915 = score(doc=1237,freq=1.0), product of:
             0.23547196 = queryWeight, product of:
               2.2834237 = boost
               6.6262937 = idf(docFreq=159, maxDocs=44421)
               0.015562596 = queryNorm
             0.41414335 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6262937 = idf(docFreq=159, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.08773924 = weight(abstract_txt:categories in 1237) [ClassicSimilarity], result of:
           0.08773924 = score(doc=1237,freq=2.0), product of:
             0.19171 = queryWeight, product of:
               2.3790777 = boost
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.015562596 = queryNorm
             0.45766646 = fieldWeight in 1237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.177905 = idf(docFreq=680, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
         0.16471602 = weight(abstract_txt:answers in 1237) [ClassicSimilarity], result of:
           0.16471602 = score(doc=1237,freq=1.0), product of:
             0.42077166 = queryWeight, product of:
               4.3167324 = boost
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.015562596 = queryNorm
             0.39146176 = fieldWeight in 1237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0625 = fieldNorm(doc=1237)
       0.4 = coord(10/25)
   

5. Su, L.T.: ¬A comprehensive and systematic model of user evaluation of Web search engines : Il. An evaluation by undergraduates (2003) 0.22

   0.22419262 = sum of:
     0.22419262 = product of:
       0.62275726 = sum of:
         0.005448019 = weight(abstract_txt:this in 3117) [ClassicSimilarity], result of:
           0.005448019 = score(doc=3117,freq=1.0), product of:
             0.041401166 = queryWeight, product of:
               1.105586 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015562596 = queryNorm
             0.13159096 = fieldWeight in 3117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.02266667 = weight(abstract_txt:individual in 3117) [ClassicSimilarity], result of:
           0.02266667 = score(doc=3117,freq=1.0), product of:
             0.085003205 = queryWeight, product of:
               1.1201829 = boost
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.015562596 = queryNorm
             0.26665667 = fieldWeight in 3117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8760076 = idf(docFreq=920, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.02523733 = weight(abstract_txt:topic in 3117) [ClassicSimilarity], result of:
           0.02523733 = score(doc=3117,freq=1.0), product of:
             0.09131436 = queryWeight, product of:
               1.1610229 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.015562596 = queryNorm
             0.27637854 = fieldWeight in 3117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.020234581 = weight(abstract_txt:study in 3117) [ClassicSimilarity], result of:
           0.020234581 = score(doc=3117,freq=3.0), product of:
             0.062550336 = queryWeight, product of:
               1.1768787 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.015562596 = queryNorm
             0.32349277 = fieldWeight in 3117, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.03028361 = weight(abstract_txt:content in 3117) [ClassicSimilarity], result of:
           0.03028361 = score(doc=3117,freq=2.0), product of:
             0.09368477 = queryWeight, product of:
               1.4402947 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.015562596 = queryNorm
             0.3232501 = fieldWeight in 3117, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.050166078 = weight(abstract_txt:utility in 3117) [ClassicSimilarity], result of:
           0.050166078 = score(doc=3117,freq=1.0), product of:
             0.14436112 = queryWeight, product of:
               1.4598101 = boost
               6.35436 = idf(docFreq=209, maxDocs=44421)
               0.015562596 = queryNorm
             0.34750408 = fieldWeight in 3117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.35436 = idf(docFreq=209, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.07772688 = weight(abstract_txt:comments in 3117) [ClassicSimilarity], result of:
           0.07772688 = score(doc=3117,freq=1.0), product of:
             0.22126941 = queryWeight, product of:
               2.21349 = boost
               6.4233527 = idf(docFreq=195, maxDocs=44421)
               0.015562596 = queryNorm
             0.3512771 = fieldWeight in 3117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4233527 = idf(docFreq=195, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.09936832 = weight(abstract_txt:relevance in 3117) [ClassicSimilarity], result of:
           0.09936832 = score(doc=3117,freq=2.0), product of:
             0.2606389 = queryWeight, product of:
               3.3974376 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015562596 = queryNorm
             0.381249 = fieldWeight in 3117, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
         0.2916258 = weight(abstract_txt:criteria in 3117) [ClassicSimilarity], result of:
           0.2916258 = score(doc=3117,freq=3.0), product of:
             0.5533633 = queryWeight, product of:
               6.390891 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015562596 = queryNorm
             0.52700603 = fieldWeight in 3117, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3117)
       0.36 = coord(9/25)