Document (#37519)

Author

Smith, G.
Brien, C.
Ashman, H.

Title

Evaluating implicit judgments from image search clickthrough data

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.12, S.2451-2462

Year

2012

Abstract

The interactions of users with search engines can be seen as implicit relevance feedback by the user on the results offered to them. In particular, the selection of results by users can be interpreted as a confirmation of the relevance of those results, and used to reorder or prioritize subsequent search results. This collection of search/result pairings is called clickthrough data, and many uses for it have been proposed. However, the reliability of clickthrough data has been challenged and it has been suggested that clickthrough data are not a completely accurate measure of relevance between search term and results. This paper reports on an experiment evaluating the reliability of clickthrough data as a measure of the mutual relevance of search term and result. The experiment comprised a user study involving over 67 participants and determines the reliability of image search clickthrough data, using factors identified in previous similar studies. A major difference in this work to previous work is that the source of clickthrough data comes from image searches, rather than the traditional text page searches. Image search clickthrough data were rarely examined in prior works but has differences that impact the accuracy of clickthrough data. These differences include a more complete representation of the results in image search, allowing users to scrutinize the results more closely before selecting them, as well as presenting the results in a less obviously ordered way. The experiment reported here demonstrates that image clickthrough data can be more reliable as a relevance feedback measure than has been the case with traditional text-based search. There is also evidence that the precision of the search system influences the accuracy of click data when users make searches in an information-seeking capacity.

Similar documents (author)

1. Smith, M.P.; Smith, M.: ¬The use of genetic programming to build Boolean queries for text retrieval through relevance feedback (1997) 4.56

   4.5639806 = sum of:
     4.5639806 = weight(author_txt:smith in 1761) [ClassicSimilarity], result of:
       4.5639806 = fieldWeight in 1761, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.5 = fieldNorm(doc=1761)
   

2. Smith, E.H.: Enhancing subject accessibiliy to the online catalog (1991) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 1068) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 1068, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=1068)
   

3. Smith, L.C.: UNISIST revisited: campatibility in the context of collaboratories (1992) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2112) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2112, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2112)
   

4. Smith, M.M.: Knowledge management : a guide to resources on the Internet (2004) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2804) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2804, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2804)
   

5. Smith, L.C.: Citation analysis (1981) 4.03

   4.034027 = sum of:
     4.034027 = weight(author_txt:smith in 2832) [ClassicSimilarity], result of:
       4.034027 = fieldWeight in 2832, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4544435 = idf(docFreq=189, maxDocs=44421)
         0.625 = fieldNorm(doc=2832)
   

Similar documents (content)

1. Zhang, Y.; Jansen, B.J.; Spink, A.: Identification of factors predicting clickthrough in Web searching using neural network analysis (2009) 0.41

   0.41180584 = sum of:
     0.41180584 = product of:
       1.7158577 = sum of:
         0.0085291555 = weight(abstract_txt:more in 3742) [ClassicSimilarity], result of:
           0.0085291555 = score(doc=3742,freq=1.0), product of:
             0.0321454 = queryWeight, product of:
               1.0933993 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.008656511 = queryNorm
             0.26533052 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
         0.019195933 = weight(abstract_txt:result in 3742) [ClassicSimilarity], result of:
           0.019195933 = score(doc=3742,freq=1.0), product of:
             0.04822703 = queryWeight, product of:
               1.0935005 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.008656511 = queryNorm
             0.39803264 = fieldWeight in 3742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
         0.006787909 = weight(abstract_txt:that in 3742) [ClassicSimilarity], result of:
           0.006787909 = score(doc=3742,freq=2.0), product of:
             0.02597836 = queryWeight, product of:
               1.2689649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.008656511 = queryNorm
             0.2612909 = fieldWeight in 3742, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
         0.034564383 = weight(abstract_txt:results in 3742) [ClassicSimilarity], result of:
           0.034564383 = score(doc=3742,freq=2.0), product of:
             0.08993187 = queryWeight, product of:
               2.9864864 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.008656511 = queryNorm
             0.38433966 = fieldWeight in 3742, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
         0.067494035 = weight(abstract_txt:search in 3742) [ClassicSimilarity], result of:
           0.067494035 = score(doc=3742,freq=3.0), product of:
             0.13648193 = queryWeight, product of:
               4.314124 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.008656511 = queryNorm
             0.49452728 = fieldWeight in 3742, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
         1.5792863 = weight(abstract_txt:clickthrough in 3742) [ClassicSimilarity], result of:
           1.5792863 = score(doc=3742,freq=5.0), product of:
             0.9122733 = queryWeight, product of:
               10.634602 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.008656511 = queryNorm
             1.7311548 = fieldWeight in 3742, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.078125 = fieldNorm(doc=3742)
       0.24 = coord(6/25)
   

2. Mat-Hassan, M.; Levene, M.: Associating search and navigation behavior through log analysis (2005) 0.31

   0.31418368 = sum of:
     0.31418368 = product of:
       0.98182404 = sum of:
         0.009649637 = weight(abstract_txt:more in 4681) [ClassicSimilarity], result of:
           0.009649637 = score(doc=4681,freq=2.0), product of:
             0.0321454 = queryWeight, product of:
               1.0933993 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.008656511 = queryNorm
             0.3001872 = fieldWeight in 4681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.006650765 = weight(abstract_txt:that in 4681) [ClassicSimilarity], result of:
           0.006650765 = score(doc=4681,freq=3.0), product of:
             0.02597836 = queryWeight, product of:
               1.2689649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.008656511 = queryNorm
             0.25601172 = fieldWeight in 4681, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.02789387 = weight(abstract_txt:users in 4681) [ClassicSimilarity], result of:
           0.02789387 = score(doc=4681,freq=7.0), product of:
             0.047286905 = queryWeight, product of:
               1.5312961 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.008656511 = queryNorm
             0.5898857 = fieldWeight in 4681, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.010966477 = weight(abstract_txt:been in 4681) [ClassicSimilarity], result of:
           0.010966477 = score(doc=4681,freq=1.0), product of:
             0.04854515 = queryWeight, product of:
               1.5515352 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.008656511 = queryNorm
             0.22590263 = fieldWeight in 4681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.027651506 = weight(abstract_txt:results in 4681) [ClassicSimilarity], result of:
           0.027651506 = score(doc=4681,freq=2.0), product of:
             0.08993187 = queryWeight, product of:
               2.9864864 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.008656511 = queryNorm
             0.30747172 = fieldWeight in 4681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.023588313 = weight(abstract_txt:data in 4681) [ClassicSimilarity], result of:
           0.023588313 = score(doc=4681,freq=1.0), product of:
             0.11332957 = queryWeight, product of:
               3.931214 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.008656511 = queryNorm
             0.20813909 = fieldWeight in 4681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.07636079 = weight(abstract_txt:search in 4681) [ClassicSimilarity], result of:
           0.07636079 = score(doc=4681,freq=6.0), product of:
             0.13648193 = queryWeight, product of:
               4.314124 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.008656511 = queryNorm
             0.5594938 = fieldWeight in 4681, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
         0.79906267 = weight(abstract_txt:clickthrough in 4681) [ClassicSimilarity], result of:
           0.79906267 = score(doc=4681,freq=2.0), product of:
             0.9122733 = queryWeight, product of:
               10.634602 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.008656511 = queryNorm
             0.8759027 = fieldWeight in 4681, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0625 = fieldNorm(doc=4681)
       0.32 = coord(8/25)
   

3. Lewandowski, D.; Drechsler, J.; Mach, S. von: Deriving query intents from web search engine queries (2012) 0.21

   0.20805229 = sum of:
     0.20805229 = product of:
       0.7430439 = sum of:
         0.006650765 = weight(abstract_txt:that in 1385) [ClassicSimilarity], result of:
           0.006650765 = score(doc=1385,freq=3.0), product of:
             0.02597836 = queryWeight, product of:
               1.2689649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.008656511 = queryNorm
             0.25601172 = fieldWeight in 1385, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.010542892 = weight(abstract_txt:users in 1385) [ClassicSimilarity], result of:
           0.010542892 = score(doc=1385,freq=1.0), product of:
             0.047286905 = queryWeight, product of:
               1.5312961 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.008656511 = queryNorm
             0.22295584 = fieldWeight in 1385, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.055592574 = weight(abstract_txt:reliability in 1385) [ClassicSimilarity], result of:
           0.055592574 = score(doc=1385,freq=1.0), product of:
             0.13015655 = queryWeight, product of:
               2.2001505 = boost
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.008656511 = queryNorm
             0.42712083 = fieldWeight in 1385, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.027651506 = weight(abstract_txt:results in 1385) [ClassicSimilarity], result of:
           0.027651506 = score(doc=1385,freq=2.0), product of:
             0.08993187 = queryWeight, product of:
               2.9864864 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.008656511 = queryNorm
             0.30747172 = fieldWeight in 1385, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.023588313 = weight(abstract_txt:data in 1385) [ClassicSimilarity], result of:
           0.023588313 = score(doc=1385,freq=1.0), product of:
             0.11332957 = queryWeight, product of:
               3.931214 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.008656511 = queryNorm
             0.20813909 = fieldWeight in 1385, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.05399523 = weight(abstract_txt:search in 1385) [ClassicSimilarity], result of:
           0.05399523 = score(doc=1385,freq=3.0), product of:
             0.13648193 = queryWeight, product of:
               4.314124 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.008656511 = queryNorm
             0.39562184 = fieldWeight in 1385, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
         0.56502265 = weight(abstract_txt:clickthrough in 1385) [ClassicSimilarity], result of:
           0.56502265 = score(doc=1385,freq=1.0), product of:
             0.9122733 = queryWeight, product of:
               10.634602 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.008656511 = queryNorm
             0.61935675 = fieldWeight in 1385, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0625 = fieldNorm(doc=1385)
       0.28 = coord(7/25)
   

4. Jung, S.; Herlocker, J.L.; Webster, J.: Click data as implicit relevance feedback in web search (2007) 0.18

   0.17501664 = sum of:
     0.17501664 = product of:
       0.4375416 = sum of:
         0.008443433 = weight(abstract_txt:more in 1912) [ClassicSimilarity], result of:
           0.008443433 = score(doc=1912,freq=2.0), product of:
             0.0321454 = queryWeight, product of:
               1.0933993 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.008656511 = queryNorm
             0.2626638 = fieldWeight in 1912, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.00888931 = weight(abstract_txt:that in 1912) [ClassicSimilarity], result of:
           0.00888931 = score(doc=1912,freq=7.0), product of:
             0.02597836 = queryWeight, product of:
               1.2689649 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.008656511 = queryNorm
             0.34218132 = fieldWeight in 1912, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.05632506 = weight(abstract_txt:feedback in 1912) [ClassicSimilarity], result of:
           0.05632506 = score(doc=1912,freq=7.0), product of:
             0.06554217 = queryWeight, product of:
               1.2747768 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.008656511 = queryNorm
             0.8593713 = fieldWeight in 1912, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.03052556 = weight(abstract_txt:implicit in 1912) [ClassicSimilarity], result of:
           0.03052556 = score(doc=1912,freq=1.0), product of:
             0.08334153 = queryWeight, product of:
               1.4374888 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.008656511 = queryNorm
             0.3662707 = fieldWeight in 1912, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.00922503 = weight(abstract_txt:users in 1912) [ClassicSimilarity], result of:
           0.00922503 = score(doc=1912,freq=1.0), product of:
             0.047286905 = queryWeight, product of:
               1.5312961 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.008656511 = queryNorm
             0.19508636 = fieldWeight in 1912, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.0486435 = weight(abstract_txt:reliability in 1912) [ClassicSimilarity], result of:
           0.0486435 = score(doc=1912,freq=1.0), product of:
             0.13015655 = queryWeight, product of:
               2.2001505 = boost
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.008656511 = queryNorm
             0.37373072 = fieldWeight in 1912, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.08050585 = weight(abstract_txt:relevance in 1912) [ClassicSimilarity], result of:
           0.08050585 = score(doc=1912,freq=7.0), product of:
             0.11287159 = queryWeight, product of:
               2.6450632 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.008656511 = queryNorm
             0.71325165 = fieldWeight in 1912, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.038255762 = weight(abstract_txt:results in 1912) [ClassicSimilarity], result of:
           0.038255762 = score(doc=1912,freq=5.0), product of:
             0.08993187 = queryWeight, product of:
               2.9864864 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.008656511 = queryNorm
             0.42538607 = fieldWeight in 1912, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.0583781 = weight(abstract_txt:data in 1912) [ClassicSimilarity], result of:
           0.0583781 = score(doc=1912,freq=8.0), product of:
             0.11332957 = queryWeight, product of:
               3.931214 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.008656511 = queryNorm
             0.515118 = fieldWeight in 1912, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
         0.09835003 = weight(abstract_txt:search in 1912) [ClassicSimilarity], result of:
           0.09835003 = score(doc=1912,freq=13.0), product of:
             0.13648193 = queryWeight, product of:
               4.314124 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.008656511 = queryNorm
             0.7206085 = fieldWeight in 1912, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1912)
       0.4 = coord(10/25)
   

5. Zhu, S.; Xie, X.; Ye, Z.; Ai, Q.; Liu, Y.: Comparing point-wise and pair-wise relevance judgment with brain signals (2024) 0.14

   0.14274402 = sum of:
     0.14274402 = product of:
       0.35686004 = sum of:
         0.014117248 = weight(abstract_txt:differences in 2340) [ClassicSimilarity], result of:
           0.014117248 = score(doc=2340,freq=1.0), product of:
             0.045595758 = queryWeight, product of:
               1.0632514 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.008656511 = queryNorm
             0.30961758 = fieldWeight in 2340, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.0068233246 = weight(abstract_txt:more in 2340) [ClassicSimilarity], result of:
           0.0068233246 = score(doc=2340,freq=1.0), product of:
             0.0321454 = queryWeight, product of:
               1.0933993 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.008656511 = queryNorm
             0.21226442 = fieldWeight in 2340, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.016486704 = weight(abstract_txt:previous in 2340) [ClassicSimilarity], result of:
           0.016486704 = score(doc=2340,freq=1.0), product of:
             0.050564647 = queryWeight, product of:
               1.1196885 = boost
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.008656511 = queryNorm
             0.326052 = fieldWeight in 2340, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.03440801 = weight(abstract_txt:feedback in 2340) [ClassicSimilarity], result of:
           0.03440801 = score(doc=2340,freq=2.0), product of:
             0.06554217 = queryWeight, product of:
               1.2747768 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.008656511 = queryNorm
             0.5249752 = fieldWeight in 2340, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.049336758 = weight(abstract_txt:implicit in 2340) [ClassicSimilarity], result of:
           0.049336758 = score(doc=2340,freq=2.0), product of:
             0.08334153 = queryWeight, product of:
               1.4374888 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.008656511 = queryNorm
             0.59198284 = fieldWeight in 2340, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.018260824 = weight(abstract_txt:users in 2340) [ClassicSimilarity], result of:
           0.018260824 = score(doc=2340,freq=3.0), product of:
             0.047286905 = queryWeight, product of:
               1.5312961 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.008656511 = queryNorm
             0.38617083 = fieldWeight in 2340, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.010966477 = weight(abstract_txt:been in 2340) [ClassicSimilarity], result of:
           0.010966477 = score(doc=2340,freq=1.0), product of:
             0.04854515 = queryWeight, product of:
               1.5515352 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.008656511 = queryNorm
             0.22590263 = fieldWeight in 2340, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.09835927 = weight(abstract_txt:relevance in 2340) [ClassicSimilarity], result of:
           0.09835927 = score(doc=2340,freq=8.0), product of:
             0.11287159 = queryWeight, product of:
               2.6450632 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.008656511 = queryNorm
             0.87142634 = fieldWeight in 2340, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.0541062 = weight(abstract_txt:image in 2340) [ClassicSimilarity], result of:
           0.0541062 = score(doc=2340,freq=1.0), product of:
             0.16105078 = queryWeight, product of:
               3.461113 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.008656511 = queryNorm
             0.33595738 = fieldWeight in 2340, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
         0.05399523 = weight(abstract_txt:search in 2340) [ClassicSimilarity], result of:
           0.05399523 = score(doc=2340,freq=3.0), product of:
             0.13648193 = queryWeight, product of:
               4.314124 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.008656511 = queryNorm
             0.39562184 = fieldWeight in 2340, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2340)
       0.4 = coord(10/25)