Document (#30046)

Author

Lin, J.
Katz, B.

Title

Building a reusable test collection for question answering

Source

Journal of the American Society for Information Science and Technology. 57(2006) no.7, S.851-861

Year

2006

Abstract

In contrast to traditional information retrieval systems, which return ranked lists of documents that users must manually browse through, a question answering system attempts to directly answer natural language questions posed by the user. Although such systems possess language-processing capabilities, they still rely on traditional document retrieval techniques to generate an initial candidate set of documents. In this article, the authors argue that document retrieval for question answering represents a task different from retrieving documents in response to more general retrospective information needs. Thus, to guide future system development, specialized question answering test collections must be constructed. They show that the current evaluation resources have major shortcomings; to remedy the situation, they have manually created a small, reusable question answering test collection for research purposes. In this article they describe their methodology for building this test collection and discuss issues they encountered regarding the notion of "answer correctness."

Theme

Retrievalalgorithmen
Sprachretrieval

Similar documents (author)

1. Katz, M.: Multimedia: the future of information delivery to homes and business (1993) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 6645) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 6645, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=6645)
   

2. Katz, B.: Community college reference services : a working guide for and by librarians (1992) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 729) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 729, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=729)
   

3. Katz, J.S.: Bibliometric standards : personal experience and lessons learned (1996) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 5126) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 5126, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=5126)
   

4. Katz, W.A.: Introduction to reference work (1997) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 2188) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 2188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=2188)
   

5. Katz, W.A.: Introduction to reference work : Vol.1: Basic information sources; vol.2: Reference services and reference processes (1992) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 4364) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 4364, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=4364)
   

Similar documents (content)

1. Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005) 0.49

   0.49017695 = sum of:
     0.49017695 = product of:
       1.021202 = sum of:
         0.01332571 = weight(abstract_txt:that in 4455) [ClassicSimilarity], result of:
           0.01332571 = score(doc=4455,freq=3.0), product of:
             0.041640937 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017607644 = queryNorm
             0.32001466 = fieldWeight in 4455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.00810375 = weight(abstract_txt:this in 4455) [ClassicSimilarity], result of:
           0.00810375 = score(doc=4455,freq=1.0), product of:
             0.043108013 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017607644 = queryNorm
             0.18798709 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.07309833 = weight(abstract_txt:return in 4455) [ClassicSimilarity], result of:
           0.07309833 = score(doc=4455,freq=1.0), product of:
             0.12951852 = queryWeight, product of:
               1.018228 = boost
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.017607644 = queryNorm
             0.5643852 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.021267118 = weight(abstract_txt:article in 4455) [ClassicSimilarity], result of:
           0.021267118 = score(doc=4455,freq=1.0), product of:
             0.071648866 = queryWeight, product of:
               1.071023 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.017607644 = queryNorm
             0.29682422 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.028138274 = weight(abstract_txt:language in 4455) [ClassicSimilarity], result of:
           0.028138274 = score(doc=4455,freq=1.0), product of:
             0.08635123 = queryWeight, product of:
               1.1757863 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017607644 = queryNorm
             0.3258584 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.043423753 = weight(abstract_txt:document in 4455) [ClassicSimilarity], result of:
           0.043423753 = score(doc=4455,freq=2.0), product of:
             0.091526136 = queryWeight, product of:
               1.2105052 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.017607644 = queryNorm
             0.47444102 = fieldWeight in 4455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.024439864 = weight(abstract_txt:retrieval in 4455) [ClassicSimilarity], result of:
           0.024439864 = score(doc=4455,freq=1.0), product of:
             0.08998425 = queryWeight, product of:
               1.4700192 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017607644 = queryNorm
             0.27160156 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.08010793 = weight(abstract_txt:answer in 4455) [ClassicSimilarity], result of:
           0.08010793 = score(doc=4455,freq=1.0), product of:
             0.17345516 = queryWeight, product of:
               1.6664325 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.017607644 = queryNorm
             0.46183652 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.04077686 = weight(abstract_txt:documents in 4455) [ClassicSimilarity], result of:
           0.04077686 = score(doc=4455,freq=1.0), product of:
             0.12658332 = queryWeight, product of:
               1.7435243 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017607644 = queryNorm
             0.32213452 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.05103278 = weight(abstract_txt:they in 4455) [ClassicSimilarity], result of:
           0.05103278 = score(doc=4455,freq=1.0), product of:
             0.17429425 = queryWeight, product of:
               2.6412265 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.017607644 = queryNorm
             0.2927967 = fieldWeight in 4455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.23632653 = weight(abstract_txt:question in 4455) [ClassicSimilarity], result of:
           0.23632653 = score(doc=4455,freq=3.0), product of:
             0.33575165 = queryWeight, product of:
               3.6658373 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.017607644 = queryNorm
             0.70387304 = fieldWeight in 4455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
         0.40116104 = weight(abstract_txt:answering in 4455) [ClassicSimilarity], result of:
           0.40116104 = score(doc=4455,freq=2.0), product of:
             0.54691446 = queryWeight, product of:
               4.678685 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.017607644 = queryNorm
             0.7334987 = fieldWeight in 4455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.078125 = fieldNorm(doc=4455)
       0.48 = coord(12/25)
   

2. Belbachir, F.; Boughanem, M.: Using language models to improve opinion detection (2018) 0.31

   0.30741507 = sum of:
     0.30741507 = product of:
       0.6986706 = sum of:
         0.0076162782 = weight(abstract_txt:that in 44) [ClassicSimilarity], result of:
           0.0076162782 = score(doc=44,freq=2.0), product of:
             0.041640937 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017607644 = queryNorm
             0.18290362 = fieldWeight in 44, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.008022303 = weight(abstract_txt:this in 44) [ClassicSimilarity], result of:
           0.008022303 = score(doc=44,freq=2.0), product of:
             0.043108013 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017607644 = queryNorm
             0.18609773 = fieldWeight in 44, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.044043362 = weight(abstract_txt:language in 44) [ClassicSimilarity], result of:
           0.044043362 = score(doc=44,freq=5.0), product of:
             0.08635123 = queryWeight, product of:
               1.1757863 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017607644 = queryNorm
             0.51004905 = fieldWeight in 44, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.048061285 = weight(abstract_txt:document in 44) [ClassicSimilarity], result of:
           0.048061285 = score(doc=44,freq=5.0), product of:
             0.091526136 = queryWeight, product of:
               1.2105052 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.017607644 = queryNorm
             0.52510995 = fieldWeight in 44, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.035502825 = weight(abstract_txt:must in 44) [ClassicSimilarity], result of:
           0.035502825 = score(doc=44,freq=1.0), product of:
             0.12789302 = queryWeight, product of:
               1.4309272 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.017607644 = queryNorm
             0.27759784 = fieldWeight in 44, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.04190564 = weight(abstract_txt:retrieval in 44) [ClassicSimilarity], result of:
           0.04190564 = score(doc=44,freq=6.0), product of:
             0.08998425 = queryWeight, product of:
               1.4700192 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017607644 = queryNorm
             0.4656997 = fieldWeight in 44, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.049439315 = weight(abstract_txt:documents in 44) [ClassicSimilarity], result of:
           0.049439315 = score(doc=44,freq=3.0), product of:
             0.12658332 = queryWeight, product of:
               1.7435243 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017607644 = queryNorm
             0.39056736 = fieldWeight in 44, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.10025264 = weight(abstract_txt:collection in 44) [ClassicSimilarity], result of:
           0.10025264 = score(doc=44,freq=6.0), product of:
             0.16095905 = queryWeight, product of:
               1.966063 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.017607644 = queryNorm
             0.62284565 = fieldWeight in 44, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.06975214 = weight(abstract_txt:test in 44) [ClassicSimilarity], result of:
           0.06975214 = score(doc=44,freq=1.0), product of:
             0.25276673 = queryWeight, product of:
               2.8449135 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.017607644 = queryNorm
             0.2759546 = fieldWeight in 44, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.09551024 = weight(abstract_txt:question in 44) [ClassicSimilarity], result of:
           0.09551024 = score(doc=44,freq=1.0), product of:
             0.33575165 = queryWeight, product of:
               3.6658373 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.017607644 = queryNorm
             0.28446692 = fieldWeight in 44, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
         0.19856459 = weight(abstract_txt:answering in 44) [ClassicSimilarity], result of:
           0.19856459 = score(doc=44,freq=1.0), product of:
             0.54691446 = queryWeight, product of:
               4.678685 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.017607644 = queryNorm
             0.36306334 = fieldWeight in 44, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.0546875 = fieldNorm(doc=44)
       0.44 = coord(11/25)
   

3. Saint-Dizier, P.; Moens, M.-F.: Knowledge and reasoning for question answering : research perspectives (2011) 0.30

   0.2965389 = sum of:
     0.2965389 = product of:
       1.2355788 = sum of:
         0.009232324 = weight(abstract_txt:that in 3746) [ClassicSimilarity], result of:
           0.009232324 = score(doc=3746,freq=1.0), product of:
             0.041640937 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017607644 = queryNorm
             0.22171268 = fieldWeight in 3746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
         0.0097245 = weight(abstract_txt:this in 3746) [ClassicSimilarity], result of:
           0.0097245 = score(doc=3746,freq=1.0), product of:
             0.043108013 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017607644 = queryNorm
             0.2255845 = fieldWeight in 3746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
         0.033765927 = weight(abstract_txt:language in 3746) [ClassicSimilarity], result of:
           0.033765927 = score(doc=3746,freq=1.0), product of:
             0.08635123 = queryWeight, product of:
               1.1757863 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017607644 = queryNorm
             0.39103007 = fieldWeight in 3746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
         0.13594766 = weight(abstract_txt:answer in 3746) [ClassicSimilarity], result of:
           0.13594766 = score(doc=3746,freq=2.0), product of:
             0.17345516 = queryWeight, product of:
               1.6664325 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.017607644 = queryNorm
             0.7837626 = fieldWeight in 3746, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
         0.3661155 = weight(abstract_txt:question in 3746) [ClassicSimilarity], result of:
           0.3661155 = score(doc=3746,freq=5.0), product of:
             0.33575165 = queryWeight, product of:
               3.6658373 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.017607644 = queryNorm
             1.0904355 = fieldWeight in 3746, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
         0.6807929 = weight(abstract_txt:answering in 3746) [ClassicSimilarity], result of:
           0.6807929 = score(doc=3746,freq=4.0), product of:
             0.54691446 = queryWeight, product of:
               4.678685 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.017607644 = queryNorm
             1.2447886 = fieldWeight in 3746, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.09375 = fieldNorm(doc=3746)
       0.24 = coord(6/25)
   

4. Ferret, O.; Grau, B.; Hurault-Plantet, M.; Illouz, G.; Jacquemin, C.; Monceaux, L.; Robba, I.; Vilnat, A.: How NLP can improve question answering (2002) 0.29

   0.29073495 = sum of:
     0.29073495 = product of:
       0.9085467 = sum of:
         0.0076936027 = weight(abstract_txt:that in 2850) [ClassicSimilarity], result of:
           0.0076936027 = score(doc=2850,freq=1.0), product of:
             0.041640937 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017607644 = queryNorm
             0.18476056 = fieldWeight in 2850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.00810375 = weight(abstract_txt:this in 2850) [ClassicSimilarity], result of:
           0.00810375 = score(doc=2850,freq=1.0), product of:
             0.043108013 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.017607644 = queryNorm
             0.18798709 = fieldWeight in 2850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.028138274 = weight(abstract_txt:language in 2850) [ClassicSimilarity], result of:
           0.028138274 = score(doc=2850,freq=1.0), product of:
             0.08635123 = queryWeight, product of:
               1.1757863 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017607644 = queryNorm
             0.3258584 = fieldWeight in 2850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.030705228 = weight(abstract_txt:document in 2850) [ClassicSimilarity], result of:
           0.030705228 = score(doc=2850,freq=1.0), product of:
             0.091526136 = queryWeight, product of:
               1.2105052 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.017607644 = queryNorm
             0.33548045 = fieldWeight in 2850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.13875102 = weight(abstract_txt:answer in 2850) [ClassicSimilarity], result of:
           0.13875102 = score(doc=2850,freq=3.0), product of:
             0.17345516 = queryWeight, product of:
               1.6664325 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.017607644 = queryNorm
             0.7999244 = fieldWeight in 2850, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.057667185 = weight(abstract_txt:documents in 2850) [ClassicSimilarity], result of:
           0.057667185 = score(doc=2850,freq=2.0), product of:
             0.12658332 = queryWeight, product of:
               1.7435243 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017607644 = queryNorm
             0.455567 = fieldWeight in 2850, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.23632653 = weight(abstract_txt:question in 2850) [ClassicSimilarity], result of:
           0.23632653 = score(doc=2850,freq=3.0), product of:
             0.33575165 = queryWeight, product of:
               3.6658373 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.017607644 = queryNorm
             0.70387304 = fieldWeight in 2850, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
         0.40116104 = weight(abstract_txt:answering in 2850) [ClassicSimilarity], result of:
           0.40116104 = score(doc=2850,freq=2.0), product of:
             0.54691446 = queryWeight, product of:
               4.678685 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.017607644 = queryNorm
             0.7334987 = fieldWeight in 2850, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.078125 = fieldNorm(doc=2850)
       0.32 = coord(8/25)
   

5. Galitsky, B.: Can many agents answer questions better than one? (2005) 0.29

   0.28939098 = sum of:
     0.28939098 = product of:
       1.2057958 = sum of:
         0.010880399 = weight(abstract_txt:that in 4094) [ClassicSimilarity], result of:
           0.010880399 = score(doc=4094,freq=2.0), product of:
             0.041640937 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017607644 = queryNorm
             0.2612909 = fieldWeight in 4094, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
         0.028138274 = weight(abstract_txt:language in 4094) [ClassicSimilarity], result of:
           0.028138274 = score(doc=4094,freq=1.0), product of:
             0.08635123 = queryWeight, product of:
               1.1757863 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017607644 = queryNorm
             0.3258584 = fieldWeight in 4094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
         0.024439864 = weight(abstract_txt:retrieval in 4094) [ClassicSimilarity], result of:
           0.024439864 = score(doc=4094,freq=1.0), product of:
             0.08998425 = queryWeight, product of:
               1.4700192 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017607644 = queryNorm
             0.27160156 = fieldWeight in 4094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
         0.11328972 = weight(abstract_txt:answer in 4094) [ClassicSimilarity], result of:
           0.11328972 = score(doc=4094,freq=2.0), product of:
             0.17345516 = queryWeight, product of:
               1.6664325 = boost
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.017607644 = queryNorm
             0.6531355 = fieldWeight in 4094, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9115076 = idf(docFreq=326, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
         0.3342162 = weight(abstract_txt:question in 4094) [ClassicSimilarity], result of:
           0.3342162 = score(doc=4094,freq=6.0), product of:
             0.33575165 = queryWeight, product of:
               3.6658373 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.017607644 = queryNorm
             0.99542683 = fieldWeight in 4094, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
         0.6948313 = weight(abstract_txt:answering in 4094) [ClassicSimilarity], result of:
           0.6948313 = score(doc=4094,freq=6.0), product of:
             0.54691446 = queryWeight, product of:
               4.678685 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.017607644 = queryNorm
             1.270457 = fieldWeight in 4094, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.078125 = fieldNorm(doc=4094)
       0.24 = coord(6/25)