Document (#43925)

Author

Jha, A.

Title

Why GPT-4 isn't all it's cracked up to be

Issue

[22.03.2023].

Source

¬The Economist. 2023, 22.03.2023

Year

2023

Abstract

"I still don't know what to think about GPT-4, the new large language model (LLM) from OpenAI. On the one hand it is a remarkable product that easily passes the Turing test. If you ask it questions, via the ChatGPT interface, GPT-4 can easily produce fluid sentences largely indistinguishable from those a person might write. But on the other hand, amid the exceptional levels of hype and anticipation, it's hard to know where GPT-4 and other LLMs truly fit in the larger project of making machines intelligent.
They might appear intelligent, but LLMs are nothing of the sort. They don't understand the meanings of the words they are using, nor the concepts expressed within the sentences they create. When asked how to bring a cow back to life, earlier versions of ChatGPT, for example, which ran on a souped-up version of GPT-3, would confidently provide a list of instructions. So-called hallucinations like this happen because language models have no concept of what a "cow" is or that "death" is a non-reversible state of being. LLMs do not have minds that can think about objects in the world and how they relate to each other. All they "know" is how likely it is that some sets of words will follow other sets of words, having calculated those probabilities from their training data. To make sense of all this, I spoke with Gary Marcus, an emeritus professor of psychology and neural science at New York University, for "Babbage", our science and technology podcast. Last year, as the world was transfixed by the sudden appearance of ChatGPT, he made some fascinating predictions about GPT-4.
He doesn't dismiss the potential of LLMs to become useful assistants in all sorts of ways-Google and Microsoft have already announced that they will be integrating LLMs into their search and office productivity software. But he talked me through some of his criticisms of the technology's apparent capabilities. At the heart of Dr Marcus's thoughtful critique is an attempt to put LLMs into proper context. Deep learning, the underlying technology that makes LLMs work, is only one piece of the puzzle in the quest for machine intelligence. To reach the level of artificial general intelligence (AGI) that many tech companies strive for-i.e. machines that can plan, reason and solve problems in the way human brains can-they will need to deploy a suite of other AI techniques. These include, for example, the kind of "symbolic AI" that was popular before artificial neural networks and deep learning became all the rage.
People use symbols to think about the world: if I say the words "cat", "house" or "aeroplane", you know instantly what I mean. Symbols can also be used to describe the way things are behaving (running, falling, flying) or they can represent how things should behave in relation to each other (a "+" means add the numbers before and after). Symbolic AI is a way to embed this human knowledge and reasoning into computer systems. Though the idea has been around for decades, it fell by the wayside a few years ago as deep learning-buoyed by the sudden easy availability of lots of training data and cheap computing power-became more fashionable. In the near future at least, there's no doubt people will find LLMs useful. But whether they represent a critical step on the path towards AGI, or rather just an intriguing detour, remains to be seen."

Theme

Computerlinguistik

Object

ChatGPT
GPT-4

Similar documents (content)

1. Kau, A.; He, X.; Nambissan, A.; Astudillo, A.; Yin, H.; Aryani, A.: Combining graphs and Large Language Models (2024) 0.21

   0.21454418 = sum of:
     0.21454418 = product of:
       1.0727209 = sum of:
         0.019164708 = weight(abstract_txt:world in 2336) [ClassicSimilarity], result of:
           0.019164708 = score(doc=2336,freq=1.0), product of:
             0.069265 = queryWeight, product of:
               1.0616736 = boost
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.014737182 = queryNorm
             0.27668676 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.016959 = weight(abstract_txt:will in 2336) [ClassicSimilarity], result of:
           0.016959 = score(doc=2336,freq=1.0), product of:
             0.07026819 = queryWeight, product of:
               1.2347609 = boost
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.014737182 = queryNorm
             0.24134676 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.01753017 = weight(abstract_txt:that in 2336) [ClassicSimilarity], result of:
           0.01753017 = score(doc=2336,freq=4.0), product of:
             0.059300296 = queryWeight, product of:
               1.7014656 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014737182 = queryNorm
             0.2956169 = fieldWeight in 2336, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.038760047 = weight(abstract_txt:they in 2336) [ClassicSimilarity], result of:
           0.038760047 = score(doc=2336,freq=1.0), product of:
             0.16547339 = queryWeight, product of:
               2.9959707 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.014737182 = queryNorm
             0.23423736 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.9803069 = weight(abstract_txt:llms in 2336) [ClassicSimilarity], result of:
           0.9803069 = score(doc=2336,freq=5.0), product of:
             0.77402204 = queryWeight, product of:
               5.7955565 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.014737182 = queryNorm
             1.2665104 = fieldWeight in 2336, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
       0.2 = coord(5/25)
   

2. Yang, L.; Chen, H.; Li, Z.; Ding, X.; Wu, X.: Give us the facts : enhancing Large Language Models with knowledge graphs for fact-aware language modeling (2024) 0.17

   0.16780029 = sum of:
     0.16780029 = product of:
       1.0487518 = sum of:
         0.023554875 = weight(abstract_txt:learning in 2337) [ClassicSimilarity], result of:
           0.023554875 = score(doc=2337,freq=1.0), product of:
             0.07947543 = queryWeight, product of:
               1.1372359 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.014737182 = queryNorm
             0.29637933 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.10962378 = weight(abstract_txt:chatgpt in 2337) [ClassicSimilarity], result of:
           0.10962378 = score(doc=2337,freq=1.0), product of:
             0.22153834 = queryWeight, product of:
               1.8987097 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.014737182 = queryNorm
             0.49482986 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.038760047 = weight(abstract_txt:they in 2337) [ClassicSimilarity], result of:
           0.038760047 = score(doc=2337,freq=1.0), product of:
             0.16547339 = queryWeight, product of:
               2.9959707 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.014737182 = queryNorm
             0.23423736 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.8768132 = weight(abstract_txt:llms in 2337) [ClassicSimilarity], result of:
           0.8768132 = score(doc=2337,freq=4.0), product of:
             0.77402204 = queryWeight, product of:
               5.7955565 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.014737182 = queryNorm
             1.1328013 = fieldWeight in 2337, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
       0.16 = coord(4/25)
   

3. Frederick, D.E.: ChatGPT: a viral data-driven disruption in the information environment (2023) 0.17

   0.16716254 = sum of:
     0.16716254 = product of:
       0.46434036 = sum of:
         0.024968654 = weight(abstract_txt:what in 1985) [ClassicSimilarity], result of:
           0.024968654 = score(doc=1985,freq=2.0), product of:
             0.06557915 = queryWeight, product of:
               1.0330397 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.014737182 = queryNorm
             0.3807407 = fieldWeight in 1985, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.033311624 = weight(abstract_txt:learning in 1985) [ClassicSimilarity], result of:
           0.033311624 = score(doc=1985,freq=2.0), product of:
             0.07947543 = queryWeight, product of:
               1.1372359 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.014737182 = queryNorm
             0.41914365 = fieldWeight in 1985, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.016959 = weight(abstract_txt:will in 1985) [ClassicSimilarity], result of:
           0.016959 = score(doc=1985,freq=1.0), product of:
             0.07026819 = queryWeight, product of:
               1.2347609 = boost
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.014737182 = queryNorm
             0.24134676 = fieldWeight in 1985, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.035366297 = weight(abstract_txt:about in 1985) [ClassicSimilarity], result of:
           0.035366297 = score(doc=1985,freq=4.0), product of:
             0.072254516 = queryWeight, product of:
               1.2520913 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.014737182 = queryNorm
             0.48946834 = fieldWeight in 1985, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.06408606 = weight(abstract_txt:think in 1985) [ClassicSimilarity], result of:
           0.06408606 = score(doc=1985,freq=1.0), product of:
             0.1548893 = queryWeight, product of:
               1.5876136 = boost
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.014737182 = queryNorm
             0.41375396 = fieldWeight in 1985, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.019245423 = weight(abstract_txt:other in 1985) [ClassicSimilarity], result of:
           0.019245423 = score(doc=1985,freq=1.0), product of:
             0.08751329 = queryWeight, product of:
               1.6876645 = boost
               3.5186288 = idf(docFreq=3578, maxDocs=44421)
               0.014737182 = queryNorm
             0.2199143 = fieldWeight in 1985, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5186288 = idf(docFreq=3578, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.012395702 = weight(abstract_txt:that in 1985) [ClassicSimilarity], result of:
           0.012395702 = score(doc=1985,freq=2.0), product of:
             0.059300296 = queryWeight, product of:
               1.7014656 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014737182 = queryNorm
             0.20903271 = fieldWeight in 1985, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.21924756 = weight(abstract_txt:chatgpt in 1985) [ClassicSimilarity], result of:
           0.21924756 = score(doc=1985,freq=4.0), product of:
             0.22153834 = queryWeight, product of:
               1.8987097 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.014737182 = queryNorm
             0.9896597 = fieldWeight in 1985, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
         0.038760047 = weight(abstract_txt:they in 1985) [ClassicSimilarity], result of:
           0.038760047 = score(doc=1985,freq=1.0), product of:
             0.16547339 = queryWeight, product of:
               2.9959707 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.014737182 = queryNorm
             0.23423736 = fieldWeight in 1985, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=1985)
       0.36 = coord(9/25)
   

4. Battelle, J.: ¬The search : how Google and its rivals rewrote the rules of business and transformed our culture (2005) 0.16

   0.16486514 = sum of:
     0.16486514 = product of:
       0.37469348 = sum of:
         0.01872649 = weight(abstract_txt:what in 941) [ClassicSimilarity], result of:
           0.01872649 = score(doc=941,freq=2.0), product of:
             0.06557915 = queryWeight, product of:
               1.0330397 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.014737182 = queryNorm
             0.28555554 = fieldWeight in 941, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.024895685 = weight(abstract_txt:world in 941) [ClassicSimilarity], result of:
           0.024895685 = score(doc=941,freq=3.0), product of:
             0.069265 = queryWeight, product of:
               1.0616736 = boost
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.014737182 = queryNorm
             0.35942662 = fieldWeight in 941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.0254385 = weight(abstract_txt:will in 941) [ClassicSimilarity], result of:
           0.0254385 = score(doc=941,freq=4.0), product of:
             0.07026819 = queryWeight, product of:
               1.2347609 = boost
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.014737182 = queryNorm
             0.36202013 = fieldWeight in 941, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.022971082 = weight(abstract_txt:about in 941) [ClassicSimilarity], result of:
           0.022971082 = score(doc=941,freq=3.0), product of:
             0.072254516 = queryWeight, product of:
               1.2520913 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.014737182 = queryNorm
             0.317919 = fieldWeight in 941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.054346472 = weight(abstract_txt:don't in 941) [ClassicSimilarity], result of:
           0.054346472 = score(doc=941,freq=1.0), product of:
             0.14685498 = queryWeight, product of:
               1.2622135 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.014737182 = queryNorm
             0.37006897 = fieldWeight in 941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.055290762 = weight(abstract_txt:it's in 941) [ClassicSimilarity], result of:
           0.055290762 = score(doc=941,freq=1.0), product of:
             0.1485512 = queryWeight, product of:
               1.269482 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014737182 = queryNorm
             0.37220004 = fieldWeight in 941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.048064545 = weight(abstract_txt:think in 941) [ClassicSimilarity], result of:
           0.048064545 = score(doc=941,freq=1.0), product of:
             0.1548893 = queryWeight, product of:
               1.5876136 = boost
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.014737182 = queryNorm
             0.31031546 = fieldWeight in 941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.028868135 = weight(abstract_txt:other in 941) [ClassicSimilarity], result of:
           0.028868135 = score(doc=941,freq=4.0), product of:
             0.08751329 = queryWeight, product of:
               1.6876645 = boost
               3.5186288 = idf(docFreq=3578, maxDocs=44421)
               0.014737182 = queryNorm
             0.32987145 = fieldWeight in 941, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5186288 = idf(docFreq=3578, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.011386178 = weight(abstract_txt:that in 941) [ClassicSimilarity], result of:
           0.011386178 = score(doc=941,freq=3.0), product of:
             0.059300296 = queryWeight, product of:
               1.7014656 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014737182 = queryNorm
             0.1920088 = fieldWeight in 941, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.033935774 = weight(abstract_txt:words in 941) [ClassicSimilarity], result of:
           0.033935774 = score(doc=941,freq=1.0), product of:
             0.13517289 = queryWeight, product of:
               1.7125698 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.014737182 = queryNorm
             0.25105458 = fieldWeight in 941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
         0.050769825 = weight(abstract_txt:know in 941) [ClassicSimilarity], result of:
           0.050769825 = score(doc=941,freq=1.0), product of:
             0.176816 = queryWeight, product of:
               1.9586835 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.014737182 = queryNorm
             0.28713366 = fieldWeight in 941, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.046875 = fieldNorm(doc=941)
       0.44 = coord(11/25)
   

5. Larson, E.J.: ¬The myth of artificial intelligence : why computers can't think the way we do (2021) 0.12

   0.12455631 = sum of:
     0.12455631 = product of:
       0.34598973 = sum of:
         0.026757702 = weight(abstract_txt:what in 2343) [ClassicSimilarity], result of:
           0.026757702 = score(doc=2343,freq=3.0), product of:
             0.06557915 = queryWeight, product of:
               1.0330397 = boost
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.014737182 = queryNorm
             0.40802145 = fieldWeight in 2343, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3075895 = idf(docFreq=1625, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.045102492 = weight(abstract_txt:machines in 2343) [ClassicSimilarity], result of:
           0.045102492 = score(doc=2343,freq=1.0), product of:
             0.11702454 = queryWeight, product of:
               1.1267484 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.014737182 = queryNorm
             0.38541055 = fieldWeight in 2343, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.020610515 = weight(abstract_txt:learning in 2343) [ClassicSimilarity], result of:
           0.020610515 = score(doc=2343,freq=1.0), product of:
             0.07947543 = queryWeight, product of:
               1.1372359 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.014737182 = queryNorm
             0.2593319 = fieldWeight in 2343, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.020985693 = weight(abstract_txt:will in 2343) [ClassicSimilarity], result of:
           0.020985693 = score(doc=2343,freq=2.0), product of:
             0.07026819 = queryWeight, product of:
               1.2347609 = boost
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.014737182 = queryNorm
             0.2986514 = fieldWeight in 2343, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.8615482 = idf(docFreq=2539, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.015472755 = weight(abstract_txt:about in 2343) [ClassicSimilarity], result of:
           0.015472755 = score(doc=2343,freq=1.0), product of:
             0.072254516 = queryWeight, product of:
               1.2520913 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.014737182 = queryNorm
             0.2141424 = fieldWeight in 2343, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.06340422 = weight(abstract_txt:don't in 2343) [ClassicSimilarity], result of:
           0.06340422 = score(doc=2343,freq=1.0), product of:
             0.14685498 = queryWeight, product of:
               1.2622135 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.014737182 = queryNorm
             0.43174714 = fieldWeight in 2343, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.017149411 = weight(abstract_txt:that in 2343) [ClassicSimilarity], result of:
           0.017149411 = score(doc=2343,freq=5.0), product of:
             0.059300296 = queryWeight, product of:
               1.7014656 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014737182 = queryNorm
             0.28919604 = fieldWeight in 2343, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.1025919 = weight(abstract_txt:know in 2343) [ClassicSimilarity], result of:
           0.1025919 = score(doc=2343,freq=3.0), product of:
             0.176816 = queryWeight, product of:
               1.9586835 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.014737182 = queryNorm
             0.58021843 = fieldWeight in 2343, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
         0.033915043 = weight(abstract_txt:they in 2343) [ClassicSimilarity], result of:
           0.033915043 = score(doc=2343,freq=1.0), product of:
             0.16547339 = queryWeight, product of:
               2.9959707 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.014737182 = queryNorm
             0.2049577 = fieldWeight in 2343, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2343)
       0.36 = coord(9/25)