Document (#43872)

Author

Radford, A.
Narasimhan, K.
Salimans, T.
Sutskever, I.

Title

Improving language understanding by Generative Pre-Training

Source

https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf

Abstract

Natural language understanding comprises a wide range of diverse tasks such as textual entailment, question answering, semantic similarity assessment, and document classification. Although large unlabeled text corpora are abundant, labeled data for learning these specific tasks is scarce, making it challenging for discriminatively trained models to perform adequately. We demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task. In contrast to previous approaches, we make use of task-aware input transformations during fine-tuning to achieve effective transfer while requiring minimal changes to the model architecture. We demonstrate the effectiveness of our approach on a wide range of benchmarks for natural language understanding. Our general task-agnostic model outperforms discriminatively trained models that use architectures specifically crafted for each task, significantly improving upon the state of the art in 9 out of the 12 tasks studied. For instance, we achieve absolute improvements of 8.9% on commonsense reasoning (Stories Cloze Test), 5.7% on question answering (RACE), and 1.5% on textual entailment (MultiNLI).

Theme

Computerlinguistik

Object

GPT-1

Similar documents (author)

1. Radford, G.P.; Radford, M.L.: Structuralism, post-structuralism, and the library : de Saussure and Foucault (2005) 6.36

   6.3593063 = sum of:
     6.3593063 = weight(author_txt:radford in 5411) [ClassicSimilarity], result of:
       6.3593063 = fieldWeight in 5411, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.5 = fieldNorm(doc=5411)
   

2. Radford, W.: Cataloges, codes and bibliographical control (1949) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:radford in 1836) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 1836, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=1836)
   

3. Radford, M.L.: Communication theory applied to the reference encounter : an analysis of critical incidents (1996) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:radford in 6489) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 6489, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=6489)
   

4. Radford, G.P.: Flaubert, Foucault, and the Bibliothèque Fantastique : toward a postmodern epistemology for library science (1998) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:radford in 3974) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 3974, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=3974)
   

5. Radford, M.L.: Approach or avoidance? : The role of nonverbal communication in the academic library user's decision to initiate a reference encounter (1998) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:radford in 4050) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 4050, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=4050)
   

Similar documents (content)

1. Shree, P.: ¬The journey of Open AI GPT models (2020) 0.62

   0.6190984 = sum of:
     0.6190984 = product of:
       1.1905739 = sum of:
         0.078206435 = weight(abstract_txt:models in 1870) [ClassicSimilarity], result of:
           0.078206435 = score(doc=1870,freq=9.0), product of:
             0.090220556 = queryWeight, product of:
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019515054 = queryNorm
             0.86683613 = fieldWeight in 1870, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.034371667 = weight(abstract_txt:natural in 1870) [ClassicSimilarity], result of:
           0.034371667 = score(doc=1870,freq=1.0), product of:
             0.108482175 = queryWeight, product of:
               1.096545 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.019515054 = queryNorm
             0.3168416 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.049618453 = weight(abstract_txt:training in 1870) [ClassicSimilarity], result of:
           0.049618453 = score(doc=1870,freq=2.0), product of:
             0.1099791 = queryWeight, product of:
               1.1040845 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.019515054 = queryNorm
             0.45116258 = fieldWeight in 1870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.037131727 = weight(abstract_txt:question in 1870) [ClassicSimilarity], result of:
           0.037131727 = score(doc=1870,freq=1.0), product of:
             0.11421455 = queryWeight, product of:
               1.1251436 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.019515054 = queryNorm
             0.32510504 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.053917795 = weight(abstract_txt:improving in 1870) [ClassicSimilarity], result of:
           0.053917795 = score(doc=1870,freq=1.0), product of:
             0.14645788 = queryWeight, product of:
               1.2741003 = boost
               5.8903265 = idf(docFreq=333, maxDocs=44421)
               0.019515054 = queryNorm
             0.3681454 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8903265 = idf(docFreq=333, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.055991556 = weight(abstract_txt:textual in 1870) [ClassicSimilarity], result of:
           0.055991556 = score(doc=1870,freq=1.0), product of:
             0.15018955 = queryWeight, product of:
               1.2902299 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019515054 = queryNorm
             0.37280595 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.07719641 = weight(abstract_txt:answering in 1870) [ClassicSimilarity], result of:
           0.07719641 = score(doc=1870,freq=1.0), product of:
             0.18604703 = queryWeight, product of:
               1.4360138 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.019515054 = queryNorm
             0.41492954 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.03652293 = weight(abstract_txt:understanding in 1870) [ClassicSimilarity], result of:
           0.03652293 = score(doc=1870,freq=1.0), product of:
             0.12931001 = queryWeight, product of:
               1.4662532 = boost
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.019515054 = queryNorm
             0.28244472 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.13059774 = weight(abstract_txt:trained in 1870) [ClassicSimilarity], result of:
           0.13059774 = score(doc=1870,freq=2.0), product of:
             0.20965494 = queryWeight, product of:
               1.524403 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.019515054 = queryNorm
             0.62291753 = fieldWeight in 1870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.20609072 = weight(abstract_txt:generative in 1870) [ClassicSimilarity], result of:
           0.20609072 = score(doc=1870,freq=2.0), product of:
             0.28417572 = queryWeight, product of:
               1.7747645 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.019515054 = queryNorm
             0.7252228 = fieldWeight in 1870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.09378565 = weight(abstract_txt:language in 1870) [ClassicSimilarity], result of:
           0.09378565 = score(doc=1870,freq=6.0), product of:
             0.14687295 = queryWeight, product of:
               1.8044014 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.019515054 = queryNorm
             0.6385495 = fieldWeight in 1870, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.2350248 = weight(abstract_txt:entailment in 1870) [ClassicSimilarity], result of:
           0.2350248 = score(doc=1870,freq=1.0), product of:
             0.3908113 = queryWeight, product of:
               2.0812814 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.019515054 = queryNorm
             0.60137665 = fieldWeight in 1870, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
         0.10211799 = weight(abstract_txt:tasks in 1870) [ClassicSimilarity], result of:
           0.10211799 = score(doc=1870,freq=2.0), product of:
             0.22419514 = queryWeight, product of:
               2.229335 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.019515054 = queryNorm
             0.4554871 = fieldWeight in 1870, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=1870)
       0.52 = coord(13/25)
   

2. Brown, T.B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D.M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; Amodei, D.: Language models are few-shot learners (2020) 0.52

   0.51831335 = sum of:
     0.51831335 = product of:
       1.1779848 = sum of:
         0.02281021 = weight(abstract_txt:models in 1873) [ClassicSimilarity], result of:
           0.02281021 = score(doc=1873,freq=1.0), product of:
             0.090220556 = queryWeight, product of:
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019515054 = queryNorm
             0.2528272 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.15155257 = weight(abstract_txt:agnostic in 1873) [ClassicSimilarity], result of:
           0.15155257 = score(doc=1873,freq=2.0), product of:
             0.2008668 = queryWeight, product of:
               1.0550823 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.019515054 = queryNorm
             0.7544929 = fieldWeight in 1873, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.043416146 = weight(abstract_txt:training in 1873) [ClassicSimilarity], result of:
           0.043416146 = score(doc=1873,freq=2.0), product of:
             0.1099791 = queryWeight, product of:
               1.1040845 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.019515054 = queryNorm
             0.39476725 = fieldWeight in 1873, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.03249026 = weight(abstract_txt:question in 1873) [ClassicSimilarity], result of:
           0.03249026 = score(doc=1873,freq=1.0), product of:
             0.11421455 = queryWeight, product of:
               1.1251436 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.019515054 = queryNorm
             0.28446692 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.037890784 = weight(abstract_txt:model in 1873) [ClassicSimilarity], result of:
           0.037890784 = score(doc=1873,freq=3.0), product of:
             0.10043807 = queryWeight, product of:
               1.2922367 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.019515054 = queryNorm
             0.3772552 = fieldWeight in 1873, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.06754686 = weight(abstract_txt:answering in 1873) [ClassicSimilarity], result of:
           0.06754686 = score(doc=1873,freq=1.0), product of:
             0.18604703 = queryWeight, product of:
               1.4360138 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.019515054 = queryNorm
             0.36306334 = fieldWeight in 1873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.17009981 = weight(abstract_txt:fine in 1873) [ClassicSimilarity], result of:
           0.17009981 = score(doc=1873,freq=4.0), product of:
             0.21693778 = queryWeight, product of:
               1.5506538 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.019515054 = queryNorm
             0.7840949 = fieldWeight in 1873, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.0670037 = weight(abstract_txt:language in 1873) [ClassicSimilarity], result of:
           0.0670037 = score(doc=1873,freq=4.0), product of:
             0.14687295 = queryWeight, product of:
               1.8044014 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.019515054 = queryNorm
             0.45620176 = fieldWeight in 1873, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.32200792 = weight(abstract_txt:tuning in 1873) [ClassicSimilarity], result of:
           0.32200792 = score(doc=1873,freq=4.0), product of:
             0.3319788 = queryWeight, product of:
               1.9182377 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.019515054 = queryNorm
             0.96996534 = fieldWeight in 1873, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.12188673 = weight(abstract_txt:task in 1873) [ClassicSimilarity], result of:
           0.12188673 = score(doc=1873,freq=5.0), product of:
             0.20317811 = queryWeight, product of:
               2.1222703 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.019515054 = queryNorm
             0.5999009 = fieldWeight in 1873, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
         0.14127989 = weight(abstract_txt:tasks in 1873) [ClassicSimilarity], result of:
           0.14127989 = score(doc=1873,freq=5.0), product of:
             0.22419514 = queryWeight, product of:
               2.229335 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.019515054 = queryNorm
             0.63016486 = fieldWeight in 1873, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1873)
       0.44 = coord(11/25)
   

3. Lund, B.D.: ¬A brief review of ChatGPT : its value and the underlying GPT technology (2023) 0.39

   0.38781837 = sum of:
     0.38781837 = product of:
       0.9695459 = sum of:
         0.042632647 = weight(abstract_txt:range in 1874) [ClassicSimilarity], result of:
           0.042632647 = score(doc=1874,freq=1.0), product of:
             0.10792271 = queryWeight, product of:
               1.0937138 = boost
               5.0563765 = idf(docFreq=768, maxDocs=44421)
               0.019515054 = queryNorm
             0.39502943 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0563765 = idf(docFreq=768, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.04296458 = weight(abstract_txt:natural in 1874) [ClassicSimilarity], result of:
           0.04296458 = score(doc=1874,freq=1.0), product of:
             0.108482175 = queryWeight, product of:
               1.096545 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.019515054 = queryNorm
             0.396052 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.031251792 = weight(abstract_txt:model in 1874) [ClassicSimilarity], result of:
           0.031251792 = score(doc=1874,freq=1.0), product of:
             0.10043807 = queryWeight, product of:
               1.2922367 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.019515054 = queryNorm
             0.31115484 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.045653664 = weight(abstract_txt:understanding in 1874) [ClassicSimilarity], result of:
           0.045653664 = score(doc=1874,freq=1.0), product of:
             0.12931001 = queryWeight, product of:
               1.4662532 = boost
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.019515054 = queryNorm
             0.3530559 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.11543319 = weight(abstract_txt:trained in 1874) [ClassicSimilarity], result of:
           0.11543319 = score(doc=1874,freq=1.0), product of:
             0.20965494 = queryWeight, product of:
               1.524403 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.019515054 = queryNorm
             0.5505865 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.12149987 = weight(abstract_txt:fine in 1874) [ClassicSimilarity], result of:
           0.12149987 = score(doc=1874,freq=1.0), product of:
             0.21693778 = queryWeight, product of:
               1.5506538 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.019515054 = queryNorm
             0.56006783 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.18216018 = weight(abstract_txt:generative in 1874) [ClassicSimilarity], result of:
           0.18216018 = score(doc=1874,freq=1.0), product of:
             0.28417572 = queryWeight, product of:
               1.7747645 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.019515054 = queryNorm
             0.6410125 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.06768396 = weight(abstract_txt:language in 1874) [ClassicSimilarity], result of:
           0.06768396 = score(doc=1874,freq=2.0), product of:
             0.14687295 = queryWeight, product of:
               1.8044014 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.019515054 = queryNorm
             0.46083337 = fieldWeight in 1874, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.23000567 = weight(abstract_txt:tuning in 1874) [ClassicSimilarity], result of:
           0.23000567 = score(doc=1874,freq=1.0), product of:
             0.3319788 = queryWeight, product of:
               1.9182377 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.019515054 = queryNorm
             0.6928324 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.09026041 = weight(abstract_txt:tasks in 1874) [ClassicSimilarity], result of:
           0.09026041 = score(doc=1874,freq=1.0), product of:
             0.22419514 = queryWeight, product of:
               2.229335 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.019515054 = queryNorm
             0.40259752 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
       0.4 = coord(10/25)
   

4. Korman, D.Z.; Mack, E.; Jett, J.; Renear, A.H.: Defining textual entailment (2018) 0.34

   0.3413276 = sum of:
     0.3413276 = product of:
       1.2190272 = sum of:
         0.038103927 = weight(abstract_txt:wide in 284) [ClassicSimilarity], result of:
           0.038103927 = score(doc=284,freq=1.0), product of:
             0.10013775 = queryWeight, product of:
               1.0535282 = boost
               4.8705935 = idf(docFreq=925, maxDocs=44421)
               0.019515054 = queryNorm
             0.38051513 = fieldWeight in 284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8705935 = idf(docFreq=925, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.04296458 = weight(abstract_txt:natural in 284) [ClassicSimilarity], result of:
           0.04296458 = score(doc=284,freq=1.0), product of:
             0.108482175 = queryWeight, product of:
               1.096545 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.019515054 = queryNorm
             0.396052 = fieldWeight in 284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.04641466 = weight(abstract_txt:question in 284) [ClassicSimilarity], result of:
           0.04641466 = score(doc=284,freq=1.0), product of:
             0.11421455 = queryWeight, product of:
               1.1251436 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.019515054 = queryNorm
             0.4063813 = fieldWeight in 284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.18517466 = weight(abstract_txt:textual in 284) [ClassicSimilarity], result of:
           0.18517466 = score(doc=284,freq=7.0), product of:
             0.15018955 = queryWeight, product of:
               1.2902299 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019515054 = queryNorm
             1.2329397 = fieldWeight in 284, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.09649551 = weight(abstract_txt:answering in 284) [ClassicSimilarity], result of:
           0.09649551 = score(doc=284,freq=1.0), product of:
             0.18604703 = queryWeight, product of:
               1.4360138 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.019515054 = queryNorm
             0.5186619 = fieldWeight in 284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.7196135 = weight(abstract_txt:entailment in 284) [ClassicSimilarity], result of:
           0.7196135 = score(doc=284,freq=6.0), product of:
             0.3908113 = queryWeight, product of:
               2.0812814 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.019515054 = queryNorm
             1.8413324 = fieldWeight in 284, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
         0.09026041 = weight(abstract_txt:tasks in 284) [ClassicSimilarity], result of:
           0.09026041 = score(doc=284,freq=1.0), product of:
             0.22419514 = queryWeight, product of:
               2.229335 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.019515054 = queryNorm
             0.40259752 = fieldWeight in 284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.078125 = fieldNorm(doc=284)
       0.28 = coord(7/25)
   

5. Radford, A.; Wu, J.; Child, R.; Luan, D.; Amode, D.; Sutskever, I.: Language models are unsupervised multitask learners 0.32

   0.3165183 = sum of:
     0.3165183 = product of:
       0.7193598 = sum of:
         0.026068812 = weight(abstract_txt:models in 1872) [ClassicSimilarity], result of:
           0.026068812 = score(doc=1872,freq=1.0), product of:
             0.090220556 = queryWeight, product of:
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.019515054 = queryNorm
             0.28894538 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.034371667 = weight(abstract_txt:natural in 1872) [ClassicSimilarity], result of:
           0.034371667 = score(doc=1872,freq=1.0), product of:
             0.108482175 = queryWeight, product of:
               1.096545 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.019515054 = queryNorm
             0.3168416 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.035085548 = weight(abstract_txt:training in 1872) [ClassicSimilarity], result of:
           0.035085548 = score(doc=1872,freq=1.0), product of:
             0.1099791 = queryWeight, product of:
               1.1040845 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.019515054 = queryNorm
             0.31902012 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.037131727 = weight(abstract_txt:question in 1872) [ClassicSimilarity], result of:
           0.037131727 = score(doc=1872,freq=1.0), product of:
             0.11421455 = queryWeight, product of:
               1.1251436 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.019515054 = queryNorm
             0.32510504 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.040853433 = weight(abstract_txt:demonstrate in 1872) [ClassicSimilarity], result of:
           0.040853433 = score(doc=1872,freq=1.0), product of:
             0.12172423 = queryWeight, product of:
               1.1615443 = boost
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.019515054 = queryNorm
             0.33562285 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.05000287 = weight(abstract_txt:model in 1872) [ClassicSimilarity], result of:
           0.05000287 = score(doc=1872,freq=4.0), product of:
             0.10043807 = queryWeight, product of:
               1.2922367 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.019515054 = queryNorm
             0.49784777 = fieldWeight in 1872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.07719641 = weight(abstract_txt:answering in 1872) [ClassicSimilarity], result of:
           0.07719641 = score(doc=1872,freq=1.0), product of:
             0.18604703 = queryWeight, product of:
               1.4360138 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.019515054 = queryNorm
             0.41492954 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.09234655 = weight(abstract_txt:trained in 1872) [ClassicSimilarity], result of:
           0.09234655 = score(doc=1872,freq=1.0), product of:
             0.20965494 = queryWeight, product of:
               1.524403 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.019515054 = queryNorm
             0.4404692 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.09378565 = weight(abstract_txt:language in 1872) [ClassicSimilarity], result of:
           0.09378565 = score(doc=1872,freq=6.0), product of:
             0.14687295 = queryWeight, product of:
               1.8044014 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.019515054 = queryNorm
             0.6385495 = fieldWeight in 1872, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.0881005 = weight(abstract_txt:task in 1872) [ClassicSimilarity], result of:
           0.0881005 = score(doc=1872,freq=2.0), product of:
             0.20317811 = queryWeight, product of:
               2.1222703 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.019515054 = queryNorm
             0.43361217 = fieldWeight in 1872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.14441665 = weight(abstract_txt:tasks in 1872) [ClassicSimilarity], result of:
           0.14441665 = score(doc=1872,freq=4.0), product of:
             0.22419514 = queryWeight, product of:
               2.229335 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.019515054 = queryNorm
             0.64415604 = fieldWeight in 1872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
       0.44 = coord(11/25)