Document (#43871)

Author

Shree, P.

Title

¬The journey of Open AI GPT models

Issue

[10.11.2020].

Source

https://medium.com/walmartglobaltech/the-journey-of-open-ai-gpt-models-32d95b7b7fb2

Year

2020

Abstract

Generative Pre-trained Transformer (GPT) models by OpenAI have taken natural language processing (NLP) community by storm by introducing very powerful language models. These models can perform various NLP tasks like question answering, textual entailment, text summarisation etc. without any supervised training. These language models need very few to no examples to understand the tasks and perform equivalent or even better than the state-of-the-art models trained in supervised fashion. In this article we will cover the journey of these models and understand how they have evolved over a period of 2 years. 1. Discussion of GPT-1 paper (Improving Language Understanding by Generative Pre-training). 2. Discussion of GPT-2 paper (Language Models are unsupervised multitask learners) and its subsequent improvements over GPT-1. 3. Discussion of GPT-3 paper (Language models are few shot learners) and the improvements which have made it one of the most powerful models NLP has seen till date. This article assumes familiarity with the basics of NLP terminologies and transformer architecture.

Theme

Computerlinguistik

Object

GPT-x

Similar documents (content)

1. Radford, A.; Wu, J.; Child, R.; Luan, D.; Amode, D.; Sutskever, I.: Language models are unsupervised multitask learners 0.46

   0.45587566 = sum of:
     0.45587566 = product of:
       1.0360811 = sum of:
         0.1151283 = weight(abstract_txt:shot in 1872) [ClassicSimilarity], result of:
           0.1151283 = score(doc=1872,freq=2.0), product of:
             0.15127337 = queryWeight, product of:
               1.014733 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.017313551 = queryNorm
             0.76106125 = fieldWeight in 1872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.021366537 = weight(abstract_txt:these in 1872) [ClassicSimilarity], result of:
           0.021366537 = score(doc=1872,freq=3.0), product of:
             0.06201173 = queryWeight, product of:
               1.1252993 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.017313551 = queryNorm
             0.34455636 = fieldWeight in 1872, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.03391857 = weight(abstract_txt:training in 1872) [ClassicSimilarity], result of:
           0.03391857 = score(doc=1872,freq=1.0), product of:
             0.1063211 = queryWeight, product of:
               1.203082 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.017313551 = queryNorm
             0.31902012 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.06980661 = weight(abstract_txt:tasks in 1872) [ClassicSimilarity], result of:
           0.06980661 = score(doc=1872,freq=4.0), product of:
             0.108369105 = queryWeight, product of:
               1.2146139 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.017313551 = queryNorm
             0.64415604 = fieldWeight in 1872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.05862082 = weight(abstract_txt:perform in 1872) [ClassicSimilarity], result of:
           0.05862082 = score(doc=1872,freq=1.0), product of:
             0.15311898 = queryWeight, product of:
               1.4437767 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.017313551 = queryNorm
             0.3828449 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.06079144 = weight(abstract_txt:improvements in 1872) [ClassicSimilarity], result of:
           0.06079144 = score(doc=1872,freq=1.0), product of:
             0.15687583 = queryWeight, product of:
               1.4613813 = boost
               6.2002096 = idf(docFreq=244, maxDocs=44421)
               0.017313551 = queryNorm
             0.3875131 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2002096 = idf(docFreq=244, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.08927502 = weight(abstract_txt:trained in 1872) [ClassicSimilarity], result of:
           0.08927502 = score(doc=1872,freq=1.0), product of:
             0.20268163 = queryWeight, product of:
               1.6610882 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017313551 = queryNorm
             0.4404692 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.10620007 = weight(abstract_txt:supervised in 1872) [ClassicSimilarity], result of:
           0.10620007 = score(doc=1872,freq=1.0), product of:
             0.22755042 = queryWeight, product of:
               1.7600472 = boost
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.017313551 = queryNorm
             0.46671006 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.21896562 = weight(abstract_txt:transformer in 1872) [ClassicSimilarity], result of:
           0.21896562 = score(doc=1872,freq=1.0), product of:
             0.36861956 = queryWeight, product of:
               2.2401376 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.017313551 = queryNorm
             0.5940152 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.13599938 = weight(abstract_txt:language in 1872) [ClassicSimilarity], result of:
           0.13599938 = score(doc=1872,freq=6.0), product of:
             0.21298173 = queryWeight, product of:
               2.9492888 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017313551 = queryNorm
             0.6385495 = fieldWeight in 1872, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
         0.12600872 = weight(abstract_txt:models in 1872) [ClassicSimilarity], result of:
           0.12600872 = score(doc=1872,freq=1.0), product of:
             0.43609875 = queryWeight, product of:
               5.448324 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.017313551 = queryNorm
             0.28894538 = fieldWeight in 1872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=1872)
       0.44 = coord(11/25)
   

2. Radford, A.; Narasimhan, K.; Salimans, T.; Sutskever, I.: Improving language understanding by Generative Pre-Training 0.38

   0.37709904 = sum of:
     0.37709904 = product of:
       0.9427476 = sum of:
         0.017445704 = weight(abstract_txt:these in 1871) [ClassicSimilarity], result of:
           0.017445704 = score(doc=1871,freq=2.0), product of:
             0.06201173 = queryWeight, product of:
               1.1252993 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.017313551 = queryNorm
             0.2813291 = fieldWeight in 1871, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.16066009 = weight(abstract_txt:entailment in 1871) [ClassicSimilarity], result of:
           0.16066009 = score(doc=1871,freq=2.0), product of:
             0.1889063 = queryWeight, product of:
               1.1339495 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.017313551 = queryNorm
             0.850475 = fieldWeight in 1871, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.03391857 = weight(abstract_txt:training in 1871) [ClassicSimilarity], result of:
           0.03391857 = score(doc=1871,freq=1.0), product of:
             0.1063211 = queryWeight, product of:
               1.203082 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.017313551 = queryNorm
             0.31902012 = fieldWeight in 1871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.06980661 = weight(abstract_txt:tasks in 1871) [ClassicSimilarity], result of:
           0.06980661 = score(doc=1871,freq=4.0), product of:
             0.108369105 = queryWeight, product of:
               1.2146139 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.017313551 = queryNorm
             0.64415604 = fieldWeight in 1871, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.05862082 = weight(abstract_txt:perform in 1871) [ClassicSimilarity], result of:
           0.05862082 = score(doc=1871,freq=1.0), product of:
             0.15311898 = queryWeight, product of:
               1.4437767 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.017313551 = queryNorm
             0.3828449 = fieldWeight in 1871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.06079144 = weight(abstract_txt:improvements in 1871) [ClassicSimilarity], result of:
           0.06079144 = score(doc=1871,freq=1.0), product of:
             0.15687583 = queryWeight, product of:
               1.4613813 = boost
               6.2002096 = idf(docFreq=244, maxDocs=44421)
               0.017313551 = queryNorm
             0.3875131 = fieldWeight in 1871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2002096 = idf(docFreq=244, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.12625395 = weight(abstract_txt:trained in 1871) [ClassicSimilarity], result of:
           0.12625395 = score(doc=1871,freq=2.0), product of:
             0.20268163 = queryWeight, product of:
               1.6610882 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017313551 = queryNorm
             0.62291753 = fieldWeight in 1871, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.1408811 = weight(abstract_txt:generative in 1871) [ClassicSimilarity], result of:
           0.1408811 = score(doc=1871,freq=1.0), product of:
             0.2747238 = queryWeight, product of:
               1.9338983 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.017313551 = queryNorm
             0.51281 = fieldWeight in 1871, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.096166074 = weight(abstract_txt:language in 1871) [ClassicSimilarity], result of:
           0.096166074 = score(doc=1871,freq=3.0), product of:
             0.21298173 = queryWeight, product of:
               2.9492888 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017313551 = queryNorm
             0.45152265 = fieldWeight in 1871, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
         0.17820324 = weight(abstract_txt:models in 1871) [ClassicSimilarity], result of:
           0.17820324 = score(doc=1871,freq=2.0), product of:
             0.43609875 = queryWeight, product of:
               5.448324 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.017313551 = queryNorm
             0.40863046 = fieldWeight in 1871, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=1871)
       0.4 = coord(10/25)
   

3. Lund, B.D.: ¬A brief review of ChatGPT : its value and the underlying GPT technology (2023) 0.31

   0.3118104 = sum of:
     0.3118104 = product of:
       0.97440755 = sum of:
         0.11864092 = weight(abstract_txt:openai in 1874) [ClassicSimilarity], result of:
           0.11864092 = score(doc=1874,freq=1.0), product of:
             0.16757174 = queryWeight, product of:
               1.0679991 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.017313551 = queryNorm
             0.7080008 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.043629132 = weight(abstract_txt:tasks in 1874) [ClassicSimilarity], result of:
           0.043629132 = score(doc=1874,freq=1.0), product of:
             0.108369105 = queryWeight, product of:
               1.2146139 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.017313551 = queryNorm
             0.40259752 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.019836228 = weight(abstract_txt:paper in 1874) [ClassicSimilarity], result of:
           0.019836228 = score(doc=1874,freq=1.0), product of:
             0.07334844 = queryWeight, product of:
               1.2238455 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.017313551 = queryNorm
             0.2704383 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.111593775 = weight(abstract_txt:trained in 1874) [ClassicSimilarity], result of:
           0.111593775 = score(doc=1874,freq=1.0), product of:
             0.20268163 = queryWeight, product of:
               1.6610882 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017313551 = queryNorm
             0.5505865 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.13275008 = weight(abstract_txt:supervised in 1874) [ClassicSimilarity], result of:
           0.13275008 = score(doc=1874,freq=1.0), product of:
             0.22755042 = queryWeight, product of:
               1.7600472 = boost
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.017313551 = queryNorm
             0.58338755 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.17610139 = weight(abstract_txt:generative in 1874) [ClassicSimilarity], result of:
           0.17610139 = score(doc=1874,freq=1.0), product of:
             0.2747238 = queryWeight, product of:
               1.9338983 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.017313551 = queryNorm
             0.6410125 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.273707 = weight(abstract_txt:transformer in 1874) [ClassicSimilarity], result of:
           0.273707 = score(doc=1874,freq=1.0), product of:
             0.36861956 = queryWeight, product of:
               2.2401376 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.017313551 = queryNorm
             0.74251896 = fieldWeight in 1874, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
         0.09814909 = weight(abstract_txt:language in 1874) [ClassicSimilarity], result of:
           0.09814909 = score(doc=1874,freq=2.0), product of:
             0.21298173 = queryWeight, product of:
               2.9492888 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017313551 = queryNorm
             0.46083337 = fieldWeight in 1874, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=1874)
       0.32 = coord(8/25)
   

4. Donahue, J.; Hendricks, L.A.; Guadarrama, S.; Rohrbach, M.; Venugopalan, S.; Saenko, K.; Darrell, T.: Long-term recurrent convolutional networks for visual recognition and description (2014) 0.23

   0.22739461 = sum of:
     0.22739461 = product of:
       0.7106082 = sum of:
         0.019478334 = weight(abstract_txt:over in 2873) [ClassicSimilarity], result of:
           0.019478334 = score(doc=2873,freq=1.0), product of:
             0.07345629 = queryWeight, product of:
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.017313551 = queryNorm
             0.26516905 = fieldWeight in 2873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.012335976 = weight(abstract_txt:these in 2873) [ClassicSimilarity], result of:
           0.012335976 = score(doc=2873,freq=1.0), product of:
             0.06201173 = queryWeight, product of:
               1.1252993 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.017313551 = queryNorm
             0.19892971 = fieldWeight in 2873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.02170081 = weight(abstract_txt:have in 2873) [ClassicSimilarity], result of:
           0.02170081 = score(doc=2873,freq=3.0), product of:
             0.06265683 = queryWeight, product of:
               1.1311374 = boost
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.017313551 = queryNorm
             0.3463439 = fieldWeight in 2873, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.03391857 = weight(abstract_txt:training in 2873) [ClassicSimilarity], result of:
           0.03391857 = score(doc=2873,freq=1.0), product of:
             0.1063211 = queryWeight, product of:
               1.203082 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.017313551 = queryNorm
             0.31902012 = fieldWeight in 2873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.060454298 = weight(abstract_txt:tasks in 2873) [ClassicSimilarity], result of:
           0.060454298 = score(doc=2873,freq=3.0), product of:
             0.108369105 = queryWeight, product of:
               1.2146139 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.017313551 = queryNorm
             0.5578555 = fieldWeight in 2873, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.08927502 = weight(abstract_txt:trained in 2873) [ClassicSimilarity], result of:
           0.08927502 = score(doc=2873,freq=1.0), product of:
             0.20268163 = queryWeight, product of:
               1.6610882 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017313551 = queryNorm
             0.4404692 = fieldWeight in 2873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.05552151 = weight(abstract_txt:language in 2873) [ClassicSimilarity], result of:
           0.05552151 = score(doc=2873,freq=1.0), product of:
             0.21298173 = queryWeight, product of:
               2.9492888 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017313551 = queryNorm
             0.26068673 = fieldWeight in 2873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
         0.41792366 = weight(abstract_txt:models in 2873) [ClassicSimilarity], result of:
           0.41792366 = score(doc=2873,freq=11.0), product of:
             0.43609875 = queryWeight, product of:
               5.448324 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.017313551 = queryNorm
             0.9583234 = fieldWeight in 2873, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=2873)
       0.32 = coord(8/25)
   

5. Aydin, Ö.; Karaarslan, E.: OpenAI ChatGPT generated literature review: : digital twin in healthcare (2022) 0.21

   0.21220435 = sum of:
     0.21220435 = product of:
       0.7578727 = sum of:
         0.22510533 = weight(abstract_txt:openai in 1852) [ClassicSimilarity], result of:
           0.22510533 = score(doc=1852,freq=10.0), product of:
             0.16757174 = queryWeight, product of:
               1.0679991 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.017313551 = queryNorm
             1.343337 = fieldWeight in 1852, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.02617748 = weight(abstract_txt:tasks in 1852) [ClassicSimilarity], result of:
           0.02617748 = score(doc=1852,freq=1.0), product of:
             0.108369105 = queryWeight, product of:
               1.2146139 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.017313551 = queryNorm
             0.24155852 = fieldWeight in 1852, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.027620805 = weight(abstract_txt:understand in 1852) [ClassicSimilarity], result of:
           0.027620805 = score(doc=1852,freq=1.0), product of:
             0.112316735 = queryWeight, product of:
               1.2365388 = boost
               5.246269 = idf(docFreq=635, maxDocs=44421)
               0.017313551 = queryNorm
             0.24591887 = fieldWeight in 1852, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.246269 = idf(docFreq=635, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.11597164 = weight(abstract_txt:trained in 1852) [ClassicSimilarity], result of:
           0.11597164 = score(doc=1852,freq=3.0), product of:
             0.20268163 = queryWeight, product of:
               1.6610882 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017313551 = queryNorm
             0.57218623 = fieldWeight in 1852, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.10566083 = weight(abstract_txt:generative in 1852) [ClassicSimilarity], result of:
           0.10566083 = score(doc=1852,freq=1.0), product of:
             0.2747238 = queryWeight, product of:
               1.9338983 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.017313551 = queryNorm
             0.3846075 = fieldWeight in 1852, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.16422422 = weight(abstract_txt:transformer in 1852) [ClassicSimilarity], result of:
           0.16422422 = score(doc=1852,freq=1.0), product of:
             0.36861956 = queryWeight, product of:
               2.2401376 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.017313551 = queryNorm
             0.4455114 = fieldWeight in 1852, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
         0.0931124 = weight(abstract_txt:language in 1852) [ClassicSimilarity], result of:
           0.0931124 = score(doc=1852,freq=5.0), product of:
             0.21298173 = queryWeight, product of:
               2.9492888 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017313551 = queryNorm
             0.43718493 = fieldWeight in 1852, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.046875 = fieldNorm(doc=1852)
       0.28 = coord(7/25)