Document (#44174)

Author

Luo, L.
Ju, J.
Li, Y.-F.
Haffari, G.
Xiong, B.
Pan, S.

Title

ChatRule: mining logical rules with large language models for knowledge graph reasoning

Source

https://www.researchgate.net/publication/373685576_ChatRule_Mining_Logical_Rules_with_Large_Language_Models_for_Knowledge_Graph_Reasoning

Year

2023

Abstract

Logical rules are essential for uncovering the logical connections between relations, which could improve the reasoning performance and provide interpretable results on knowledge graphs (KGs). Although there have been many efforts to mine meaningful logical rules over KGs, existing methods suffer from the computationally intensive searches over the rule space and a lack of scalability for large-scale KGs. Besides, they often ignore the semantics of relations which is crucial for uncovering logical connections. Recently, large language models (LLMs) have shown impressive performance in the field of natural language processing and various applications, owing to their emergent ability and generalizability. In this paper, we propose a novel framework, ChatRule, unleashing the power of large language models for mining logical rules over knowledge graphs. Specifically, the framework is initiated with an LLM-based rule generator, leveraging both the semantic and structural information of KGs to prompt LLMs to generate logical rules. To refine the generated rules, a rule ranking module estimates the rule quality by incorporating facts from existing KGs. Last, a rule validator harnesses the reasoning ability of LLMs to validate the logical correctness of ranked rules through chain-of-thought reasoning. ChatRule is evaluated on four large-scale KGs, w.r.t. different rule quality metrics and downstream tasks, showing the effectiveness and scalability of our method.

Theme

Computerlinguistik

Object

ChatRule

Similar documents (author)

1. Xiong, L.J.: On the compiling of cataloguing rules for Chinese document(s) (1997) 6.10

   6.0972233 = sum of:
     6.0972233 = weight(author_txt:xiong in 4199) [ClassicSimilarity], result of:
       6.0972233 = fieldWeight in 4199, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.625 = fieldNorm(doc=4199)
   

2. Xiong, C.: Knowledge based text representations for information retrieval (2016) 6.10

   6.0972233 = sum of:
     6.0972233 = weight(author_txt:xiong in 820) [ClassicSimilarity], result of:
       6.0972233 = fieldWeight in 820, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.625 = fieldNorm(doc=820)
   

3. Xiong, S.; Ji, D.: Query-focused multi-document summarization using hypergraph-based ranking (2016) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:xiong in 3972) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 3972, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=3972)
   

4. Li, W.; Xiong, B.; Yang, C.: ¬A roadmap to achieving a healthier information ecosystem through GDPR implementation and privacy compliance technologies (2024) 3.66

   3.6583338 = sum of:
     3.6583338 = weight(author_txt:xiong in 2365) [ClassicSimilarity], result of:
       3.6583338 = fieldWeight in 2365, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.375 = fieldNorm(doc=2365)
   

5. Zeng, Q.; Yu, M.; Yu, W.; Xiong, J.; Shi, Y.; Jiang, M.: Faceted hierarchy : a new graph type to organize scientific concepts and a construction method (2019) 2.44

   2.4388893 = sum of:
     2.4388893 = weight(author_txt:xiong in 1401) [ClassicSimilarity], result of:
       2.4388893 = fieldWeight in 1401, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.25 = fieldNorm(doc=1401)
   

Similar documents (content)

1. Yang, L.; Chen, H.; Li, Z.; Ding, X.; Wu, X.: Give us the facts : enhancing Large Language Models with knowledge graphs for fact-aware language modeling (2024) 0.36

   0.35912454 = sum of:
     0.35912454 = product of:
       0.89781135 = sum of:
         0.019287717 = weight(abstract_txt:performance in 2337) [ClassicSimilarity], result of:
           0.019287717 = score(doc=2337,freq=1.0), product of:
             0.06680077 = queryWeight, product of:
               1.0273645 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0140746515 = queryNorm
             0.28873494 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.027685499 = weight(abstract_txt:existing in 2337) [ClassicSimilarity], result of:
           0.027685499 = score(doc=2337,freq=2.0), product of:
             0.06746614 = queryWeight, product of:
               1.0324683 = boost
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0140746515 = queryNorm
             0.41036138 = fieldWeight in 2337, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.037018567 = weight(abstract_txt:knowledge in 2337) [ClassicSimilarity], result of:
           0.037018567 = score(doc=2337,freq=8.0), product of:
             0.059048355 = queryWeight, product of:
               1.1829962 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0140746515 = queryNorm
             0.62691957 = fieldWeight in 2337, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.033652566 = weight(abstract_txt:ability in 2337) [ClassicSimilarity], result of:
           0.033652566 = score(doc=2337,freq=1.0), product of:
             0.09681435 = queryWeight, product of:
               1.2368119 = boost
               5.561583 = idf(docFreq=463, maxDocs=44421)
               0.0140746515 = queryNorm
             0.34759894 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.561583 = idf(docFreq=463, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.05022061 = weight(abstract_txt:models in 2337) [ClassicSimilarity], result of:
           0.05022061 = score(doc=2337,freq=3.0), product of:
             0.10034728 = queryWeight, product of:
               1.5421699 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0140746515 = queryNorm
             0.5004681 = fieldWeight in 2337, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.06932302 = weight(abstract_txt:graphs in 2337) [ClassicSimilarity], result of:
           0.06932302 = score(doc=2337,freq=1.0), product of:
             0.15673979 = queryWeight, product of:
               1.5737053 = boost
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0140746515 = queryNorm
             0.44228092 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.063482575 = weight(abstract_txt:language in 2337) [ClassicSimilarity], result of:
           0.063482575 = score(doc=2337,freq=5.0), product of:
             0.10890571 = queryWeight, product of:
               1.855129 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0140746515 = queryNorm
             0.5829132 = fieldWeight in 2337, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.060634058 = weight(abstract_txt:large in 2337) [ClassicSimilarity], result of:
           0.060634058 = score(doc=2337,freq=2.0), product of:
             0.15442184 = queryWeight, product of:
               2.4697795 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0140746515 = queryNorm
             0.3926521 = fieldWeight in 2337, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.09971414 = weight(abstract_txt:reasoning in 2337) [ClassicSimilarity], result of:
           0.09971414 = score(doc=2337,freq=1.0), product of:
             0.25163755 = queryWeight, product of:
               2.8199182 = boost
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0140746515 = queryNorm
             0.39626098 = fieldWeight in 2337, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
         0.43679264 = weight(abstract_txt:llms in 2337) [ClassicSimilarity], result of:
           0.43679264 = score(doc=2337,freq=4.0), product of:
             0.3855863 = queryWeight, product of:
               3.0230143 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             1.1328013 = fieldWeight in 2337, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=2337)
       0.4 = coord(10/25)
   

2. Hou, Y.; Pascale, A.; Carnerero-Cano, J.; Sattigeri, P.; Tchrakian, T.; Marinescu, R.; Daly, E.; Padhi, I.: WikiContradict : a benchmark for evaluating LLMs on real-world knowledge conflicts from Wikipedia (2024) 0.27

   0.27210695 = sum of:
     0.27210695 = product of:
       0.7558526 = sum of:
         0.023867331 = weight(abstract_txt:performance in 2368) [ClassicSimilarity], result of:
           0.023867331 = score(doc=2368,freq=2.0), product of:
             0.06680077 = queryWeight, product of:
               1.0273645 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0140746515 = queryNorm
             0.35729125 = fieldWeight in 2368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.024251767 = weight(abstract_txt:quality in 2368) [ClassicSimilarity], result of:
           0.024251767 = score(doc=2368,freq=2.0), product of:
             0.06751618 = queryWeight, product of:
               1.0328511 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0140746515 = queryNorm
             0.35919935 = fieldWeight in 2368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.016195623 = weight(abstract_txt:knowledge in 2368) [ClassicSimilarity], result of:
           0.016195623 = score(doc=2368,freq=2.0), product of:
             0.059048355 = queryWeight, product of:
               1.1829962 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0140746515 = queryNorm
             0.2742773 = fieldWeight in 2368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.019608786 = weight(abstract_txt:over in 2368) [ClassicSimilarity], result of:
           0.019608786 = score(doc=2368,freq=1.0), product of:
             0.08451228 = queryWeight, product of:
               1.4152701 = boost
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0140746515 = queryNorm
             0.23202293 = fieldWeight in 2368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.043943036 = weight(abstract_txt:models in 2368) [ClassicSimilarity], result of:
           0.043943036 = score(doc=2368,freq=3.0), product of:
             0.10034728 = queryWeight, product of:
               1.5421699 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0140746515 = queryNorm
             0.43790957 = fieldWeight in 2368, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.03513117 = weight(abstract_txt:language in 2368) [ClassicSimilarity], result of:
           0.03513117 = score(doc=2368,freq=2.0), product of:
             0.10890571 = queryWeight, product of:
               1.855129 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0140746515 = queryNorm
             0.32258338 = fieldWeight in 2368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.03751541 = weight(abstract_txt:large in 2368) [ClassicSimilarity], result of:
           0.03751541 = score(doc=2368,freq=1.0), product of:
             0.15442184 = queryWeight, product of:
               2.4697795 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0140746515 = queryNorm
             0.24294108 = fieldWeight in 2368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.087249875 = weight(abstract_txt:reasoning in 2368) [ClassicSimilarity], result of:
           0.087249875 = score(doc=2368,freq=1.0), product of:
             0.25163755 = queryWeight, product of:
               2.8199182 = boost
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0140746515 = queryNorm
             0.34672835 = fieldWeight in 2368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
         0.4680896 = weight(abstract_txt:llms in 2368) [ClassicSimilarity], result of:
           0.4680896 = score(doc=2368,freq=6.0), product of:
             0.3855863 = queryWeight, product of:
               3.0230143 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             1.2139685 = fieldWeight in 2368, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2368)
       0.36 = coord(9/25)
   

3. Khorashadizadeh, H.; Amara, F.Z.; Ezzabady, M.; Ieng, F.; Tiwari, S.; Mihindukulasooriya, N.; Groppe, J.; Sahri, S.; Benamara, F.; Groppe, S.: Research trends for the interplay between Large Language Models and Knowledge Graphs (2024) 0.26

   0.2589863 = sum of:
     0.2589863 = product of:
       0.9249511 = sum of:
         0.016360052 = weight(abstract_txt:knowledge in 2335) [ClassicSimilarity], result of:
           0.016360052 = score(doc=2335,freq=1.0), product of:
             0.059048355 = queryWeight, product of:
               1.1829962 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0140746515 = queryNorm
             0.27706194 = fieldWeight in 2335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.036243606 = weight(abstract_txt:models in 2335) [ClassicSimilarity], result of:
           0.036243606 = score(doc=2335,freq=1.0), product of:
             0.10034728 = queryWeight, product of:
               1.5421699 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0140746515 = queryNorm
             0.36118174 = fieldWeight in 2335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.08665377 = weight(abstract_txt:graphs in 2335) [ClassicSimilarity], result of:
           0.08665377 = score(doc=2335,freq=1.0), product of:
             0.15673979 = queryWeight, product of:
               1.5737053 = boost
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0140746515 = queryNorm
             0.55285114 = fieldWeight in 2335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.061466742 = weight(abstract_txt:language in 2335) [ClassicSimilarity], result of:
           0.061466742 = score(doc=2335,freq=3.0), product of:
             0.10890571 = queryWeight, product of:
               1.855129 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0140746515 = queryNorm
             0.5644033 = fieldWeight in 2335, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.053593446 = weight(abstract_txt:large in 2335) [ClassicSimilarity], result of:
           0.053593446 = score(doc=2335,freq=1.0), product of:
             0.15442184 = queryWeight, product of:
               2.4697795 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0140746515 = queryNorm
             0.3470587 = fieldWeight in 2335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.12464268 = weight(abstract_txt:reasoning in 2335) [ClassicSimilarity], result of:
           0.12464268 = score(doc=2335,freq=1.0), product of:
             0.25163755 = queryWeight, product of:
               2.8199182 = boost
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0140746515 = queryNorm
             0.49532622 = fieldWeight in 2335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
         0.54599077 = weight(abstract_txt:llms in 2335) [ClassicSimilarity], result of:
           0.54599077 = score(doc=2335,freq=4.0), product of:
             0.3855863 = queryWeight, product of:
               3.0230143 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             1.4160016 = fieldWeight in 2335, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=2335)
       0.28 = coord(7/25)
   

4. Kau, A.; He, X.; Nambissan, A.; Astudillo, A.; Yin, H.; Aryani, A.: Combining graphs and Large Language Models (2024) 0.26

   0.25757033 = sum of:
     0.25757033 = product of:
       0.80490726 = sum of:
         0.07279877 = weight(abstract_txt:interpretable in 2336) [ClassicSimilarity], result of:
           0.07279877 = score(doc=2336,freq=1.0), product of:
             0.12852876 = queryWeight, product of:
               1.0076715 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             0.56640065 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.02727695 = weight(abstract_txt:performance in 2336) [ClassicSimilarity], result of:
           0.02727695 = score(doc=2336,freq=2.0), product of:
             0.06680077 = queryWeight, product of:
               1.0273645 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0140746515 = queryNorm
             0.40833285 = fieldWeight in 2336, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.018509284 = weight(abstract_txt:knowledge in 2336) [ClassicSimilarity], result of:
           0.018509284 = score(doc=2336,freq=2.0), product of:
             0.059048355 = queryWeight, product of:
               1.1829962 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0140746515 = queryNorm
             0.31345978 = fieldWeight in 2336, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.028994882 = weight(abstract_txt:models in 2336) [ClassicSimilarity], result of:
           0.028994882 = score(doc=2336,freq=1.0), product of:
             0.10034728 = queryWeight, product of:
               1.5421699 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0140746515 = queryNorm
             0.28894538 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.06932302 = weight(abstract_txt:graphs in 2336) [ClassicSimilarity], result of:
           0.06932302 = score(doc=2336,freq=1.0), product of:
             0.15673979 = queryWeight, product of:
               1.5737053 = boost
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0140746515 = queryNorm
             0.44228092 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.056780547 = weight(abstract_txt:language in 2336) [ClassicSimilarity], result of:
           0.056780547 = score(doc=2336,freq=4.0), product of:
             0.10890571 = queryWeight, product of:
               1.855129 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0140746515 = queryNorm
             0.52137345 = fieldWeight in 2336, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.042874753 = weight(abstract_txt:large in 2336) [ClassicSimilarity], result of:
           0.042874753 = score(doc=2336,freq=1.0), product of:
             0.15442184 = queryWeight, product of:
               2.4697795 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0140746515 = queryNorm
             0.27764696 = fieldWeight in 2336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
         0.48834905 = weight(abstract_txt:llms in 2336) [ClassicSimilarity], result of:
           0.48834905 = score(doc=2336,freq=5.0), product of:
             0.3855863 = queryWeight, product of:
               3.0230143 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             1.2665104 = fieldWeight in 2336, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=2336)
       0.32 = coord(8/25)
   

5. Ghali, M.-K.; Farrag, A.; Won, D.; Jin, Y.: Enhancing knowledge retrieval with in-context learning and semantic search through Generative AI (2024) 0.24

   0.23553808 = sum of:
     0.23553808 = product of:
       0.65427244 = sum of:
         0.016876753 = weight(abstract_txt:performance in 2367) [ClassicSimilarity], result of:
           0.016876753 = score(doc=2367,freq=1.0), product of:
             0.06680077 = queryWeight, product of:
               1.0273645 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0140746515 = queryNorm
             0.25264308 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.01712953 = weight(abstract_txt:existing in 2367) [ClassicSimilarity], result of:
           0.01712953 = score(doc=2367,freq=1.0), product of:
             0.06746614 = queryWeight, product of:
               1.0324683 = boost
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0140746515 = queryNorm
             0.25389817 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6427093 = idf(docFreq=1162, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.011452036 = weight(abstract_txt:knowledge in 2367) [ClassicSimilarity], result of:
           0.011452036 = score(doc=2367,freq=1.0), product of:
             0.059048355 = queryWeight, product of:
               1.1829962 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0140746515 = queryNorm
             0.19394335 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.019608786 = weight(abstract_txt:over in 2367) [ClassicSimilarity], result of:
           0.019608786 = score(doc=2367,freq=1.0), product of:
             0.08451228 = queryWeight, product of:
               1.4152701 = boost
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0140746515 = queryNorm
             0.23202293 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.025370521 = weight(abstract_txt:models in 2367) [ClassicSimilarity], result of:
           0.025370521 = score(doc=2367,freq=1.0), product of:
             0.10034728 = queryWeight, product of:
               1.5421699 = boost
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0140746515 = queryNorm
             0.2528272 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.623126 = idf(docFreq=1185, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.08153145 = weight(abstract_txt:scalability in 2367) [ClassicSimilarity], result of:
           0.08153145 = score(doc=2367,freq=1.0), product of:
             0.1908999 = queryWeight, product of:
               1.7367473 = boost
               7.809647 = idf(docFreq=48, maxDocs=44421)
               0.0140746515 = queryNorm
             0.42709008 = fieldWeight in 2367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.809647 = idf(docFreq=48, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.03513117 = weight(abstract_txt:language in 2367) [ClassicSimilarity], result of:
           0.03513117 = score(doc=2367,freq=2.0), product of:
             0.10890571 = queryWeight, product of:
               1.855129 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0140746515 = queryNorm
             0.32258338 = fieldWeight in 2367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.06497859 = weight(abstract_txt:large in 2367) [ClassicSimilarity], result of:
           0.06497859 = score(doc=2367,freq=3.0), product of:
             0.15442184 = queryWeight, product of:
               2.4697795 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0140746515 = queryNorm
             0.4207863 = fieldWeight in 2367, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
         0.3821936 = weight(abstract_txt:llms in 2367) [ClassicSimilarity], result of:
           0.3821936 = score(doc=2367,freq=4.0), product of:
             0.3855863 = queryWeight, product of:
               3.0230143 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0140746515 = queryNorm
             0.99120116 = fieldWeight in 2367, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2367)
       0.36 = coord(9/25)