Document (#6681)

Editor

Thomas, D.W.

Author

Driscoll, J.R.
Rajala, D.A.
Shaffer, W.H.

Title

¬The operation and performance of an artificially intelligent keywording system

Source

Information processing and management. 27(1991) no.1, S.43-54

Year

1991

Abstract

Presents a new approach to text analysis for automating the key phrase indexing process, using artificial intelligence techniques. This mimics the behaviour of human experts by using a rule base consisting of insertion and deletion rules generated by subject-matter experts. The insertion rules are based on the idea that some phrases found in a text imply or trigger other phrases. The deletion rules apply to semantically ambiguous phrases where text presence alone does not determine appropriateness as a key phrase. The insertion and deletion rules are used to transform a list of found phrases to a list of key phrases for indexing a document. Statistical data are provided to demonstrate the performance of this expert rule based system

Theme

Automatisches Indexieren
Computerlinguistik

Similar documents (content)

1. Vlachidis, A.; Tudhope, D.: ¬A knowledge-based approach to information extraction for semantic interoperability in the archaeology domain (2016) 0.21

   0.21121255 = sum of:
     0.21121255 = product of:
       0.5867015 = sum of:
         0.009334912 = weight(abstract_txt:system in 3895) [ClassicSimilarity], result of:
           0.009334912 = score(doc=3895,freq=1.0), product of:
             0.04428359 = queryWeight, product of:
               1.0319533 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.012723172 = queryNorm
             0.21079844 = fieldWeight in 3895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.017408373 = weight(abstract_txt:using in 3895) [ClassicSimilarity], result of:
           0.017408373 = score(doc=3895,freq=3.0), product of:
             0.04651943 = queryWeight, product of:
               1.0576837 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.012723172 = queryNorm
             0.37421724 = fieldWeight in 3895, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.028328493 = weight(abstract_txt:indexing in 3895) [ClassicSimilarity], result of:
           0.028328493 = score(doc=3895,freq=2.0), product of:
             0.073672995 = queryWeight, product of:
               1.3310452 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.012723172 = queryNorm
             0.38451666 = fieldWeight in 3895, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.023988666 = weight(abstract_txt:performance in 3895) [ClassicSimilarity], result of:
           0.023988666 = score(doc=3895,freq=1.0), product of:
             0.08308196 = queryWeight, product of:
               1.4134876 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.012723172 = queryNorm
             0.28873494 = fieldWeight in 3895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.024080632 = weight(abstract_txt:text in 3895) [ClassicSimilarity], result of:
           0.024080632 = score(doc=3895,freq=1.0), product of:
             0.09534802 = queryWeight, product of:
               1.8545567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.012723172 = queryNorm
             0.25255513 = fieldWeight in 3895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.09982735 = weight(abstract_txt:rule in 3895) [ClassicSimilarity], result of:
           0.09982735 = score(doc=3895,freq=2.0), product of:
             0.17060524 = queryWeight, product of:
               2.025512 = boost
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.012723172 = queryNorm
             0.5851365 = fieldWeight in 3895, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.08731472 = weight(abstract_txt:phrase in 3895) [ClassicSimilarity], result of:
           0.08731472 = score(doc=3895,freq=1.0), product of:
             0.1965898 = queryWeight, product of:
               2.1742983 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.012723172 = queryNorm
             0.44414672 = fieldWeight in 3895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.098923296 = weight(abstract_txt:rules in 3895) [ClassicSimilarity], result of:
           0.098923296 = score(doc=3895,freq=2.0), product of:
             0.21364942 = queryWeight, product of:
               3.2055643 = boost
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.012723172 = queryNorm
             0.4630169 = fieldWeight in 3895, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
         0.19749507 = weight(abstract_txt:phrases in 3895) [ClassicSimilarity], result of:
           0.19749507 = score(doc=3895,freq=1.0), product of:
             0.45974836 = queryWeight, product of:
               5.2573724 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012723172 = queryNorm
             0.4295721 = fieldWeight in 3895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3895)
       0.36 = coord(9/25)
   

2. Craven, T.C.: Adapting of string indexing systems for retrieval using proximity operators (1988) 0.17

   0.16698514 = sum of:
     0.16698514 = product of:
       0.83492565 = sum of:
         0.016336095 = weight(abstract_txt:system in 704) [ClassicSimilarity], result of:
           0.016336095 = score(doc=704,freq=1.0), product of:
             0.04428359 = queryWeight, product of:
               1.0319533 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.012723172 = queryNorm
             0.36889726 = fieldWeight in 704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.109375 = fieldNorm(doc=704)
         0.017588774 = weight(abstract_txt:using in 704) [ClassicSimilarity], result of:
           0.017588774 = score(doc=704,freq=1.0), product of:
             0.04651943 = queryWeight, product of:
               1.0576837 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.012723172 = queryNorm
             0.37809524 = fieldWeight in 704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.109375 = fieldNorm(doc=704)
         0.049574863 = weight(abstract_txt:indexing in 704) [ClassicSimilarity], result of:
           0.049574863 = score(doc=704,freq=2.0), product of:
             0.073672995 = queryWeight, product of:
               1.3310452 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.012723172 = queryNorm
             0.67290413 = fieldWeight in 704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.109375 = fieldNorm(doc=704)
         0.15280075 = weight(abstract_txt:phrase in 704) [ClassicSimilarity], result of:
           0.15280075 = score(doc=704,freq=1.0), product of:
             0.1965898 = queryWeight, product of:
               2.1742983 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.012723172 = queryNorm
             0.7772568 = fieldWeight in 704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.109375 = fieldNorm(doc=704)
         0.5986252 = weight(abstract_txt:phrases in 704) [ClassicSimilarity], result of:
           0.5986252 = score(doc=704,freq=3.0), product of:
             0.45974836 = queryWeight, product of:
               5.2573724 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012723172 = queryNorm
             1.3020713 = fieldWeight in 704, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.109375 = fieldNorm(doc=704)
       0.2 = coord(5/25)
   

3. Losee, R.: ¬A performance model of the length and number of subject headings and index phrases (2004) 0.16

   0.1627012 = sum of:
     0.1627012 = product of:
       0.813506 = sum of:
         0.035410617 = weight(abstract_txt:indexing in 4725) [ClassicSimilarity], result of:
           0.035410617 = score(doc=4725,freq=2.0), product of:
             0.073672995 = queryWeight, product of:
               1.3310452 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.012723172 = queryNorm
             0.48064584 = fieldWeight in 4725, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=4725)
         0.042568944 = weight(abstract_txt:text in 4725) [ClassicSimilarity], result of:
           0.042568944 = score(doc=4725,freq=2.0), product of:
             0.09534802 = queryWeight, product of:
               1.8545567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.012723172 = queryNorm
             0.4464586 = fieldWeight in 4725, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=4725)
         0.15435207 = weight(abstract_txt:phrase in 4725) [ClassicSimilarity], result of:
           0.15435207 = score(doc=4725,freq=2.0), product of:
             0.1965898 = queryWeight, product of:
               2.1742983 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.012723172 = queryNorm
             0.7851479 = fieldWeight in 4725, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.078125 = fieldNorm(doc=4725)
         0.08743666 = weight(abstract_txt:rules in 4725) [ClassicSimilarity], result of:
           0.08743666 = score(doc=4725,freq=1.0), product of:
             0.21364942 = queryWeight, product of:
               3.2055643 = boost
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.012723172 = queryNorm
             0.40925297 = fieldWeight in 4725, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.078125 = fieldNorm(doc=4725)
         0.49373767 = weight(abstract_txt:phrases in 4725) [ClassicSimilarity], result of:
           0.49373767 = score(doc=4725,freq=4.0), product of:
             0.45974836 = queryWeight, product of:
               5.2573724 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012723172 = queryNorm
             1.0739303 = fieldWeight in 4725, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=4725)
       0.2 = coord(5/25)
   

4. Fagan, J.L.: ¬The effectiveness of a nonsyntactic approach to automatic phrase indexing for document retrieval (1989) 0.16

   0.1593852 = sum of:
     0.1593852 = product of:
       0.66410506 = sum of:
         0.010050728 = weight(abstract_txt:using in 2845) [ClassicSimilarity], result of:
           0.010050728 = score(doc=2845,freq=1.0), product of:
             0.04651943 = queryWeight, product of:
               1.0576837 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.012723172 = queryNorm
             0.21605442 = fieldWeight in 2845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
         0.04006254 = weight(abstract_txt:indexing in 2845) [ClassicSimilarity], result of:
           0.04006254 = score(doc=2845,freq=4.0), product of:
             0.073672995 = queryWeight, product of:
               1.3310452 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.012723172 = queryNorm
             0.5437887 = fieldWeight in 2845, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
         0.023988666 = weight(abstract_txt:performance in 2845) [ClassicSimilarity], result of:
           0.023988666 = score(doc=2845,freq=1.0), product of:
             0.08308196 = queryWeight, product of:
               1.4134876 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.012723172 = queryNorm
             0.28873494 = fieldWeight in 2845, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
         0.034055155 = weight(abstract_txt:text in 2845) [ClassicSimilarity], result of:
           0.034055155 = score(doc=2845,freq=2.0), product of:
             0.09534802 = queryWeight, product of:
               1.8545567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.012723172 = queryNorm
             0.3571669 = fieldWeight in 2845, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
         0.2138765 = weight(abstract_txt:phrase in 2845) [ClassicSimilarity], result of:
           0.2138765 = score(doc=2845,freq=6.0), product of:
             0.1965898 = queryWeight, product of:
               2.1742983 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.012723172 = queryNorm
             1.0879328 = fieldWeight in 2845, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
         0.3420715 = weight(abstract_txt:phrases in 2845) [ClassicSimilarity], result of:
           0.3420715 = score(doc=2845,freq=3.0), product of:
             0.45974836 = queryWeight, product of:
               5.2573724 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012723172 = queryNorm
             0.7440407 = fieldWeight in 2845, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2845)
       0.24 = coord(6/25)
   

5. Frohmann, B.: Rules of indexing : a critique of mentalism in information retrieval theory (1990) 0.13

   0.13109568 = sum of:
     0.13109568 = product of:
       0.546232 = sum of:
         0.05096609 = weight(abstract_txt:operation in 3907) [ClassicSimilarity], result of:
           0.05096609 = score(doc=3907,freq=1.0), product of:
             0.08316732 = queryWeight, product of:
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.012723172 = queryNorm
             0.6128139 = fieldWeight in 3907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
         0.030046904 = weight(abstract_txt:indexing in 3907) [ClassicSimilarity], result of:
           0.030046904 = score(doc=3907,freq=1.0), product of:
             0.073672995 = queryWeight, product of:
               1.3310452 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.012723172 = queryNorm
             0.4078415 = fieldWeight in 3907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
         0.036120947 = weight(abstract_txt:text in 3907) [ClassicSimilarity], result of:
           0.036120947 = score(doc=3907,freq=1.0), product of:
             0.09534802 = queryWeight, product of:
               1.8545567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.012723172 = queryNorm
             0.3788327 = fieldWeight in 3907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
         0.14974102 = weight(abstract_txt:rule in 3907) [ClassicSimilarity], result of:
           0.14974102 = score(doc=3907,freq=2.0), product of:
             0.17060524 = queryWeight, product of:
               2.025512 = boost
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.012723172 = queryNorm
             0.87770474 = fieldWeight in 3907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6200633 = idf(docFreq=160, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
         0.13097207 = weight(abstract_txt:phrase in 3907) [ClassicSimilarity], result of:
           0.13097207 = score(doc=3907,freq=1.0), product of:
             0.1965898 = queryWeight, product of:
               2.1742983 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.012723172 = queryNorm
             0.66622007 = fieldWeight in 3907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
         0.14838494 = weight(abstract_txt:rules in 3907) [ClassicSimilarity], result of:
           0.14838494 = score(doc=3907,freq=2.0), product of:
             0.21364942 = queryWeight, product of:
               3.2055643 = boost
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.012723172 = queryNorm
             0.69452536 = fieldWeight in 3907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.09375 = fieldNorm(doc=3907)
       0.24 = coord(6/25)