Document (#25247)

Author

Diaz, I.
Morato, J.
Lioréns, J.

Title

¬An algorithm for term conflation based on tree structures

Source

Journal of the American Society for Information Science and technology. 53(2002) no.3, S.199-208

Year

2002

Abstract

This work presents a new stemming algorithm. This algorithm stores the stemming information in tree structures. This storage allows us to enhance the performance of the algorithm due to the reduction of the search space and the overall complexity. The final result of that stemming algorithm is a normalized concept, understanding this process as the automatic extraction of the generic form (or a lexeme) for a selected term.

Theme

Computerlinguistik

Similar documents (author)

1. Diaz, P.: Multilingual tools for accessing a Spanish library catalogue (1997) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:diaz in 2163) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 2163, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=2163)
   

2. Diaz, D.A.V.: Manejo de informacion en el sistema literario (1997) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:diaz in 3255) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 3255, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=3255)
   

3. Diaz, I.: Semi-automatic construction of thesaurus applying domain analysis techniques (1998) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:diaz in 4744) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 4744, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=4744)
   

4. Flynn, D.J.; Diaz, O.F.: Information modelling : an international perspective (1995) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:diaz in 6370) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 6370, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=6370)
   

5. Diaz, I.G.; Aguilar, G.S.: Bibliometria comparada sobre tecnologia de informacion : diez anos en la base de datos ERIC (1995) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:diaz in 6456) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 6456, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=6456)
   

Similar documents (content)

1. Goslin, K.; Hofmann, M.: ¬A Wikipedia powered state-based approach to automatic search query enhancement (2018) 0.21

   0.21057257 = sum of:
     0.21057257 = product of:
       0.7520449 = sum of:
         0.022479296 = weight(abstract_txt:concept in 83) [ClassicSimilarity], result of:
           0.022479296 = score(doc=83,freq=1.0), product of:
             0.06387324 = queryWeight, product of:
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.014178988 = queryNorm
             0.35193604 = fieldWeight in 83, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5047812 = idf(docFreq=1334, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.022694565 = weight(abstract_txt:understanding in 83) [ClassicSimilarity], result of:
           0.022694565 = score(doc=83,freq=1.0), product of:
             0.064280376 = queryWeight, product of:
               1.003182 = boost
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.014178988 = queryNorm
             0.3530559 = fieldWeight in 83, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5191154 = idf(docFreq=1315, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.034489714 = weight(abstract_txt:automatic in 83) [ClassicSimilarity], result of:
           0.034489714 = score(doc=83,freq=1.0), product of:
             0.08496829 = queryWeight, product of:
               1.1533709 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.014178988 = queryNorm
             0.40591276 = fieldWeight in 83, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.035222393 = weight(abstract_txt:selected in 83) [ClassicSimilarity], result of:
           0.035222393 = score(doc=83,freq=1.0), product of:
             0.08616741 = queryWeight, product of:
               1.1614809 = boost
               5.2322173 = idf(docFreq=644, maxDocs=44421)
               0.014178988 = queryNorm
             0.40876698 = fieldWeight in 83, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2322173 = idf(docFreq=644, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.054209996 = weight(abstract_txt:term in 83) [ClassicSimilarity], result of:
           0.054209996 = score(doc=83,freq=1.0), product of:
             0.14471939 = queryWeight, product of:
               2.1287217 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.014178988 = queryNorm
             0.37458694 = fieldWeight in 83, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.023735378 = weight(abstract_txt:this in 83) [ClassicSimilarity], result of:
           0.023735378 = score(doc=83,freq=3.0), product of:
             0.07289664 = queryWeight, product of:
               2.1366053 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014178988 = queryNorm
             0.3256032 = fieldWeight in 83, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
         0.5592136 = weight(abstract_txt:algorithm in 83) [ClassicSimilarity], result of:
           0.5592136 = score(doc=83,freq=6.0), product of:
             0.5122184 = queryWeight, product of:
               6.332178 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.014178988 = queryNorm
             1.0917482 = fieldWeight in 83, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=83)
       0.28 = coord(7/25)
   

2. Ahmad, F.; Yusoff, M.; Sembok, T.M.T.: Experiments with a stemming algorithm for Malay words (1996) 0.18

   0.1770198 = sum of:
     0.1770198 = product of:
       1.1063738 = sum of:
         0.029093824 = weight(abstract_txt:performance in 6572) [ClassicSimilarity], result of:
           0.029093824 = score(doc=6572,freq=1.0), product of:
             0.06717539 = queryWeight, product of:
               1.0255235 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.014178988 = queryNorm
             0.43310243 = fieldWeight in 6572, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.09375 = fieldNorm(doc=6572)
         0.05508014 = weight(abstract_txt:enhance in 6572) [ClassicSimilarity], result of:
           0.05508014 = score(doc=6572,freq=1.0), product of:
             0.10280313 = queryWeight, product of:
               1.2686555 = boost
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.014178988 = queryNorm
             0.5357827 = fieldWeight in 6572, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.09375 = fieldNorm(doc=6572)
         0.6347653 = weight(abstract_txt:stemming in 6572) [ClassicSimilarity], result of:
           0.6347653 = score(doc=6572,freq=3.0), product of:
             0.5245076 = queryWeight, product of:
               4.9633746 = boost
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.014178988 = queryNorm
             1.2102119 = fieldWeight in 6572, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.09375 = fieldNorm(doc=6572)
         0.38743448 = weight(abstract_txt:algorithm in 6572) [ClassicSimilarity], result of:
           0.38743448 = score(doc=6572,freq=2.0), product of:
             0.5122184 = queryWeight, product of:
               6.332178 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.014178988 = queryNorm
             0.7563853 = fieldWeight in 6572, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.09375 = fieldNorm(doc=6572)
       0.16 = coord(4/25)
   

3. Khoo, C.S.G.; Wan, K.-W.: ¬A simple relevancy-ranking strategy for an interface to Boolean OPACs (2004) 0.16

   0.1606378 = sum of:
     0.1606378 = product of:
       1.0039862 = sum of:
         0.040355004 = weight(abstract_txt:overall in 3509) [ClassicSimilarity], result of:
           0.040355004 = score(doc=3509,freq=1.0), product of:
             0.09434714 = queryWeight, product of:
               1.2153599 = boost
               5.474931 = idf(docFreq=505, maxDocs=44421)
               0.014178988 = queryNorm
             0.42772895 = fieldWeight in 3509, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.474931 = idf(docFreq=505, maxDocs=44421)
               0.078125 = fieldNorm(doc=3509)
         0.054209996 = weight(abstract_txt:term in 3509) [ClassicSimilarity], result of:
           0.054209996 = score(doc=3509,freq=1.0), product of:
             0.14471939 = queryWeight, product of:
               2.1287217 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.014178988 = queryNorm
             0.37458694 = fieldWeight in 3509, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.078125 = fieldNorm(doc=3509)
         0.3054016 = weight(abstract_txt:stemming in 3509) [ClassicSimilarity], result of:
           0.3054016 = score(doc=3509,freq=1.0), product of:
             0.5245076 = queryWeight, product of:
               4.9633746 = boost
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.014178988 = queryNorm
             0.58226347 = fieldWeight in 3509, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.078125 = fieldNorm(doc=3509)
         0.60401964 = weight(abstract_txt:algorithm in 3509) [ClassicSimilarity], result of:
           0.60401964 = score(doc=3509,freq=7.0), product of:
             0.5122184 = queryWeight, product of:
               6.332178 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.014178988 = queryNorm
             1.1792228 = fieldWeight in 3509, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=3509)
       0.16 = coord(4/25)
   

4. Greengrass, M.: Conflation methods for searching databases of Latin text (1996) 0.15

   0.15341227 = sum of:
     0.15341227 = product of:
       0.95882666 = sum of:
         0.2533351 = weight(abstract_txt:conflation in 56) [ClassicSimilarity], result of:
           0.2533351 = score(doc=56,freq=1.0), product of:
             0.28431943 = queryWeight, product of:
               2.1098123 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.014178988 = queryNorm
             0.8910228 = fieldWeight in 56, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.09375 = fieldNorm(doc=56)
         0.065051995 = weight(abstract_txt:term in 56) [ClassicSimilarity], result of:
           0.065051995 = score(doc=56,freq=1.0), product of:
             0.14471939 = queryWeight, product of:
               2.1287217 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.014178988 = queryNorm
             0.44950435 = fieldWeight in 56, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.09375 = fieldNorm(doc=56)
         0.36648193 = weight(abstract_txt:stemming in 56) [ClassicSimilarity], result of:
           0.36648193 = score(doc=56,freq=1.0), product of:
             0.5245076 = queryWeight, product of:
               4.9633746 = boost
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.014178988 = queryNorm
             0.69871616 = fieldWeight in 56, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.09375 = fieldNorm(doc=56)
         0.27395758 = weight(abstract_txt:algorithm in 56) [ClassicSimilarity], result of:
           0.27395758 = score(doc=56,freq=1.0), product of:
             0.5122184 = queryWeight, product of:
               6.332178 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.014178988 = queryNorm
             0.53484523 = fieldWeight in 56, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.09375 = fieldNorm(doc=56)
       0.16 = coord(4/25)
   

5. Tseng, Y.-H.; Lin, C.-J.; Lin, Y.-I.: Text mining techniques for patent analysis (2007) 0.15

   0.15125781 = sum of:
     0.15125781 = product of:
       0.47268066 = sum of:
         0.026015818 = weight(abstract_txt:result in 1935) [ClassicSimilarity], result of:
           0.026015818 = score(doc=1935,freq=1.0), product of:
             0.08170127 = queryWeight, product of:
               1.13098 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.014178988 = queryNorm
             0.3184261 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.039020658 = weight(abstract_txt:automatic in 1935) [ClassicSimilarity], result of:
           0.039020658 = score(doc=1935,freq=2.0), product of:
             0.08496829 = queryWeight, product of:
               1.1533709 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.014178988 = queryNorm
             0.45923787 = fieldWeight in 1935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.066050485 = weight(abstract_txt:extraction in 1935) [ClassicSimilarity], result of:
           0.066050485 = score(doc=1935,freq=2.0), product of:
             0.12068257 = queryWeight, product of:
               1.3745571 = boost
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.014178988 = queryNorm
             0.5473076 = fieldWeight in 1935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.04843793 = weight(abstract_txt:final in 1935) [ClassicSimilarity], result of:
           0.04843793 = score(doc=1935,freq=1.0), product of:
             0.12365002 = queryWeight, product of:
               1.391354 = boost
               6.2677455 = idf(docFreq=228, maxDocs=44421)
               0.014178988 = queryNorm
             0.3917341 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2677455 = idf(docFreq=228, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.05164551 = weight(abstract_txt:generic in 1935) [ClassicSimilarity], result of:
           0.05164551 = score(doc=1935,freq=1.0), product of:
             0.12905025 = queryWeight, product of:
               1.421412 = boost
               6.40315 = idf(docFreq=199, maxDocs=44421)
               0.014178988 = queryNorm
             0.40019688 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.40315 = idf(docFreq=199, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.043367997 = weight(abstract_txt:term in 1935) [ClassicSimilarity], result of:
           0.043367997 = score(doc=1935,freq=1.0), product of:
             0.14471939 = queryWeight, product of:
               2.1287217 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.014178988 = queryNorm
             0.29966956 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.015503883 = weight(abstract_txt:this in 1935) [ClassicSimilarity], result of:
           0.015503883 = score(doc=1935,freq=2.0), product of:
             0.07289664 = queryWeight, product of:
               2.1366053 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014178988 = queryNorm
             0.21268311 = fieldWeight in 1935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.18263838 = weight(abstract_txt:algorithm in 1935) [ClassicSimilarity], result of:
           0.18263838 = score(doc=1935,freq=1.0), product of:
             0.5122184 = queryWeight, product of:
               6.332178 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.014178988 = queryNorm
             0.35656348 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
       0.32 = coord(8/25)