Document (#41676)

Author

Doval, Y.
Gómez-Rodríguez, C.

Title

Comparing neural- and N-gram-based language models for word segmentation

Source

Journal of the Association for Information Science and Technology. 70(2019) no.2, S.187-197

Year

2019

Abstract

Word segmentation is the task of inserting or deleting word boundary characters in order to separate character sequences that correspond to words in some language. In this article we propose an approach based on a beam search algorithm and a language model working at the byte/character level, the latter component implemented either as an n-gram model or a recurrent neural network. The resulting system analyzes the text input with no word boundaries one token at a time, which can be a character or a byte, and uses the information gathered by the language model to determine if a boundary must be placed in the current position or not. Our aim is to use this system in a preprocessing step for a microtext normalization system. This means that it needs to effectively cope with the data sparsity present on this kind of texts. We also strove to surpass the performance of two readily available word segmentation systems: The well-known and accessible Word Breaker by Microsoft, and the Python module WordSegment by Grant Jenks. The results show that we have met our objectives, and we hope to continue to improve both the precision and the efficiency of our system in the future.

Content

Vgl.: https://onlinelibrary.wiley.com/doi/10.1002/asi.24082.

Theme

Computerlinguistik

Similar documents (author)

1. Cuesta, P.; Gómez, A.M.; Rodríguez, F.J.: Using agents for information retrieval (2003) 4.38

   4.377383 = sum of:
     4.377383 = sum of:
       1.7921447 = weight(author_txt:rodríguez in 3745) [ClassicSimilarity], result of:
         1.7921447 = score(doc=3745,freq=1.0), product of:
           0.61663413 = queryWeight, product of:
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.079563394 = queryNorm
           2.906334 = fieldWeight in 3745, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.375 = fieldNorm(doc=3745)
       2.5852387 = weight(author_txt:gómez in 3745) [ClassicSimilarity], result of:
         2.5852387 = score(doc=3745,freq=1.0), product of:
           0.78724986 = queryWeight, product of:
             1.1299065 = boost
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.079563394 = queryNorm
           3.2838857 = fieldWeight in 3745, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.375 = fieldNorm(doc=3745)
   

2. Vilares, D.; Alonso, M.A.; Gómez-Rodríguez, C.: On the usefulness of lexical and syntactic processing in polarity classification of Twitter messages (2015) 4.38

   4.377383 = sum of:
     4.377383 = sum of:
       1.7921447 = weight(author_txt:rodríguez in 3161) [ClassicSimilarity], result of:
         1.7921447 = score(doc=3161,freq=1.0), product of:
           0.61663413 = queryWeight, product of:
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.079563394 = queryNorm
           2.906334 = fieldWeight in 3161, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.375 = fieldNorm(doc=3161)
       2.5852387 = weight(author_txt:gómez in 3161) [ClassicSimilarity], result of:
         2.5852387 = score(doc=3161,freq=1.0), product of:
           0.78724986 = queryWeight, product of:
             1.1299065 = boost
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.079563394 = queryNorm
           3.2838857 = fieldWeight in 3161, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.375 = fieldNorm(doc=3161)
   

3. Olmeda-Gómez, C.; Perianes-Rodríguez, A.; Ovalle-Perandones, M.A.: Mapas de ciencias multidisciplinares : la biología molecular en la Comunidad de Madrid (2007) 3.65

   3.6478193 = sum of:
     3.6478193 = sum of:
       1.493454 = weight(author_txt:rodríguez in 2120) [ClassicSimilarity], result of:
         1.493454 = score(doc=2120,freq=1.0), product of:
           0.61663413 = queryWeight, product of:
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.079563394 = queryNorm
           2.421945 = fieldWeight in 2120, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.750224 = idf(docFreq=51, maxDocs=44421)
             0.3125 = fieldNorm(doc=2120)
       2.1543653 = weight(author_txt:gómez in 2120) [ClassicSimilarity], result of:
         2.1543653 = score(doc=2120,freq=1.0), product of:
           0.78724986 = queryWeight, product of:
             1.1299065 = boost
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.079563394 = queryNorm
           2.7365713 = fieldWeight in 2120, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.757029 = idf(docFreq=18, maxDocs=44421)
             0.3125 = fieldNorm(doc=2120)
   

4. Gómez Prada, R. Gómez => Gómez Prada, R.: 2.24

   2.2388823 = sum of:
     2.2388823 = product of:
       4.4777646 = sum of:
         4.4777646 = weight(author_txt:gómez in 119) [ClassicSimilarity], result of:
           4.4777646 = score(doc=119,freq=3.0), product of:
             0.78724986 = queryWeight, product of:
               1.1299065 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.079563394 = queryNorm
             5.6878567 = fieldWeight in 119, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.375 = fieldNorm(doc=119)
       0.5 = coord(1/2)
   

5. Gómez, C. Olmeda- -> Olmeda-Gómez, C.: 1.83

   1.8280398 = sum of:
     1.8280398 = product of:
       3.6560795 = sum of:
         3.6560795 = weight(author_txt:gómez in 7446) [ClassicSimilarity], result of:
           3.6560795 = score(doc=7446,freq=2.0), product of:
             0.78724986 = queryWeight, product of:
               1.1299065 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.079563394 = queryNorm
             4.644116 = fieldWeight in 7446, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.375 = fieldNorm(doc=7446)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Kwok, K.L.: Employing multiple representations for Chinese information retrieval (1999) 0.26

   0.26368588 = sum of:
     0.26368588 = product of:
       0.9417353 = sum of:
         0.07337584 = weight(abstract_txt:characters in 4773) [ClassicSimilarity], result of:
           0.07337584 = score(doc=4773,freq=2.0), product of:
             0.11242622 = queryWeight, product of:
               1.0300063 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.014782139 = queryNorm
             0.65265775 = fieldWeight in 4773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.027970731 = weight(abstract_txt:system in 4773) [ClassicSimilarity], result of:
           0.027970731 = score(doc=4773,freq=2.0), product of:
             0.09382562 = queryWeight, product of:
               1.881901 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.014782139 = queryNorm
             0.298114 = fieldWeight in 4773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.12903339 = weight(abstract_txt:gram in 4773) [ClassicSimilarity], result of:
           0.12903339 = score(doc=4773,freq=1.0), product of:
             0.26000813 = queryWeight, product of:
               2.215208 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             0.49626672 = fieldWeight in 4773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.037406184 = weight(abstract_txt:language in 4773) [ClassicSimilarity], result of:
           0.037406184 = score(doc=4773,freq=1.0), product of:
             0.14349094 = queryWeight, product of:
               2.3272781 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014782139 = queryNorm
             0.26068673 = fieldWeight in 4773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.1515244 = weight(abstract_txt:character in 4773) [ClassicSimilarity], result of:
           0.1515244 = score(doc=4773,freq=2.0), product of:
             0.26294264 = queryWeight, product of:
               2.7283318 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.014782139 = queryNorm
             0.5762641 = fieldWeight in 4773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.27372116 = weight(abstract_txt:segmentation in 4773) [ClassicSimilarity], result of:
           0.27372116 = score(doc=4773,freq=2.0), product of:
             0.39001223 = queryWeight, product of:
               3.3228123 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             0.7018271 = fieldWeight in 4773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
         0.24870367 = weight(abstract_txt:word in 4773) [ClassicSimilarity], result of:
           0.24870367 = score(doc=4773,freq=4.0), product of:
             0.36587054 = queryWeight, product of:
               4.5514045 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.014782139 = queryNorm
             0.67975867 = fieldWeight in 4773, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=4773)
       0.28 = coord(7/25)
   

2. Wang, F.L.; Yang, C.C.: Mining Web data for Chinese segmentation (2007) 0.26

   0.25539955 = sum of:
     0.25539955 = product of:
       1.0641649 = sum of:
         0.052749854 = weight(abstract_txt:sequences in 1604) [ClassicSimilarity], result of:
           0.052749854 = score(doc=1604,freq=1.0), product of:
             0.113672756 = queryWeight, product of:
               1.0357007 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.014782139 = queryNorm
             0.46405008 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.0071819224 = weight(abstract_txt:this in 1604) [ClassicSimilarity], result of:
           0.0071819224 = score(doc=1604,freq=1.0), product of:
             0.047755424 = queryWeight, product of:
               1.3426024 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014782139 = queryNorm
             0.15038967 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.06478941 = weight(abstract_txt:language in 1604) [ClassicSimilarity], result of:
           0.06478941 = score(doc=1604,freq=3.0), product of:
             0.14349094 = queryWeight, product of:
               2.3272781 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014782139 = queryNorm
             0.45152265 = fieldWeight in 1604, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.1515244 = weight(abstract_txt:character in 1604) [ClassicSimilarity], result of:
           0.1515244 = score(doc=1604,freq=2.0), product of:
             0.26294264 = queryWeight, product of:
               2.7283318 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.014782139 = queryNorm
             0.5762641 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.6120592 = weight(abstract_txt:segmentation in 1604) [ClassicSimilarity], result of:
           0.6120592 = score(doc=1604,freq=10.0), product of:
             0.39001223 = queryWeight, product of:
               3.3228123 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             1.5693332 = fieldWeight in 1604, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.17586005 = weight(abstract_txt:word in 1604) [ClassicSimilarity], result of:
           0.17586005 = score(doc=1604,freq=2.0), product of:
             0.36587054 = queryWeight, product of:
               4.5514045 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.014782139 = queryNorm
             0.48066196 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
       0.24 = coord(6/25)
   

3. Peng, F.; Huang, X.: Machine learning for Asian language text classification (2007) 0.24

   0.23682316 = sum of:
     0.23682316 = product of:
       0.9867632 = sum of:
         0.010156772 = weight(abstract_txt:this in 1831) [ClassicSimilarity], result of:
           0.010156772 = score(doc=1831,freq=2.0), product of:
             0.047755424 = queryWeight, product of:
               1.3426024 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014782139 = queryNorm
             0.21268311 = fieldWeight in 1831, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
         0.024425734 = weight(abstract_txt:model in 1831) [ClassicSimilarity], result of:
           0.024425734 = score(doc=1831,freq=1.0), product of:
             0.098125316 = queryWeight, product of:
               1.6666992 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.014782139 = queryNorm
             0.24892388 = fieldWeight in 1831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
         0.11657926 = weight(abstract_txt:boundary in 1831) [ClassicSimilarity], result of:
           0.11657926 = score(doc=1831,freq=1.0), product of:
             0.24299635 = queryWeight, product of:
               2.141514 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.014782139 = queryNorm
             0.47975725 = fieldWeight in 1831, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
         0.07481237 = weight(abstract_txt:language in 1831) [ClassicSimilarity], result of:
           0.07481237 = score(doc=1831,freq=4.0), product of:
             0.14349094 = queryWeight, product of:
               2.3272781 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014782139 = queryNorm
             0.52137345 = fieldWeight in 1831, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
         0.5120854 = weight(abstract_txt:segmentation in 1831) [ClassicSimilarity], result of:
           0.5120854 = score(doc=1831,freq=7.0), product of:
             0.39001223 = queryWeight, product of:
               3.3228123 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             1.3129983 = fieldWeight in 1831, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
         0.24870367 = weight(abstract_txt:word in 1831) [ClassicSimilarity], result of:
           0.24870367 = score(doc=1831,freq=4.0), product of:
             0.36587054 = queryWeight, product of:
               4.5514045 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.014782139 = queryNorm
             0.67975867 = fieldWeight in 1831, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=1831)
       0.24 = coord(6/25)
   

4. Lee, K.H.; Ng, M.K.M.; Lu, Q.: Text segmentation for Chinese spell checking (1999) 0.20

   0.20217487 = sum of:
     0.20217487 = product of:
       0.8423953 = sum of:
         0.051884554 = weight(abstract_txt:characters in 4913) [ClassicSimilarity], result of:
           0.051884554 = score(doc=4913,freq=1.0), product of:
             0.11242622 = queryWeight, product of:
               1.0300063 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.014782139 = queryNorm
             0.4614987 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.010156772 = weight(abstract_txt:this in 4913) [ClassicSimilarity], result of:
           0.010156772 = score(doc=4913,freq=2.0), product of:
             0.047755424 = queryWeight, product of:
               1.3426024 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014782139 = queryNorm
             0.21268311 = fieldWeight in 4913, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.037406184 = weight(abstract_txt:language in 4913) [ClassicSimilarity], result of:
           0.037406184 = score(doc=4913,freq=1.0), product of:
             0.14349094 = queryWeight, product of:
               2.3272781 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.014782139 = queryNorm
             0.26068673 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.10714393 = weight(abstract_txt:character in 4913) [ClassicSimilarity], result of:
           0.10714393 = score(doc=4913,freq=1.0), product of:
             0.26294264 = queryWeight, product of:
               2.7283318 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.014782139 = queryNorm
             0.40748024 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.3871002 = weight(abstract_txt:segmentation in 4913) [ClassicSimilarity], result of:
           0.3871002 = score(doc=4913,freq=4.0), product of:
             0.39001223 = queryWeight, product of:
               3.3228123 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             0.99253345 = fieldWeight in 4913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.24870367 = weight(abstract_txt:word in 4913) [ClassicSimilarity], result of:
           0.24870367 = score(doc=4913,freq=4.0), product of:
             0.36587054 = queryWeight, product of:
               4.5514045 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.014782139 = queryNorm
             0.67975867 = fieldWeight in 4913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
       0.24 = coord(6/25)
   

5. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.20

   0.19668393 = sum of:
     0.19668393 = product of:
       0.9834196 = sum of:
         0.051884554 = weight(abstract_txt:characters in 5580) [ClassicSimilarity], result of:
           0.051884554 = score(doc=5580,freq=1.0), product of:
             0.11242622 = queryWeight, product of:
               1.0300063 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.014782139 = queryNorm
             0.4614987 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.010156772 = weight(abstract_txt:this in 5580) [ClassicSimilarity], result of:
           0.010156772 = score(doc=5580,freq=2.0), product of:
             0.047755424 = queryWeight, product of:
               1.3426024 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014782139 = queryNorm
             0.21268311 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.16486797 = weight(abstract_txt:boundary in 5580) [ClassicSimilarity], result of:
           0.16486797 = score(doc=5580,freq=2.0), product of:
             0.24299635 = queryWeight, product of:
               2.141514 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.014782139 = queryNorm
             0.6784792 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.58065027 = weight(abstract_txt:segmentation in 5580) [ClassicSimilarity], result of:
           0.58065027 = score(doc=5580,freq=9.0), product of:
             0.39001223 = queryWeight, product of:
               3.3228123 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.014782139 = queryNorm
             1.4888002 = fieldWeight in 5580, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.17586005 = weight(abstract_txt:word in 5580) [ClassicSimilarity], result of:
           0.17586005 = score(doc=5580,freq=2.0), product of:
             0.36587054 = queryWeight, product of:
               4.5514045 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.014782139 = queryNorm
             0.48066196 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
       0.2 = coord(5/25)