Document (#32605)

Author

Wang, F.L.
Yang, C.C.

Title

Mining Web data for Chinese segmentation

Source

Journal of the American Society for Information Science and Technology. 58(2007) no.12, S.1820-1837

Year

2007

Abstract

Modern information retrieval systems use keywords within documents as indexing terms for search of relevant documents. As Chinese is an ideographic character-based language, the words in the texts are not delimited by white spaces. Indexing of Chinese documents is impossible without a proper segmentation algorithm. Many Chinese segmentation algorithms have been proposed in the past. Traditional segmentation algorithms cannot operate without a large dictionary or a large corpus of training data. Nowadays, the Web has become the largest corpus that is ideal for Chinese segmentation. Although most search engines have problems in segmenting texts into proper words, they maintain huge databases of documents and frequencies of character sequences in the documents. Their databases are important potential resources for segmentation. In this paper, we propose a segmentation algorithm by mining Web data with the help of search engines. On the other hand, the Romanized pinyin of Chinese language indicates boundaries of words in the text. Our algorithm is the first to utilize the Romanized pinyin to segmentation. It is the first unified segmentation algorithm for the Chinese language from different geographical areas, and it is also domain independent because of the nature of the Web. Experiments have been conducted on the datasets of a recent Chinese segmentation competition. The results show that our algorithm outperforms the traditional algorithms in terms of precision and recall. Moreover, our algorithm can effectively deal with the problems of segmentation ambiguity, new word (unknown word) detection, and stop words.

Footnote

Beitrag eines Themenschwerpunktes "Mining Web resources for enhancing information retrieval"

Theme

Data Mining
Computerlinguistik

Object

WWW

Similar documents (author)

1. Wang, F.L.; Yang, C.C.: ¬The impact analysis of language differences on an automatic multilingual text summarization system (2006) 4.86

   4.864334 = sum of:
     4.864334 = sum of:
       2.0967865 = weight(author_txt:wang in 5049) [ClassicSimilarity], result of:
         2.0967865 = score(doc=5049,freq=1.0), product of:
           0.6391581 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.097416475 = queryNorm
           3.2805443 = fieldWeight in 5049, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.5 = fieldNorm(doc=5049)
       2.7675476 = weight(author_txt:yang in 5049) [ClassicSimilarity], result of:
         2.7675476 = score(doc=5049,freq=1.0), product of:
           0.7690754 = queryWeight, product of:
             1.0969335 = boost
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.097416475 = queryNorm
           3.5985389 = fieldWeight in 5049, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.5 = fieldNorm(doc=5049)
   

2. Yang, C.C.; Wang, F.L.: Hierarchical summarization of large documents (2008) 4.86

   4.864334 = sum of:
     4.864334 = sum of:
       2.0967865 = weight(author_txt:wang in 1719) [ClassicSimilarity], result of:
         2.0967865 = score(doc=1719,freq=1.0), product of:
           0.6391581 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.097416475 = queryNorm
           3.2805443 = fieldWeight in 1719, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.5 = fieldNorm(doc=1719)
       2.7675476 = weight(author_txt:yang in 1719) [ClassicSimilarity], result of:
         2.7675476 = score(doc=1719,freq=1.0), product of:
           0.7690754 = queryWeight, product of:
             1.0969335 = boost
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.097416475 = queryNorm
           3.5985389 = fieldWeight in 1719, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.5 = fieldNorm(doc=1719)
   

3. Wang, P.; Berry, M.W.; Yang, Y.: Mining longitudinal Web queries : trends and patterns (2003) 3.65

   3.6482506 = sum of:
     3.6482506 = sum of:
       1.5725899 = weight(author_txt:wang in 6561) [ClassicSimilarity], result of:
         1.5725899 = score(doc=6561,freq=1.0), product of:
           0.6391581 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.097416475 = queryNorm
           2.4604082 = fieldWeight in 6561, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.375 = fieldNorm(doc=6561)
       2.0756607 = weight(author_txt:yang in 6561) [ClassicSimilarity], result of:
         2.0756607 = score(doc=6561,freq=1.0), product of:
           0.7690754 = queryWeight, product of:
             1.0969335 = boost
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.097416475 = queryNorm
           2.698904 = fieldWeight in 6561, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.375 = fieldNorm(doc=6561)
   

4. Wang, Y.; Tai, Y.; Yang, Y.: Determination of semantic types of tags in social tagging systems (2018) 3.65

   3.6482506 = sum of:
     3.6482506 = sum of:
       1.5725899 = weight(author_txt:wang in 4648) [ClassicSimilarity], result of:
         1.5725899 = score(doc=4648,freq=1.0), product of:
           0.6391581 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.097416475 = queryNorm
           2.4604082 = fieldWeight in 4648, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.375 = fieldNorm(doc=4648)
       2.0756607 = weight(author_txt:yang in 4648) [ClassicSimilarity], result of:
         2.0756607 = score(doc=4648,freq=1.0), product of:
           0.7690754 = queryWeight, product of:
             1.0969335 = boost
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.097416475 = queryNorm
           2.698904 = fieldWeight in 4648, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.375 = fieldNorm(doc=4648)
   

5. Wang, F.; Yang, J.; Wu, Y.: Non-synchronism in theoretical research of information science (2021) 3.65

   3.6482506 = sum of:
     3.6482506 = sum of:
       1.5725899 = weight(author_txt:wang in 602) [ClassicSimilarity], result of:
         1.5725899 = score(doc=602,freq=1.0), product of:
           0.6391581 = queryWeight, product of:
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.097416475 = queryNorm
           2.4604082 = fieldWeight in 602, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.5610886 = idf(docFreq=169, maxDocs=44218)
             0.375 = fieldNorm(doc=602)
       2.0756607 = weight(author_txt:yang in 602) [ClassicSimilarity], result of:
         2.0756607 = score(doc=602,freq=1.0), product of:
           0.7690754 = queryWeight, product of:
             1.0969335 = boost
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.097416475 = queryNorm
           2.698904 = fieldWeight in 602, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.1970778 = idf(docFreq=89, maxDocs=44218)
             0.375 = fieldNorm(doc=602)
   

Similar documents (content)

1. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.42

   0.42214164 = sum of:
     0.42214164 = product of:
       1.7589235 = sum of:
         0.011771532 = weight(abstract_txt:indexing in 4580) [ClassicSimilarity], result of:
           0.011771532 = score(doc=4580,freq=1.0), product of:
             0.043301694 = queryWeight, product of:
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.009955357 = queryNorm
             0.27184922 = fieldWeight in 4580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
         0.007061586 = weight(abstract_txt:have in 4580) [ClassicSimilarity], result of:
           0.007061586 = score(doc=4580,freq=1.0), product of:
             0.035257228 = queryWeight, product of:
               1.10514 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.009955357 = queryNorm
             0.20028761 = fieldWeight in 4580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
         0.032486074 = weight(abstract_txt:word in 4580) [ClassicSimilarity], result of:
           0.032486074 = score(doc=4580,freq=2.0), product of:
             0.06761936 = queryWeight, product of:
               1.2496347 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.009955357 = queryNorm
             0.48042563 = fieldWeight in 4580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
         0.09812895 = weight(abstract_txt:words in 4580) [ClassicSimilarity], result of:
           0.09812895 = score(doc=4580,freq=5.0), product of:
             0.13116995 = queryWeight, product of:
               2.461386 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.009955357 = queryNorm
             0.74810547 = fieldWeight in 4580, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
         0.4298982 = weight(abstract_txt:chinese in 4580) [ClassicSimilarity], result of:
           0.4298982 = score(doc=4580,freq=9.0), product of:
             0.3637468 = queryWeight, product of:
               5.796651 = boost
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.009955357 = queryNorm
             1.1818612 = fieldWeight in 4580, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
         1.1795771 = weight(abstract_txt:segmentation in 4580) [ClassicSimilarity], result of:
           1.1795771 = score(doc=4580,freq=9.0), product of:
             0.7927578 = queryWeight, product of:
               10.034579 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.009955357 = queryNorm
             1.4879413 = fieldWeight in 4580, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=4580)
       0.24 = coord(6/25)
   

2. Lee, K.H.; Ng, M.K.M.; Lu, Q.: Text segmentation for Chinese spell checking (1999) 0.38

   0.38162088 = sum of:
     0.38162088 = product of:
       1.3629317 = sum of:
         0.045942247 = weight(abstract_txt:word in 3913) [ClassicSimilarity], result of:
           0.045942247 = score(doc=3913,freq=4.0), product of:
             0.06761936 = queryWeight, product of:
               1.2496347 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.009955357 = queryNorm
             0.67942446 = fieldWeight in 3913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.036570407 = weight(abstract_txt:texts in 3913) [ClassicSimilarity], result of:
           0.036570407 = score(doc=3913,freq=2.0), product of:
             0.07317445 = queryWeight, product of:
               1.2999519 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.009955357 = queryNorm
             0.4997702 = fieldWeight in 3913, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.01569493 = weight(abstract_txt:language in 3913) [ClassicSimilarity], result of:
           0.01569493 = score(doc=3913,freq=1.0), product of:
             0.060046297 = queryWeight, product of:
               1.442236 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009955357 = queryNorm
             0.26138046 = fieldWeight in 3913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.039559685 = weight(abstract_txt:character in 3913) [ClassicSimilarity], result of:
           0.039559685 = score(doc=3913,freq=1.0), product of:
             0.097151935 = queryWeight, product of:
               1.4978671 = boost
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.009955357 = queryNorm
             0.407194 = fieldWeight in 3913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.0877692 = weight(abstract_txt:words in 3913) [ClassicSimilarity], result of:
           0.0877692 = score(doc=3913,freq=4.0), product of:
             0.13116995 = queryWeight, product of:
               2.461386 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.009955357 = queryNorm
             0.66912585 = fieldWeight in 3913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.35101044 = weight(abstract_txt:chinese in 3913) [ClassicSimilarity], result of:
           0.35101044 = score(doc=3913,freq=6.0), product of:
             0.3637468 = queryWeight, product of:
               5.796651 = boost
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.009955357 = queryNorm
             0.96498567 = fieldWeight in 3913, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
         0.78638476 = weight(abstract_txt:segmentation in 3913) [ClassicSimilarity], result of:
           0.78638476 = score(doc=3913,freq=4.0), product of:
             0.7927578 = queryWeight, product of:
               10.034579 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.009955357 = queryNorm
             0.9919609 = fieldWeight in 3913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=3913)
       0.28 = coord(7/25)
   

3. Kwok, K.L.: Employing multiple representations for Chinese information retrieval (1999) 0.36

   0.35692698 = sum of:
     0.35692698 = product of:
       0.9914638 = sum of:
         0.02038889 = weight(abstract_txt:indexing in 3773) [ClassicSimilarity], result of:
           0.02038889 = score(doc=3773,freq=3.0), product of:
             0.043301694 = queryWeight, product of:
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.009955357 = queryNorm
             0.47085664 = fieldWeight in 3773, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3495874 = idf(docFreq=1551, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.045942247 = weight(abstract_txt:word in 3773) [ClassicSimilarity], result of:
           0.045942247 = score(doc=3773,freq=4.0), product of:
             0.06761936 = queryWeight, product of:
               1.2496347 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.009955357 = queryNorm
             0.67942446 = fieldWeight in 3773, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.025859185 = weight(abstract_txt:texts in 3773) [ClassicSimilarity], result of:
           0.025859185 = score(doc=3773,freq=1.0), product of:
             0.07317445 = queryWeight, product of:
               1.2999519 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.009955357 = queryNorm
             0.3533909 = fieldWeight in 3773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.01569493 = weight(abstract_txt:language in 3773) [ClassicSimilarity], result of:
           0.01569493 = score(doc=3773,freq=1.0), product of:
             0.060046297 = queryWeight, product of:
               1.442236 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009955357 = queryNorm
             0.26138046 = fieldWeight in 3773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.05594584 = weight(abstract_txt:character in 3773) [ClassicSimilarity], result of:
           0.05594584 = score(doc=3773,freq=2.0), product of:
             0.097151935 = queryWeight, product of:
               1.4978671 = boost
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.009955357 = queryNorm
             0.57585925 = fieldWeight in 3773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.025034118 = weight(abstract_txt:documents in 3773) [ClassicSimilarity], result of:
           0.025034118 = score(doc=3773,freq=1.0), product of:
             0.09718915 = queryWeight, product of:
               2.3687894 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.009955357 = queryNorm
             0.2575814 = fieldWeight in 3773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.0438846 = weight(abstract_txt:words in 3773) [ClassicSimilarity], result of:
           0.0438846 = score(doc=3773,freq=1.0), product of:
             0.13116995 = queryWeight, product of:
               2.461386 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.009955357 = queryNorm
             0.33456293 = fieldWeight in 3773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.20265596 = weight(abstract_txt:chinese in 3773) [ClassicSimilarity], result of:
           0.20265596 = score(doc=3773,freq=2.0), product of:
             0.3637468 = queryWeight, product of:
               5.796651 = boost
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.009955357 = queryNorm
             0.5571347 = fieldWeight in 3773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
         0.556058 = weight(abstract_txt:segmentation in 3773) [ClassicSimilarity], result of:
           0.556058 = score(doc=3773,freq=2.0), product of:
             0.7927578 = queryWeight, product of:
               10.034579 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.009955357 = queryNorm
             0.7014223 = fieldWeight in 3773, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=3773)
       0.36 = coord(9/25)
   

4. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.35

   0.35277843 = sum of:
     0.35277843 = product of:
       1.4699101 = sum of:
         0.007061586 = weight(abstract_txt:have in 5206) [ClassicSimilarity], result of:
           0.007061586 = score(doc=5206,freq=1.0), product of:
             0.035257228 = queryWeight, product of:
               1.10514 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.009955357 = queryNorm
             0.20028761 = fieldWeight in 5206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
         0.022971123 = weight(abstract_txt:word in 5206) [ClassicSimilarity], result of:
           0.022971123 = score(doc=5206,freq=1.0), product of:
             0.06761936 = queryWeight, product of:
               1.2496347 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.009955357 = queryNorm
             0.33971223 = fieldWeight in 5206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
         0.096901044 = weight(abstract_txt:character in 5206) [ClassicSimilarity], result of:
           0.096901044 = score(doc=5206,freq=6.0), product of:
             0.097151935 = queryWeight, product of:
               1.4978671 = boost
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.009955357 = queryNorm
             0.9974175 = fieldWeight in 5206, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
         0.1316538 = weight(abstract_txt:words in 5206) [ClassicSimilarity], result of:
           0.1316538 = score(doc=5206,freq=9.0), product of:
             0.13116995 = queryWeight, product of:
               2.461386 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.009955357 = queryNorm
             1.0036888 = fieldWeight in 5206, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
         0.24820186 = weight(abstract_txt:chinese in 5206) [ClassicSimilarity], result of:
           0.24820186 = score(doc=5206,freq=3.0), product of:
             0.3637468 = queryWeight, product of:
               5.796651 = boost
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.009955357 = queryNorm
             0.6823479 = fieldWeight in 5206, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.30326 = idf(docFreq=219, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
         0.9631207 = weight(abstract_txt:segmentation in 5206) [ClassicSimilarity], result of:
           0.9631207 = score(doc=5206,freq=6.0), product of:
             0.7927578 = queryWeight, product of:
               10.034579 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.009955357 = queryNorm
             1.2148991 = fieldWeight in 5206, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=5206)
       0.24 = coord(6/25)
   

5. Doval, Y.; Gómez-Rodríguez, C.: Comparing neural- and N-gram-based language models for word segmentation (2019) 0.35

   0.35124287 = sum of:
     0.35124287 = product of:
       0.8781072 = sum of:
         0.007061586 = weight(abstract_txt:have in 4675) [ClassicSimilarity], result of:
           0.007061586 = score(doc=4675,freq=1.0), product of:
             0.035257228 = queryWeight, product of:
               1.10514 = boost
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.009955357 = queryNorm
             0.20028761 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2046018 = idf(docFreq=4876, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.00796882 = weight(abstract_txt:data in 4675) [ClassicSimilarity], result of:
           0.00796882 = score(doc=4675,freq=1.0), product of:
             0.038215775 = queryWeight, product of:
               1.150574 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.009955357 = queryNorm
             0.20852174 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.051364996 = weight(abstract_txt:word in 4675) [ClassicSimilarity], result of:
           0.051364996 = score(doc=4675,freq=5.0), product of:
             0.06761936 = queryWeight, product of:
               1.2496347 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.009955357 = queryNorm
             0.75961965 = fieldWeight in 4675, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.010503398 = weight(abstract_txt:search in 4675) [ClassicSimilarity], result of:
           0.010503398 = score(doc=4675,freq=1.0), product of:
             0.04594094 = queryWeight, product of:
               1.261517 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.009955357 = queryNorm
             0.22862828 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.025859185 = weight(abstract_txt:texts in 4675) [ClassicSimilarity], result of:
           0.025859185 = score(doc=4675,freq=1.0), product of:
             0.07317445 = queryWeight, product of:
               1.2999519 = boost
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.009955357 = queryNorm
             0.3533909 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6542544 = idf(docFreq=420, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.027184414 = weight(abstract_txt:language in 4675) [ClassicSimilarity], result of:
           0.027184414 = score(doc=4675,freq=3.0), product of:
             0.060046297 = queryWeight, product of:
               1.442236 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.009955357 = queryNorm
             0.45272425 = fieldWeight in 4675, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.06851938 = weight(abstract_txt:character in 4675) [ClassicSimilarity], result of:
           0.06851938 = score(doc=4675,freq=3.0), product of:
             0.097151935 = queryWeight, product of:
               1.4978671 = boost
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.009955357 = queryNorm
             0.70528066 = fieldWeight in 4675, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.515104 = idf(docFreq=177, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.0438846 = weight(abstract_txt:words in 4675) [ClassicSimilarity], result of:
           0.0438846 = score(doc=4675,freq=1.0), product of:
             0.13116995 = queryWeight, product of:
               2.461386 = boost
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.009955357 = queryNorm
             0.33456293 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.353007 = idf(docFreq=568, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.079702795 = weight(abstract_txt:algorithm in 4675) [ClassicSimilarity], result of:
           0.079702795 = score(doc=4675,freq=1.0), product of:
             0.2235145 = queryWeight, product of:
               3.9351475 = boost
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.009955357 = queryNorm
             0.35658893 = fieldWeight in 4675, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.705423 = idf(docFreq=399, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
         0.556058 = weight(abstract_txt:segmentation in 4675) [ClassicSimilarity], result of:
           0.556058 = score(doc=4675,freq=2.0), product of:
             0.7927578 = queryWeight, product of:
               10.034579 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.009955357 = queryNorm
             0.7014223 = fieldWeight in 4675, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=4675)
       0.4 = coord(10/25)