Document (#21774)

Author

Kwok, K.L.

Title

Employing multiple representations for Chinese information retrieval

Source

Journal of the American Society for Information Science. 50(1999) no.8, S.709-723

Year

1999

Abstract

For information retrieval in the Chinese language, 3 representation methods for texts are popular, namely: 1-gram or character, bigram, and short-word. Each has its advantages as well as drawbacks. Employing more than one method may combine advantages from them and enhance retrieval effectiveness. We investigated 2 ways of using them simultaneously: mixing representations in documents and queries, and combining retrieval lists obtained via different representations. The experiments were done with the 170 MB evaluated Chinese corpora and 54 long and short queries available from the TREC program and using our Probabilistic Indexing and Retrieval Components System (PIRCS retrieval system). Experiments show that good retrieval need not depend on accurate word segmentation; approximate segmentation into short-words will do. Results also show and confirm that bigram representation alone works well; mixing characters with bigram representation boosts effectiveness further, but it is preferable to mix characters with short-word indexing which is more efficient, needs less resource, and gives better retrieval more often. Cobining retrieval lists from short-word with character representation and from bigram indexing provides the best retrieval results but also at a substabtial cost

Similar documents (author)

1. Kwok, K.L.: ¬The use of titles and cited titles as document representations for automatic classification (1975) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:kwok in 4346) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 4346, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=4346)
   

2. Kwok, K.L.: ¬A network approach to probabilistic information retrieval (1995) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:kwok in 6696) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 6696, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=6696)
   

3. Kwok, K.L.: Improving English and Chinese ad-hoc retrieval : a TIPSTER text phase 3 project report (2000) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:kwok in 388) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 388, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=388)
   

4. Kwok, K.L.; Grunfeld, L.: TREC-4 ad-hoc, routing retrieval and filtering experiments using PIRCS (1996) 4.50

   4.496709 = sum of:
     4.496709 = weight(author_txt:kwok in 630) [ClassicSimilarity], result of:
       4.496709 = fieldWeight in 630, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.5 = fieldNorm(doc=630)
   

5. Kwok, K.L.; Grunfeld, L.: TREC-5 English and Chinese retrieval experiments using PIRCS (1997) 4.50

   4.496709 = sum of:
     4.496709 = weight(author_txt:kwok in 4102) [ClassicSimilarity], result of:
       4.496709 = fieldWeight in 4102, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.5 = fieldNorm(doc=4102)
   

Similar documents (content)

1. Wang, F.L.; Yang, C.C.: Mining Web data for Chinese segmentation (2007) 0.35

   0.35217974 = sum of:
     0.35217974 = product of:
       0.8804493 = sum of:
         0.018178333 = weight(abstract_txt:show in 1604) [ClassicSimilarity], result of:
           0.018178333 = score(doc=1604,freq=1.0), product of:
             0.06608809 = queryWeight, product of:
               1.1085255 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.013546486 = queryNorm
             0.27506217 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.009381089 = weight(abstract_txt:with in 1604) [ClassicSimilarity], result of:
           0.009381089 = score(doc=1604,freq=2.0), product of:
             0.042519618 = queryWeight, product of:
               1.2574588 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.013546486 = queryNorm
             0.22062966 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.032195635 = weight(abstract_txt:experiments in 1604) [ClassicSimilarity], result of:
           0.032195635 = score(doc=1604,freq=1.0), product of:
             0.096742764 = queryWeight, product of:
               1.3411994 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.013546486 = queryNorm
             0.3327963 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.008961382 = weight(abstract_txt:from in 1604) [ClassicSimilarity], result of:
           0.008961382 = score(doc=1604,freq=1.0), product of:
             0.05196136 = queryWeight, product of:
               1.3900785 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.013546486 = queryNorm
             0.17246243 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.083578795 = weight(abstract_txt:character in 1604) [ClassicSimilarity], result of:
           0.083578795 = score(doc=1604,freq=2.0), product of:
             0.14503558 = queryWeight, product of:
               1.6421824 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.013546486 = queryNorm
             0.5762641 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.03724502 = weight(abstract_txt:indexing in 1604) [ClassicSimilarity], result of:
           0.03724502 = score(doc=1604,freq=2.0), product of:
             0.09686192 = queryWeight, product of:
               1.6436384 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.013546486 = queryNorm
             0.38451666 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.3376035 = weight(abstract_txt:segmentation in 1604) [ClassicSimilarity], result of:
           0.3376035 = score(doc=1604,freq=10.0), product of:
             0.21512546 = queryWeight, product of:
               2.0 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.013546486 = queryNorm
             1.5693332 = fieldWeight in 1604, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.21150143 = weight(abstract_txt:chinese in 1604) [ClassicSimilarity], result of:
           0.21150143 = score(doc=1604,freq=7.0), product of:
             0.20306128 = queryWeight, product of:
               2.3798156 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.013546486 = queryNorm
             1.0415646 = fieldWeight in 1604, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.09700202 = weight(abstract_txt:word in 1604) [ClassicSimilarity], result of:
           0.09700202 = score(doc=1604,freq=2.0), product of:
             0.20180923 = queryWeight, product of:
               2.7394893 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.013546486 = queryNorm
             0.48066196 = fieldWeight in 1604, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
         0.04480209 = weight(abstract_txt:retrieval in 1604) [ClassicSimilarity], result of:
           0.04480209 = score(doc=1604,freq=1.0), product of:
             0.20619398 = queryWeight, product of:
               4.378316 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.013546486 = queryNorm
             0.21728125 = fieldWeight in 1604, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1604)
       0.4 = coord(10/25)
   

2. Lee, K.H.; Ng, M.K.M.; Lu, Q.: Text segmentation for Chinese spell checking (1999) 0.28

   0.27586383 = sum of:
     0.27586383 = product of:
       0.7662884 = sum of:
         0.009381089 = weight(abstract_txt:with in 4913) [ClassicSimilarity], result of:
           0.009381089 = score(doc=4913,freq=2.0), product of:
             0.042519618 = queryWeight, product of:
               1.2574588 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.013546486 = queryNorm
             0.22062966 = fieldWeight in 4913, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.017721454 = weight(abstract_txt:more in 4913) [ClassicSimilarity], result of:
           0.017721454 = score(doc=4913,freq=2.0), product of:
             0.059034675 = queryWeight, product of:
               1.2831674 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.013546486 = queryNorm
             0.3001872 = fieldWeight in 4913, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.032195635 = weight(abstract_txt:experiments in 4913) [ClassicSimilarity], result of:
           0.032195635 = score(doc=4913,freq=1.0), product of:
             0.096742764 = queryWeight, product of:
               1.3411994 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.013546486 = queryNorm
             0.3327963 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.015521569 = weight(abstract_txt:from in 4913) [ClassicSimilarity], result of:
           0.015521569 = score(doc=4913,freq=3.0), product of:
             0.05196136 = queryWeight, product of:
               1.3900785 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.013546486 = queryNorm
             0.29871368 = fieldWeight in 4913, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.059099134 = weight(abstract_txt:character in 4913) [ClassicSimilarity], result of:
           0.059099134 = score(doc=4913,freq=1.0), product of:
             0.14503558 = queryWeight, product of:
               1.6421824 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.013546486 = queryNorm
             0.40748024 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.08585645 = weight(abstract_txt:characters in 4913) [ClassicSimilarity], result of:
           0.08585645 = score(doc=4913,freq=1.0), product of:
             0.18603835 = queryWeight, product of:
               1.8598818 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.013546486 = queryNorm
             0.4614987 = fieldWeight in 4913, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.21351922 = weight(abstract_txt:segmentation in 4913) [ClassicSimilarity], result of:
           0.21351922 = score(doc=4913,freq=4.0), product of:
             0.21512546 = queryWeight, product of:
               2.0 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.013546486 = queryNorm
             0.99253345 = fieldWeight in 4913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.1958123 = weight(abstract_txt:chinese in 4913) [ClassicSimilarity], result of:
           0.1958123 = score(doc=4913,freq=6.0), product of:
             0.20306128 = queryWeight, product of:
               2.3798156 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.013546486 = queryNorm
             0.96430147 = fieldWeight in 4913, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
         0.13718157 = weight(abstract_txt:word in 4913) [ClassicSimilarity], result of:
           0.13718157 = score(doc=4913,freq=4.0), product of:
             0.20180923 = queryWeight, product of:
               2.7394893 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.013546486 = queryNorm
             0.67975867 = fieldWeight in 4913, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=4913)
       0.36 = coord(9/25)
   

3. Chau, M.; Lu, Y.; Fang, X.; Yang, C.C.: Characteristics of character usage in Chinese Web searching (2009) 0.27

   0.2712942 = sum of:
     0.2712942 = product of:
       0.8477944 = sum of:
         0.013266863 = weight(abstract_txt:with in 3456) [ClassicSimilarity], result of:
           0.013266863 = score(doc=3456,freq=4.0), product of:
             0.042519618 = queryWeight, product of:
               1.2574588 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.013546486 = queryNorm
             0.31201747 = fieldWeight in 3456, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.017721454 = weight(abstract_txt:more in 3456) [ClassicSimilarity], result of:
           0.017721454 = score(doc=3456,freq=2.0), product of:
             0.059034675 = queryWeight, product of:
               1.2831674 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.013546486 = queryNorm
             0.3001872 = fieldWeight in 3456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.040043775 = weight(abstract_txt:queries in 3456) [ClassicSimilarity], result of:
           0.040043775 = score(doc=3456,freq=2.0), product of:
             0.08880427 = queryWeight, product of:
               1.2849938 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.013546486 = queryNorm
             0.45092174 = fieldWeight in 3456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.015521569 = weight(abstract_txt:from in 3456) [ClassicSimilarity], result of:
           0.015521569 = score(doc=3456,freq=3.0), product of:
             0.05196136 = queryWeight, product of:
               1.3900785 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.013546486 = queryNorm
             0.29871368 = fieldWeight in 3456, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.083578795 = weight(abstract_txt:character in 3456) [ClassicSimilarity], result of:
           0.083578795 = score(doc=3456,freq=2.0), product of:
             0.14503558 = queryWeight, product of:
               1.6421824 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.013546486 = queryNorm
             0.5762641 = fieldWeight in 3456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.08585645 = weight(abstract_txt:characters in 3456) [ClassicSimilarity], result of:
           0.08585645 = score(doc=3456,freq=1.0), product of:
             0.18603835 = queryWeight, product of:
               1.8598818 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.013546486 = queryNorm
             0.4614987 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.1958123 = weight(abstract_txt:chinese in 3456) [ClassicSimilarity], result of:
           0.1958123 = score(doc=3456,freq=6.0), product of:
             0.20306128 = queryWeight, product of:
               2.3798156 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.013546486 = queryNorm
             0.96430147 = fieldWeight in 3456, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
         0.3959932 = weight(abstract_txt:bigram in 3456) [ClassicSimilarity], result of:
           0.3959932 = score(doc=3456,freq=1.0), product of:
             0.64946485 = queryWeight, product of:
               4.9144726 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.013546486 = queryNorm
             0.6097223 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.0625 = fieldNorm(doc=3456)
       0.32 = coord(8/25)
   

4. Yang, C.C.; Li, K.W.: ¬A heuristic method based on a statistical approach for chinese text segmentation (2005) 0.27

   0.26819712 = sum of:
     0.26819712 = product of:
       0.83811605 = sum of:
         0.011489442 = weight(abstract_txt:with in 5580) [ClassicSimilarity], result of:
           0.011489442 = score(doc=5580,freq=3.0), product of:
             0.042519618 = queryWeight, product of:
               1.2574588 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.013546486 = queryNorm
             0.27021506 = fieldWeight in 5580, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.012530961 = weight(abstract_txt:more in 5580) [ClassicSimilarity], result of:
           0.012530961 = score(doc=5580,freq=1.0), product of:
             0.059034675 = queryWeight, product of:
               1.2831674 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.013546486 = queryNorm
             0.21226442 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.026336208 = weight(abstract_txt:indexing in 5580) [ClassicSimilarity], result of:
           0.026336208 = score(doc=5580,freq=1.0), product of:
             0.09686192 = queryWeight, product of:
               1.6436384 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.013546486 = queryNorm
             0.27189434 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.08585645 = weight(abstract_txt:characters in 5580) [ClassicSimilarity], result of:
           0.08585645 = score(doc=5580,freq=1.0), product of:
             0.18603835 = queryWeight, product of:
               1.8598818 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.013546486 = queryNorm
             0.4614987 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.32027882 = weight(abstract_txt:segmentation in 5580) [ClassicSimilarity], result of:
           0.32027882 = score(doc=5580,freq=9.0), product of:
             0.21512546 = queryWeight, product of:
               2.0 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.013546486 = queryNorm
             1.4888002 = fieldWeight in 5580, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.2398201 = weight(abstract_txt:chinese in 5580) [ClassicSimilarity], result of:
           0.2398201 = score(doc=5580,freq=9.0), product of:
             0.20306128 = queryWeight, product of:
               2.3798156 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.013546486 = queryNorm
             1.1810232 = fieldWeight in 5580, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.09700202 = weight(abstract_txt:word in 5580) [ClassicSimilarity], result of:
           0.09700202 = score(doc=5580,freq=2.0), product of:
             0.20180923 = queryWeight, product of:
               2.7394893 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.013546486 = queryNorm
             0.48066196 = fieldWeight in 5580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
         0.04480209 = weight(abstract_txt:retrieval in 5580) [ClassicSimilarity], result of:
           0.04480209 = score(doc=5580,freq=1.0), product of:
             0.20619398 = queryWeight, product of:
               4.378316 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.013546486 = queryNorm
             0.21728125 = fieldWeight in 5580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=5580)
       0.32 = coord(8/25)
   

5. Khoo, C.S.G.; Dai, D.; Loh, T.E.: Using statistical and contextual information to identify two- and three-character words in Chinese text (2002) 0.26

   0.2553894 = sum of:
     0.2553894 = product of:
       0.7980919 = sum of:
         0.009381089 = weight(abstract_txt:with in 206) [ClassicSimilarity], result of:
           0.009381089 = score(doc=206,freq=2.0), product of:
             0.042519618 = queryWeight, product of:
               1.2574588 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.013546486 = queryNorm
             0.22062966 = fieldWeight in 206, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.017721454 = weight(abstract_txt:more in 206) [ClassicSimilarity], result of:
           0.017721454 = score(doc=206,freq=2.0), product of:
             0.059034675 = queryWeight, product of:
               1.2831674 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.013546486 = queryNorm
             0.3001872 = fieldWeight in 206, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.008961382 = weight(abstract_txt:from in 206) [ClassicSimilarity], result of:
           0.008961382 = score(doc=206,freq=1.0), product of:
             0.05196136 = queryWeight, product of:
               1.3900785 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.013546486 = queryNorm
             0.17246243 = fieldWeight in 206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.14476272 = weight(abstract_txt:character in 206) [ClassicSimilarity], result of:
           0.14476272 = score(doc=206,freq=6.0), product of:
             0.14503558 = queryWeight, product of:
               1.6421824 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.013546486 = queryNorm
             0.9981187 = fieldWeight in 206, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.14870773 = weight(abstract_txt:characters in 206) [ClassicSimilarity], result of:
           0.14870773 = score(doc=206,freq=3.0), product of:
             0.18603835 = queryWeight, product of:
               1.8598818 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.013546486 = queryNorm
             0.7993392 = fieldWeight in 206, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.26150656 = weight(abstract_txt:segmentation in 206) [ClassicSimilarity], result of:
           0.26150656 = score(doc=206,freq=6.0), product of:
             0.21512546 = queryWeight, product of:
               2.0 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.013546486 = queryNorm
             1.2156003 = fieldWeight in 206, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.13846019 = weight(abstract_txt:chinese in 206) [ClassicSimilarity], result of:
           0.13846019 = score(doc=206,freq=3.0), product of:
             0.20306128 = queryWeight, product of:
               2.3798156 = boost
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.013546486 = queryNorm
             0.6818641 = fieldWeight in 206, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.2987905 = idf(docFreq=221, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
         0.06859078 = weight(abstract_txt:word in 206) [ClassicSimilarity], result of:
           0.06859078 = score(doc=206,freq=1.0), product of:
             0.20180923 = queryWeight, product of:
               2.7394893 = boost
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.013546486 = queryNorm
             0.33987933 = fieldWeight in 206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4380693 = idf(docFreq=524, maxDocs=44421)
               0.0625 = fieldNorm(doc=206)
       0.32 = coord(8/25)