Document (#34109)

Author

Vu, Q.M.
Takasu, A.
Adachi, J.

Title

Improving the performance of personal name disambiguation using web directories

Source

Information processing and management. 44(2008) no.4, S.1546-1561

Year

2008

Abstract

Frequent requests from users to search engines on the World Wide Web are to search for information about people using personal names. Current search engines only return sets of documents containing the name queried, but, as several people usually share a personal name, the resulting sets often contain documents relevant to several people. It is necessary to disambiguate people in these result sets in order to to help users find the person of interest more readily. In the task of name disambiguation, effective measurement of similarities in the documents is a crucial step towards the final disambiguation. We propose a new method that uses web directories as a knowledge base to find common contexts in documents and uses the common contexts measure to determine document similarities. Experiments, conducted on documents mentioning real people on the web, together with several famous web directory structures, suggest that there are significant advantages in using web directories to disambiguate people compared with other conventional methods.

Similar documents (content)

1. Spink, A.; Jansen, B.J.; Pedersen , J.: Searching for people on Web search engines (2004) 0.24

   0.24262401 = sum of:
     0.24262401 = product of:
       0.8665143 = sum of:
         0.032008972 = weight(abstract_txt:common in 4429) [ClassicSimilarity], result of:
           0.032008972 = score(doc=4429,freq=1.0), product of:
             0.1065572 = queryWeight, product of:
               1.3878537 = boost
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.015974607 = queryNorm
             0.3003924 = fieldWeight in 4429, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.017961323 = weight(abstract_txt:using in 4429) [ClassicSimilarity], result of:
           0.017961323 = score(doc=4429,freq=1.0), product of:
             0.08298335 = queryWeight, product of:
               1.5000074 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.015974607 = queryNorm
             0.21644491 = fieldWeight in 4429, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.105232 = weight(abstract_txt:engines in 4429) [ClassicSimilarity], result of:
           0.105232 = score(doc=4429,freq=6.0), product of:
             0.12965316 = queryWeight, product of:
               1.5308895 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.015974607 = queryNorm
             0.8116424 = fieldWeight in 4429, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.059873004 = weight(abstract_txt:search in 4429) [ClassicSimilarity], result of:
           0.059873004 = score(doc=4429,freq=8.0), product of:
             0.0925883 = queryWeight, product of:
               1.5844407 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.015974607 = queryNorm
             0.6466584 = fieldWeight in 4429, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.17711234 = weight(abstract_txt:personal in 4429) [ClassicSimilarity], result of:
           0.17711234 = score(doc=4429,freq=8.0), product of:
             0.19079542 = queryWeight, product of:
               2.274479 = boost
               5.2511673 = idf(docFreq=629, maxDocs=44218)
               0.015974607 = queryNorm
             0.928284 = fieldWeight in 4429, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.2511673 = idf(docFreq=629, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.26798043 = weight(abstract_txt:name in 4429) [ClassicSimilarity], result of:
           0.26798043 = score(doc=4429,freq=6.0), product of:
             0.3046234 = queryWeight, product of:
               3.3185542 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.015974607 = queryNorm
             0.87971056 = fieldWeight in 4429, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
         0.20634629 = weight(abstract_txt:people in 4429) [ClassicSimilarity], result of:
           0.20634629 = score(doc=4429,freq=4.0), product of:
             0.3353409 = queryWeight, product of:
               4.264383 = boost
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.015974607 = queryNorm
             0.6153329 = fieldWeight in 4429, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.0625 = fieldNorm(doc=4429)
       0.28 = coord(7/25)
   

2. Kim, J.; Kim, J.; Owen-Smith, J.: Ethnicity-based name partitioning for author name disambiguation using supervised machine learning (2021) 0.22

   0.22016703 = sum of:
     0.22016703 = product of:
       1.1008351 = sum of:
         0.081647664 = weight(abstract_txt:similarities in 311) [ClassicSimilarity], result of:
           0.081647664 = score(doc=311,freq=1.0), product of:
             0.19892873 = queryWeight, product of:
               1.8962739 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.015974607 = queryNorm
             0.41043678 = fieldWeight in 311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.0625 = fieldNorm(doc=311)
         0.040675003 = weight(abstract_txt:several in 311) [ClassicSimilarity], result of:
           0.040675003 = score(doc=311,freq=1.0), product of:
             0.14310357 = queryWeight, product of:
               1.9698046 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.015974607 = queryNorm
             0.28423473 = fieldWeight in 311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.0625 = fieldNorm(doc=311)
         0.1867452 = weight(abstract_txt:disambiguate in 311) [ClassicSimilarity], result of:
           0.1867452 = score(doc=311,freq=1.0), product of:
             0.34533024 = queryWeight, product of:
               2.4984438 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.015974607 = queryNorm
             0.5407728 = fieldWeight in 311, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=311)
         0.38242045 = weight(abstract_txt:disambiguation in 311) [ClassicSimilarity], result of:
           0.38242045 = score(doc=311,freq=5.0), product of:
             0.37279448 = queryWeight, product of:
               3.1793084 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.015974607 = queryNorm
             1.0258211 = fieldWeight in 311, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.0625 = fieldNorm(doc=311)
         0.40934685 = weight(abstract_txt:name in 311) [ClassicSimilarity], result of:
           0.40934685 = score(doc=311,freq=14.0), product of:
             0.3046234 = queryWeight, product of:
               3.3185542 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.015974607 = queryNorm
             1.34378 = fieldWeight in 311, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=311)
       0.2 = coord(5/25)
   

3. Dumais, S.T.: Latent semantic analysis (2003) 0.17

   0.17307413 = sum of:
     0.17307413 = product of:
       0.39335027 = sum of:
         0.006557505 = weight(abstract_txt:users in 2462) [ClassicSimilarity], result of:
           0.006557505 = score(doc=2462,freq=1.0), product of:
             0.058782414 = queryWeight, product of:
               1.0308038 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.015974607 = queryNorm
             0.11155556 = fieldWeight in 2462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.03872333 = weight(abstract_txt:return in 2462) [ClassicSimilarity], result of:
           0.03872333 = score(doc=2462,freq=2.0), product of:
             0.120980896 = queryWeight, product of:
               1.0456725 = boost
               7.24254 = idf(docFreq=85, maxDocs=44218)
               0.015974607 = queryNorm
             0.32007807 = fieldWeight in 2462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.24254 = idf(docFreq=85, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.029156048 = weight(abstract_txt:find in 2462) [ClassicSimilarity], result of:
           0.029156048 = score(doc=2462,freq=3.0), product of:
             0.110204756 = queryWeight, product of:
               1.4114077 = boost
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.015974607 = queryNorm
             0.26456252 = fieldWeight in 2462, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.0127005745 = weight(abstract_txt:using in 2462) [ClassicSimilarity], result of:
           0.0127005745 = score(doc=2462,freq=2.0), product of:
             0.08298335 = queryWeight, product of:
               1.5000074 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.015974607 = queryNorm
             0.15304966 = fieldWeight in 2462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.02148039 = weight(abstract_txt:engines in 2462) [ClassicSimilarity], result of:
           0.02148039 = score(doc=2462,freq=1.0), product of:
             0.12965316 = queryWeight, product of:
               1.5308895 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.015974607 = queryNorm
             0.1656758 = fieldWeight in 2462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.018332288 = weight(abstract_txt:search in 2462) [ClassicSimilarity], result of:
           0.018332288 = score(doc=2462,freq=3.0), product of:
             0.0925883 = queryWeight, product of:
               1.5844407 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.015974607 = queryNorm
             0.1979979 = fieldWeight in 2462, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.027690686 = weight(abstract_txt:contexts in 2462) [ClassicSimilarity], result of:
           0.027690686 = score(doc=2462,freq=1.0), product of:
             0.15357156 = queryWeight, product of:
               1.6661254 = boost
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.015974607 = queryNorm
             0.18031129 = fieldWeight in 2462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.040823832 = weight(abstract_txt:similarities in 2462) [ClassicSimilarity], result of:
           0.040823832 = score(doc=2462,freq=1.0), product of:
             0.19892873 = queryWeight, product of:
               1.8962739 = boost
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.015974607 = queryNorm
             0.20521839 = fieldWeight in 2462, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5669885 = idf(docFreq=168, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.028761571 = weight(abstract_txt:several in 2462) [ClassicSimilarity], result of:
           0.028761571 = score(doc=2462,freq=2.0), product of:
             0.14310357 = queryWeight, product of:
               1.9698046 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.015974607 = queryNorm
             0.2009843 = fieldWeight in 2462, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.079773486 = weight(abstract_txt:documents in 2462) [ClassicSimilarity], result of:
           0.079773486 = score(doc=2462,freq=10.0), product of:
             0.19587275 = queryWeight, product of:
               2.9751532 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015974607 = queryNorm
             0.40727198 = fieldWeight in 2462, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
         0.08935056 = weight(abstract_txt:people in 2462) [ClassicSimilarity], result of:
           0.08935056 = score(doc=2462,freq=3.0), product of:
             0.3353409 = queryWeight, product of:
               4.264383 = boost
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.015974607 = queryNorm
             0.26644695 = fieldWeight in 2462, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.03125 = fieldNorm(doc=2462)
       0.44 = coord(11/25)
   

4. Khoo, C.S.G.; Ng, K.; Ou, S.: ¬An exploratory study of human clustering of Web pages (2003) 0.13

   0.13173363 = sum of:
     0.13173363 = product of:
       0.3659267 = sum of:
         0.021994542 = weight(abstract_txt:users in 2741) [ClassicSimilarity], result of:
           0.021994542 = score(doc=2741,freq=5.0), product of:
             0.058782414 = queryWeight, product of:
               1.0308038 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.015974607 = queryNorm
             0.37416875 = fieldWeight in 2741, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.024006728 = weight(abstract_txt:common in 2741) [ClassicSimilarity], result of:
           0.024006728 = score(doc=2741,freq=1.0), product of:
             0.1065572 = queryWeight, product of:
               1.3878537 = boost
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.015974607 = queryNorm
             0.22529429 = fieldWeight in 2741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.03570872 = weight(abstract_txt:find in 2741) [ClassicSimilarity], result of:
           0.03570872 = score(doc=2741,freq=2.0), product of:
             0.110204756 = queryWeight, product of:
               1.4114077 = boost
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.015974607 = queryNorm
             0.3240216 = fieldWeight in 2741, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.887848 = idf(docFreq=905, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.013470993 = weight(abstract_txt:using in 2741) [ClassicSimilarity], result of:
           0.013470993 = score(doc=2741,freq=1.0), product of:
             0.08298335 = queryWeight, product of:
               1.5000074 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.015974607 = queryNorm
             0.16233368 = fieldWeight in 2741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.064441174 = weight(abstract_txt:engines in 2741) [ClassicSimilarity], result of:
           0.064441174 = score(doc=2741,freq=4.0), product of:
             0.12965316 = queryWeight, product of:
               1.5308895 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.015974607 = queryNorm
             0.4970274 = fieldWeight in 2741, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.044904754 = weight(abstract_txt:search in 2741) [ClassicSimilarity], result of:
           0.044904754 = score(doc=2741,freq=8.0), product of:
             0.0925883 = queryWeight, product of:
               1.5844407 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.015974607 = queryNorm
             0.48499382 = fieldWeight in 2741, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.030506253 = weight(abstract_txt:several in 2741) [ClassicSimilarity], result of:
           0.030506253 = score(doc=2741,freq=1.0), product of:
             0.14310357 = queryWeight, product of:
               1.9698046 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.015974607 = queryNorm
             0.21317604 = fieldWeight in 2741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.05351368 = weight(abstract_txt:documents in 2741) [ClassicSimilarity], result of:
           0.05351368 = score(doc=2741,freq=2.0), product of:
             0.19587275 = queryWeight, product of:
               2.9751532 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015974607 = queryNorm
             0.27320635 = fieldWeight in 2741, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
         0.07737986 = weight(abstract_txt:people in 2741) [ClassicSimilarity], result of:
           0.07737986 = score(doc=2741,freq=1.0), product of:
             0.3353409 = queryWeight, product of:
               4.264383 = boost
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.015974607 = queryNorm
             0.23074985 = fieldWeight in 2741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.922663 = idf(docFreq=874, maxDocs=44218)
               0.046875 = fieldNorm(doc=2741)
       0.36 = coord(9/25)
   

5. Krovetz, R.; Croft, W.B.: Lexical ambiguity and information retrieval (1992) 0.13

   0.13159554 = sum of:
     0.13159554 = product of:
       0.6579777 = sum of:
         0.048013456 = weight(abstract_txt:common in 4028) [ClassicSimilarity], result of:
           0.048013456 = score(doc=4028,freq=1.0), product of:
             0.1065572 = queryWeight, product of:
               1.3878537 = boost
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.015974607 = queryNorm
             0.45058858 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.806278 = idf(docFreq=982, maxDocs=44218)
               0.09375 = fieldNorm(doc=4028)
         0.055074666 = weight(abstract_txt:uses in 4028) [ClassicSimilarity], result of:
           0.055074666 = score(doc=4028,freq=1.0), product of:
             0.116763934 = queryWeight, product of:
               1.4528028 = boost
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.015974607 = queryNorm
             0.4716753 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.09375 = fieldNorm(doc=4028)
         0.061012506 = weight(abstract_txt:several in 4028) [ClassicSimilarity], result of:
           0.061012506 = score(doc=4028,freq=1.0), product of:
             0.14310357 = queryWeight, product of:
               1.9698046 = boost
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.015974607 = queryNorm
             0.42635208 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5477557 = idf(docFreq=1272, maxDocs=44218)
               0.09375 = fieldNorm(doc=4028)
         0.1310812 = weight(abstract_txt:documents in 4028) [ClassicSimilarity], result of:
           0.1310812 = score(doc=4028,freq=3.0), product of:
             0.19587275 = queryWeight, product of:
               2.9751532 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015974607 = queryNorm
             0.6692161 = fieldWeight in 4028, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.09375 = fieldNorm(doc=4028)
         0.3627959 = weight(abstract_txt:disambiguation in 4028) [ClassicSimilarity], result of:
           0.3627959 = score(doc=4028,freq=2.0), product of:
             0.37279448 = queryWeight, product of:
               3.1793084 = boost
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.015974607 = queryNorm
             0.97317934 = fieldWeight in 4028, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3401785 = idf(docFreq=77, maxDocs=44218)
               0.09375 = fieldNorm(doc=4028)
       0.2 = coord(5/25)