Document (#11987)

Editor

Schatz, B.

Author

Chen, H.
Yim, T.
Fye, D.

Title

Automatic thesaurus generation for an electronic community system

Source

Journal of the American Society for Information Science. 46(1995) no.3, S.175-193

Year

1995

Abstract

Reports an algorithmic approach to the automatic generation of thesauri for electronic community systems. The techniques used included terms filtering, automatic indexing, and cluster analysis. The testbed for the research was the Worm Community System, which contains a comprehensive library of specialized community data and literature, currently in use by molecular biologists who study the nematode worm. The resulting worm thesaurus included 2709 researchers' names, 798 gene names, 20 experimental methods, and 4302 subject descriptors. On average, each term had about 90 weighted neighbouring terms indicating relevant concepts. The thesaurus was developed as an online search aide. Tests the worm thesaurus in an experiment with 6 worm researchers of varying degrees of expertise and background. The experiment showed that the thesaurus was an excellent 'memory jogging' device and that it supported learning and serendipitous browsing. Despite some occurrences of obvious noise, the system was useful in suggesting relevant concepts for the researchers' queries and it helped improve concept recall. With a simple browsing interface, an automatic thesaurus can become a useful tool for online search and can assist researchers in exploring and traversing a dynamic and complex electronic community system

Theme

Konzeption und Anwendung des Prinzips Thesaurus
Verbale Doksprachen im Online-Retrieval

Similar documents (author)

1. Chen, Y.N.; Chen, S.J.: ¬A metadata practice of the OFLA FRBR model : a case study for the National Palace Museum in Taipai (2004) 4.34

   4.3394766 = sum of:
     4.3394766 = weight(author_txt:chen in 4384) [ClassicSimilarity], result of:
       4.3394766 = score(doc=4384,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         4.339477 = fieldWeight in 4384, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.5 = fieldNorm(doc=4384)
   

2. Chen, C.C.; Chen, H.H.; Chen, K.H.: ¬The design of the XML/Metadata management system (2000) 3.99

   3.9860637 = sum of:
     3.9860637 = weight(author_txt:chen in 5633) [ClassicSimilarity], result of:
       3.9860637 = score(doc=5633,freq=3.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.986064 = fieldWeight in 5633, product of:
           1.7320508 = tf(freq=3.0), with freq of:
             3.0 = termFreq=3.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.375 = fieldNorm(doc=5633)
   

3. Chen, W.Y.: Observations on cataloguing and classification (1991) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 4183) [ClassicSimilarity], result of:
       3.8355918 = score(doc=4183,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 4183, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=4183)
   

4. Chen, H.: Knowledge-based document retrieval : framework and design (1992) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 5282) [ClassicSimilarity], result of:
       3.8355918 = score(doc=5282,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 5282, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=5282)
   

5. Chen, P.S.: On inference rules of logic-based information retrieval systems (1994) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 6730) [ClassicSimilarity], result of:
       3.8355918 = score(doc=6730,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 6730, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=6730)
   

Similar documents (content)

1. Chen, H.; Ng, T.D.; Martinez, J.; Schatz, B.R.: ¬A concept space approach to addressing the vocabulary problem in scientific information retrieval : an experiment on the Worm Community System (1997) 0.41

   0.40964004 = sum of:
     0.40964004 = product of:
       1.2801251 = sum of:
         0.028299076 = weight(abstract_txt:terms in 6560) [ClassicSimilarity], result of:
           0.028299076 = score(doc=6560,freq=4.0), product of:
             0.055986334 = queryWeight, product of:
               1.0382543 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.013335155 = queryNorm
             0.505464 = fieldWeight in 6560, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.08013471 = weight(abstract_txt:molecular in 6560) [ClassicSimilarity], result of:
           0.08013471 = score(doc=6560,freq=2.0), product of:
             0.11205923 = queryWeight, product of:
               1.0386555 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.013335155 = queryNorm
             0.7151103 = fieldWeight in 6560, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.067251466 = weight(abstract_txt:biologists in 6560) [ClassicSimilarity], result of:
           0.067251466 = score(doc=6560,freq=1.0), product of:
             0.12561601 = queryWeight, product of:
               1.0996898 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.013335155 = queryNorm
             0.53537333 = fieldWeight in 6560, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.03783143 = weight(abstract_txt:generation in 6560) [ClassicSimilarity], result of:
           0.03783143 = score(doc=6560,freq=1.0), product of:
             0.107850544 = queryWeight, product of:
               1.4410329 = boost
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.013335155 = queryNorm
             0.35077643 = fieldWeight in 6560, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.038777754 = weight(abstract_txt:experiment in 6560) [ClassicSimilarity], result of:
           0.038777754 = score(doc=6560,freq=1.0), product of:
             0.109641664 = queryWeight, product of:
               1.4529495 = boost
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.013335155 = queryNorm
             0.35367718 = fieldWeight in 6560, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.0600288 = weight(abstract_txt:automatic in 6560) [ClassicSimilarity], result of:
           0.0600288 = score(doc=6560,freq=1.0), product of:
             0.18485744 = queryWeight, product of:
               2.6680636 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.013335155 = queryNorm
             0.32473022 = fieldWeight in 6560, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.19843952 = weight(abstract_txt:thesaurus in 6560) [ClassicSimilarity], result of:
           0.19843952 = score(doc=6560,freq=5.0), product of:
             0.27461424 = queryWeight, product of:
               3.9827669 = boost
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.013335155 = queryNorm
             0.7226119 = fieldWeight in 6560, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
         0.76936245 = weight(abstract_txt:worm in 6560) [ClassicSimilarity], result of:
           0.76936245 = score(doc=6560,freq=3.0), product of:
             0.7561607 = queryWeight, product of:
               6.0330896 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.013335155 = queryNorm
             1.0174589 = fieldWeight in 6560, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=6560)
       0.32 = coord(8/25)
   

2. Tudhope, D.; Blocks, D.; Cunliffe, D.; Binding, C.: Query expansion via conceptual distance in thesaurus indexed collections (2006) 0.10

   0.09672534 = sum of:
     0.09672534 = product of:
       0.40302226 = sum of:
         0.014149538 = weight(abstract_txt:terms in 3215) [ClassicSimilarity], result of:
           0.014149538 = score(doc=3215,freq=1.0), product of:
             0.055986334 = queryWeight, product of:
               1.0382543 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.013335155 = queryNorm
             0.252732 = fieldWeight in 3215, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
         0.024211824 = weight(abstract_txt:useful in 3215) [ClassicSimilarity], result of:
           0.024211824 = score(doc=3215,freq=1.0), product of:
             0.08009502 = queryWeight, product of:
               1.2418395 = boost
               4.83662 = idf(docFreq=957, maxDocs=44421)
               0.013335155 = queryNorm
             0.30228874 = fieldWeight in 3215, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.83662 = idf(docFreq=957, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
         0.03720295 = weight(abstract_txt:browsing in 3215) [ClassicSimilarity], result of:
           0.03720295 = score(doc=3215,freq=1.0), product of:
             0.10665276 = queryWeight, product of:
               1.4330086 = boost
               5.58117 = idf(docFreq=454, maxDocs=44421)
               0.013335155 = queryNorm
             0.34882313 = fieldWeight in 3215, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.58117 = idf(docFreq=454, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
         0.016420778 = weight(abstract_txt:system in 3215) [ClassicSimilarity], result of:
           0.016420778 = score(doc=3215,freq=1.0), product of:
             0.077898 = queryWeight, product of:
               1.7319721 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.013335155 = queryNorm
             0.21079844 = fieldWeight in 3215, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
         0.0600288 = weight(abstract_txt:automatic in 3215) [ClassicSimilarity], result of:
           0.0600288 = score(doc=3215,freq=1.0), product of:
             0.18485744 = queryWeight, product of:
               2.6680636 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.013335155 = queryNorm
             0.32473022 = fieldWeight in 3215, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
         0.25100836 = weight(abstract_txt:thesaurus in 3215) [ClassicSimilarity], result of:
           0.25100836 = score(doc=3215,freq=8.0), product of:
             0.27461424 = queryWeight, product of:
               3.9827669 = boost
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.013335155 = queryNorm
             0.9140398 = fieldWeight in 3215, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.0625 = fieldNorm(doc=3215)
       0.24 = coord(6/25)
   

3. Weiss, A.: Hop, skip, and jump : navigating the World Wide Web (1995) 0.10

   0.096278906 = sum of:
     0.096278906 = product of:
       1.2034863 = sum of:
         0.09300737 = weight(abstract_txt:browsing in 2044) [ClassicSimilarity], result of:
           0.09300737 = score(doc=2044,freq=1.0), product of:
             0.10665276 = queryWeight, product of:
               1.4330086 = boost
               5.58117 = idf(docFreq=454, maxDocs=44421)
               0.013335155 = queryNorm
             0.8720578 = fieldWeight in 2044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.58117 = idf(docFreq=454, maxDocs=44421)
               0.15625 = fieldNorm(doc=2044)
         1.110479 = weight(abstract_txt:worm in 2044) [ClassicSimilarity], result of:
           1.110479 = score(doc=2044,freq=1.0), product of:
             0.7561607 = queryWeight, product of:
               6.0330896 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.013335155 = queryNorm
             1.4685755 = fieldWeight in 2044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.15625 = fieldNorm(doc=2044)
       0.08 = coord(2/25)
   

4. Crouch, C.J.: ¬An approach to the automatic construction of global thesauri (1990) 0.09

   0.09352118 = sum of:
     0.09352118 = product of:
       0.4676059 = sum of:
         0.056747142 = weight(abstract_txt:generation in 4110) [ClassicSimilarity], result of:
           0.056747142 = score(doc=4110,freq=1.0), product of:
             0.107850544 = queryWeight, product of:
               1.4410329 = boost
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.013335155 = queryNorm
             0.52616465 = fieldWeight in 4110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.09375 = fieldNorm(doc=4110)
         0.024631167 = weight(abstract_txt:system in 4110) [ClassicSimilarity], result of:
           0.024631167 = score(doc=4110,freq=1.0), product of:
             0.077898 = queryWeight, product of:
               1.7319721 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.013335155 = queryNorm
             0.31619766 = fieldWeight in 4110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=4110)
         0.070631035 = weight(abstract_txt:researchers in 4110) [ClassicSimilarity], result of:
           0.070631035 = score(doc=4110,freq=1.0), product of:
             0.15722926 = queryWeight, product of:
               2.4606192 = boost
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.013335155 = queryNorm
             0.44922322 = fieldWeight in 4110, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.09375 = fieldNorm(doc=4110)
         0.12734032 = weight(abstract_txt:automatic in 4110) [ClassicSimilarity], result of:
           0.12734032 = score(doc=4110,freq=2.0), product of:
             0.18485744 = queryWeight, product of:
               2.6680636 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.013335155 = queryNorm
             0.68885684 = fieldWeight in 4110, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.09375 = fieldNorm(doc=4110)
         0.18825625 = weight(abstract_txt:thesaurus in 4110) [ClassicSimilarity], result of:
           0.18825625 = score(doc=4110,freq=2.0), product of:
             0.27461424 = queryWeight, product of:
               3.9827669 = boost
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.013335155 = queryNorm
             0.6855298 = fieldWeight in 4110, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.09375 = fieldNorm(doc=4110)
       0.2 = coord(5/25)
   

5. Zhang, J.; Mostafa, J.; Tripathy, H.: Information retrieval by semantic analysis and visualization of the concept space of D-Lib® magazine (2002) 0.08

   0.0838997 = sum of:
     0.0838997 = product of:
       0.2996418 = sum of:
         0.026471363 = weight(abstract_txt:terms in 2211) [ClassicSimilarity], result of:
           0.026471363 = score(doc=2211,freq=14.0), product of:
             0.055986334 = queryWeight, product of:
               1.0382543 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.013335155 = queryNorm
             0.47281832 = fieldWeight in 2211, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.028506616 = weight(abstract_txt:concepts in 2211) [ClassicSimilarity], result of:
           0.028506616 = score(doc=2211,freq=8.0), product of:
             0.07088282 = queryWeight, product of:
               1.168243 = boost
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.013335155 = queryNorm
             0.40216538 = fieldWeight in 2211, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.015017575 = weight(abstract_txt:relevant in 2211) [ClassicSimilarity], result of:
           0.015017575 = score(doc=2211,freq=2.0), product of:
             0.07339454 = queryWeight, product of:
               1.1887611 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.013335155 = queryNorm
             0.20461434 = fieldWeight in 2211, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.03276298 = weight(abstract_txt:generation in 2211) [ClassicSimilarity], result of:
           0.03276298 = score(doc=2211,freq=3.0), product of:
             0.107850544 = queryWeight, product of:
               1.4410329 = boost
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.013335155 = queryNorm
             0.3037813 = fieldWeight in 2211, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.016420778 = weight(abstract_txt:system in 2211) [ClassicSimilarity], result of:
           0.016420778 = score(doc=2211,freq=4.0), product of:
             0.077898 = queryWeight, product of:
               1.7319721 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.013335155 = queryNorm
             0.21079844 = fieldWeight in 2211, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.033295788 = weight(abstract_txt:researchers in 2211) [ClassicSimilarity], result of:
           0.033295788 = score(doc=2211,freq=2.0), product of:
             0.15722926 = queryWeight, product of:
               2.4606192 = boost
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.013335155 = queryNorm
             0.21176584 = fieldWeight in 2211, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
         0.14716668 = weight(abstract_txt:thesaurus in 2211) [ClassicSimilarity], result of:
           0.14716668 = score(doc=2211,freq=11.0), product of:
             0.27461424 = queryWeight, product of:
               3.9827669 = boost
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.013335155 = queryNorm
             0.53590333 = fieldWeight in 2211, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               5.17059 = idf(docFreq=685, maxDocs=44421)
               0.03125 = fieldNorm(doc=2211)
       0.28 = coord(7/25)