Document (#33498)

Author

Srinivasan, P.

Title

Text mining in biomedicine : challenges and opportunities

Source

Knowledge organization, information systems and other essays: Professor A. Neelameghan Festschrift. Ed. by K.S. Raghavan and K.N. Prasad

Imprint

New Delhi : Ess Ess Publications

Year

2006

Pages

S.221-236

Abstract

Text mining is about making serendipity more likely. Serendipity, the chance discovery of interesting ideas, has been responsible for many discoveries in science. Text mining systems strive to explore large text collections, separate the potentially meaningfull connections from a vast and mostly noisy background of random associations. In this paper we provide a summary of our text mining approach and also illustrate briefly some of the experiments we have conducted with this approach. In particular we use a profile-based text mining method. We have used these profiles to explore the global distribution of disease research, replicate discoveries made by others and propose new hypotheses. Text mining holds much potential that has yet to be tapped.

Theme

Data Mining

Field

Medizin

Similar documents (author)

1. Srinivasan, P.: Expert interface to Library of Congress Subject Headings (1990/91) 5.41

   5.4105906 = sum of:
     5.4105906 = weight(author_txt:srinivasan in 2208) [ClassicSimilarity], result of:
       5.4105906 = fieldWeight in 2208, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.656945 = idf(docFreq=20, maxDocs=44421)
         0.625 = fieldNorm(doc=2208)
   

2. Srinivasan, P.: Query expansion and MEDLINE (1996) 5.41

   5.4105906 = sum of:
     5.4105906 = weight(author_txt:srinivasan in 67) [ClassicSimilarity], result of:
       5.4105906 = fieldWeight in 67, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.656945 = idf(docFreq=20, maxDocs=44421)
         0.625 = fieldNorm(doc=67)
   

3. Srinivasan, P.: Intelligent information retrieval using rough set approximations (1989) 5.41

   5.4105906 = sum of:
     5.4105906 = weight(author_txt:srinivasan in 2594) [ClassicSimilarity], result of:
       5.4105906 = fieldWeight in 2594, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.656945 = idf(docFreq=20, maxDocs=44421)
         0.625 = fieldNorm(doc=2594)
   

4. Srinivasan, P.: On generalizing the Two-Poisson Model (1990) 5.41

   5.4105906 = sum of:
     5.4105906 = weight(author_txt:srinivasan in 2948) [ClassicSimilarity], result of:
       5.4105906 = fieldWeight in 2948, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.656945 = idf(docFreq=20, maxDocs=44421)
         0.625 = fieldNorm(doc=2948)
   

5. Srinivasan, P.: Optimal document-indexing vocabulary for MEDLINE (1996) 5.41

   5.4105906 = sum of:
     5.4105906 = weight(author_txt:srinivasan in 6702) [ClassicSimilarity], result of:
       5.4105906 = fieldWeight in 6702, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.656945 = idf(docFreq=20, maxDocs=44421)
         0.625 = fieldNorm(doc=6702)
   

Similar documents (content)

1. Srinivasan, P.: Text mining : generating hypotheses from MEDLINE (2004) 0.29

   0.29298112 = sum of:
     0.29298112 = product of:
       1.0463611 = sum of:
         0.051663425 = weight(abstract_txt:connections in 3225) [ClassicSimilarity], result of:
           0.051663425 = score(doc=3225,freq=1.0), product of:
             0.10303282 = queryWeight, product of:
               1.0030456 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.016004326 = queryNorm
             0.5014269 = fieldWeight in 3225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.08849711 = weight(abstract_txt:profiles in 3225) [ClassicSimilarity], result of:
           0.08849711 = score(doc=3225,freq=2.0), product of:
             0.11707465 = queryWeight, product of:
               1.0692132 = boost
               6.8416553 = idf(docFreq=128, maxDocs=44421)
               0.016004326 = queryNorm
             0.75590324 = fieldWeight in 3225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8416553 = idf(docFreq=128, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.06784912 = weight(abstract_txt:chance in 3225) [ClassicSimilarity], result of:
           0.06784912 = score(doc=3225,freq=1.0), product of:
             0.123561434 = queryWeight, product of:
               1.0984349 = boost
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.016004326 = queryNorm
             0.54911244 = fieldWeight in 3225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.07135255 = weight(abstract_txt:hypotheses in 3225) [ClassicSimilarity], result of:
           0.07135255 = score(doc=3225,freq=1.0), product of:
             0.1277791 = queryWeight, product of:
               1.1170247 = boost
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.016004326 = queryNorm
             0.5584055 = fieldWeight in 3225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.22084117 = weight(abstract_txt:discoveries in 3225) [ClassicSimilarity], result of:
           0.22084117 = score(doc=3225,freq=1.0), product of:
             0.34191397 = queryWeight, product of:
               2.584082 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.016004326 = queryNorm
             0.6458969 = fieldWeight in 3225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.15632114 = weight(abstract_txt:text in 3225) [ClassicSimilarity], result of:
           0.15632114 = score(doc=3225,freq=3.0), product of:
             0.28588468 = queryWeight, product of:
               4.4205604 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.016004326 = queryNorm
             0.5467979 = fieldWeight in 3225, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
         0.38983658 = weight(abstract_txt:mining in 3225) [ClassicSimilarity], result of:
           0.38983658 = score(doc=3225,freq=2.0), product of:
             0.57167464 = queryWeight, product of:
               5.7873926 = boost
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.016004326 = queryNorm
             0.68192035 = fieldWeight in 3225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.078125 = fieldNorm(doc=3225)
       0.28 = coord(7/25)
   

2. Qiu, X.Y.; Srinivasan, P.; Hu, Y.: Supervised learning models to predict firm performance with annual reports : an empirical study (2014) 0.17

   0.16527954 = sum of:
     0.16527954 = product of:
       0.82639766 = sum of:
         0.0127985645 = weight(abstract_txt:have in 2205) [ClassicSimilarity], result of:
           0.0127985645 = score(doc=2205,freq=1.0), product of:
             0.051204048 = queryWeight, product of:
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.016004326 = queryNorm
             0.2499522 = fieldWeight in 2205, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.078125 = fieldNorm(doc=2205)
         0.12099605 = weight(abstract_txt:biomedicine in 2205) [ClassicSimilarity], result of:
           0.12099605 = score(doc=2205,freq=1.0), product of:
             0.1817053 = queryWeight, product of:
               1.3320382 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.016004326 = queryNorm
             0.6658917 = fieldWeight in 2205, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.078125 = fieldNorm(doc=2205)
         0.058831524 = weight(abstract_txt:explore in 2205) [ClassicSimilarity], result of:
           0.058831524 = score(doc=2205,freq=1.0), product of:
             0.1415588 = queryWeight, product of:
               1.6627091 = boost
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.016004326 = queryNorm
             0.4155978 = fieldWeight in 2205, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.078125 = fieldNorm(doc=2205)
         0.15632114 = weight(abstract_txt:text in 2205) [ClassicSimilarity], result of:
           0.15632114 = score(doc=2205,freq=3.0), product of:
             0.28588468 = queryWeight, product of:
               4.4205604 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.016004326 = queryNorm
             0.5467979 = fieldWeight in 2205, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=2205)
         0.47745034 = weight(abstract_txt:mining in 2205) [ClassicSimilarity], result of:
           0.47745034 = score(doc=2205,freq=3.0), product of:
             0.57167464 = queryWeight, product of:
               5.7873926 = boost
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.016004326 = queryNorm
             0.83517843 = fieldWeight in 2205, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.078125 = fieldNorm(doc=2205)
       0.2 = coord(5/25)
   

3. Tonkin, E.L.; Tourte, G.J.L.: Working with text. tools, techniques and approaches for text mining (2016) 0.15

   0.15155205 = sum of:
     0.15155205 = product of:
       0.9472003 = sum of:
         0.010238851 = weight(abstract_txt:have in 19) [ClassicSimilarity], result of:
           0.010238851 = score(doc=19,freq=1.0), product of:
             0.051204048 = queryWeight, product of:
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.016004326 = queryNorm
             0.19996175 = fieldWeight in 19, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.0625 = fieldNorm(doc=19)
         0.047065217 = weight(abstract_txt:explore in 19) [ClassicSimilarity], result of:
           0.047065217 = score(doc=19,freq=1.0), product of:
             0.1415588 = queryWeight, product of:
               1.6627091 = boost
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.016004326 = queryNorm
             0.33247823 = fieldWeight in 19, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.0625 = fieldNorm(doc=19)
         0.22832166 = weight(abstract_txt:text in 19) [ClassicSimilarity], result of:
           0.22832166 = score(doc=19,freq=10.0), product of:
             0.28588468 = queryWeight, product of:
               4.4205604 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.016004326 = queryNorm
             0.7986495 = fieldWeight in 19, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=19)
         0.6615746 = weight(abstract_txt:mining in 19) [ClassicSimilarity], result of:
           0.6615746 = score(doc=19,freq=9.0), product of:
             0.57167464 = queryWeight, product of:
               5.7873926 = boost
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.016004326 = queryNorm
             1.1572572 = fieldWeight in 19, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.0625 = fieldNorm(doc=19)
       0.16 = coord(4/25)
   

4. Björneborn, L.: Three key affordances for serendipity : toward a framework connecting environmental and personal factors in serendipitous encounters (2017) 0.14

   0.1370133 = sum of:
     0.1370133 = product of:
       0.68506646 = sum of:
         0.007679138 = weight(abstract_txt:have in 4947) [ClassicSimilarity], result of:
           0.007679138 = score(doc=4947,freq=1.0), product of:
             0.051204048 = queryWeight, product of:
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.016004326 = queryNorm
             0.1499713 = fieldWeight in 4947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.046875 = fieldNorm(doc=4947)
         0.053690203 = weight(abstract_txt:connections in 4947) [ClassicSimilarity], result of:
           0.053690203 = score(doc=4947,freq=3.0), product of:
             0.10303282 = queryWeight, product of:
               1.0030456 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.016004326 = queryNorm
             0.5210981 = fieldWeight in 4947, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.046875 = fieldNorm(doc=4947)
         0.021265991 = weight(abstract_txt:approach in 4947) [ClassicSimilarity], result of:
           0.021265991 = score(doc=4947,freq=3.0), product of:
             0.0700131 = queryWeight, product of:
               1.1693311 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016004326 = queryNorm
             0.30374303 = fieldWeight in 4947, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.046875 = fieldNorm(doc=4947)
         0.0499202 = weight(abstract_txt:explore in 4947) [ClassicSimilarity], result of:
           0.0499202 = score(doc=4947,freq=2.0), product of:
             0.1415588 = queryWeight, product of:
               1.6627091 = boost
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.016004326 = queryNorm
             0.3526464 = fieldWeight in 4947, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.046875 = fieldNorm(doc=4947)
         0.5525109 = weight(abstract_txt:serendipity in 4947) [ClassicSimilarity], result of:
           0.5525109 = score(doc=4947,freq=19.0), product of:
             0.3319495 = queryWeight, product of:
               2.5461493 = boost
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.016004326 = queryNorm
             1.6644427 = fieldWeight in 4947, product of:
               4.358899 = tf(freq=19.0), with freq of:
                 19.0 = termFreq=19.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.046875 = fieldNorm(doc=4947)
       0.2 = coord(5/25)
   

5. Gordon, M.D.; Dumais, S.: Using latent semantic indexing for literature based discovery (1998) 0.12

   0.121671036 = sum of:
     0.121671036 = product of:
       0.60835516 = sum of:
         0.015358276 = weight(abstract_txt:have in 5892) [ClassicSimilarity], result of:
           0.015358276 = score(doc=5892,freq=1.0), product of:
             0.051204048 = queryWeight, product of:
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.016004326 = queryNorm
             0.2999426 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.061996106 = weight(abstract_txt:connections in 5892) [ClassicSimilarity], result of:
           0.061996106 = score(doc=5892,freq=1.0), product of:
             0.10303282 = queryWeight, product of:
               1.0030456 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.016004326 = queryNorm
             0.6017122 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.08562306 = weight(abstract_txt:hypotheses in 5892) [ClassicSimilarity], result of:
           0.08562306 = score(doc=5892,freq=1.0), product of:
             0.1277791 = queryWeight, product of:
               1.1170247 = boost
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.016004326 = queryNorm
             0.6700866 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.07059783 = weight(abstract_txt:explore in 5892) [ClassicSimilarity], result of:
           0.07059783 = score(doc=5892,freq=1.0), product of:
             0.1415588 = queryWeight, product of:
               1.6627091 = boost
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.016004326 = queryNorm
             0.49871734 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3196516 = idf(docFreq=590, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.3747799 = weight(abstract_txt:discoveries in 5892) [ClassicSimilarity], result of:
           0.3747799 = score(doc=5892,freq=2.0), product of:
             0.34191397 = queryWeight, product of:
               2.584082 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.016004326 = queryNorm
             1.0961235 = fieldWeight in 5892, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
       0.2 = coord(5/25)