Document (#32910)

Author

Yoon, Y.
Lee, G.G.

Title

Efficient implementation of associative classifiers for document classification

Source

Information processing and management. 43(2007) no.2, S.393-405

Year

2007

Abstract

In practical text classification tasks, the ability to interpret the classification result is as important as the ability to classify exactly. Associative classifiers have many favorable characteristics such as rapid training, good classification accuracy, and excellent interpretation. However, associative classifiers also have some obstacles to overcome when they are applied in the area of text classification. The target text collection generally has a very high dimension, thus the training process might take a very long time. We propose a feature selection based on the mutual information between the word and class variables to reduce the space dimension of the associative classifiers. In addition, the training process of the associative classifier produces a huge amount of classification rules, which makes the prediction with a new document ineffective. We resolve this by introducing a new efficient method for storing and pruning classification rules. This method can also be used when predicting a test document. Experimental results using the 20-newsgroups dataset show many benefits of the associative classification in both training and predicting when applied to a real world problem.

Footnote

Beitrag in: Special issue on AIRS2005: Information Retrieval Research in Asia

Theme

Automatisches Klassifizieren

Similar documents (author)

1. Yoon, L.L.: ¬The performance of cited references as an approach to information retrieval (1994) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:yoon in 8218) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 8218, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=8218)
   

2. Yoon, J.W.: Utilizing quantitative users' reactions to represent affective meanings of an image (2010) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:yoon in 571) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 571, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=571)
   

3. Yoon, J.W.: Towards a user-oriented thesaurus for non-domain-specific image collections (2009) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:yoon in 221) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 221, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=221)
   

4. Yoon, K.: Conceptual syntagmatic associations in user tagging (2012) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:yoon in 1240) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 1240, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=1240)
   

5. Yoon, A.: Data reusers' trust development (2017) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:yoon in 4532) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 4532, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=4532)
   

Similar documents (content)

1. Gauch, S.; Chandramouli, A.; Ranganathan, S.: Training a hierarchical classifier using inter document relationships (2009) 0.21

   0.210639 = sum of:
     0.210639 = product of:
       0.87766254 = sum of:
         0.04259722 = weight(abstract_txt:text in 3697) [ClassicSimilarity], result of:
           0.04259722 = score(doc=3697,freq=2.0), product of:
             0.09541135 = queryWeight, product of:
               1.6357621 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014434566 = queryNorm
             0.4464586 = fieldWeight in 3697, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.032535132 = weight(abstract_txt:when in 3697) [ClassicSimilarity], result of:
           0.032535132 = score(doc=3697,freq=1.0), product of:
             0.100444056 = queryWeight, product of:
               1.6783488 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.014434566 = queryNorm
             0.32391295 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.036146756 = weight(abstract_txt:document in 3697) [ClassicSimilarity], result of:
           0.036146756 = score(doc=3697,freq=1.0), product of:
             0.107746236 = queryWeight, product of:
               1.7382858 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.014434566 = queryNorm
             0.33548045 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.16189024 = weight(abstract_txt:training in 3697) [ClassicSimilarity], result of:
           0.16189024 = score(doc=3697,freq=4.0), product of:
             0.20298435 = queryWeight, product of:
               2.7549946 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.014434566 = queryNorm
             0.7975503 = fieldWeight in 3697, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.44959012 = weight(abstract_txt:classifiers in 3697) [ClassicSimilarity], result of:
           0.44959012 = score(doc=3697,freq=3.0), product of:
             0.44140732 = queryWeight, product of:
               4.0626483 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.014434566 = queryNorm
             1.018538 = fieldWeight in 3697, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.15490307 = weight(abstract_txt:classification in 3697) [ClassicSimilarity], result of:
           0.15490307 = score(doc=3697,freq=4.0), product of:
             0.2483317 = queryWeight, product of:
               4.3094373 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.014434566 = queryNorm
             0.6237749 = fieldWeight in 3697, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
       0.24 = coord(6/25)
   

2. Liu, R.-L.: Dynamic category profiling for text filtering and classification (2007) 0.18

   0.17509063 = sum of:
     0.17509063 = product of:
       0.8754531 = sum of:
         0.030120784 = weight(abstract_txt:text in 1900) [ClassicSimilarity], result of:
           0.030120784 = score(doc=1900,freq=1.0), product of:
             0.09541135 = queryWeight, product of:
               1.6357621 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014434566 = queryNorm
             0.3156939 = fieldWeight in 1900, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=1900)
         0.051119234 = weight(abstract_txt:document in 1900) [ClassicSimilarity], result of:
           0.051119234 = score(doc=1900,freq=2.0), product of:
             0.107746236 = queryWeight, product of:
               1.7382858 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.014434566 = queryNorm
             0.47444102 = fieldWeight in 1900, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=1900)
         0.08094512 = weight(abstract_txt:training in 1900) [ClassicSimilarity], result of:
           0.08094512 = score(doc=1900,freq=1.0), product of:
             0.20298435 = queryWeight, product of:
               2.7549946 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.014434566 = queryNorm
             0.39877516 = fieldWeight in 1900, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.078125 = fieldNorm(doc=1900)
         0.63581645 = weight(abstract_txt:classifiers in 1900) [ClassicSimilarity], result of:
           0.63581645 = score(doc=1900,freq=6.0), product of:
             0.44140732 = queryWeight, product of:
               4.0626483 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.014434566 = queryNorm
             1.4404303 = fieldWeight in 1900, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=1900)
         0.077451535 = weight(abstract_txt:classification in 1900) [ClassicSimilarity], result of:
           0.077451535 = score(doc=1900,freq=1.0), product of:
             0.2483317 = queryWeight, product of:
               4.3094373 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.014434566 = queryNorm
             0.31188744 = fieldWeight in 1900, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.078125 = fieldNorm(doc=1900)
       0.2 = coord(5/25)
   

3. Yoon, Y.; Lee, C.; Lee, G.G.: ¬An effective procedure for constructing a hierarchical text classification system (2006) 0.17

   0.16518795 = sum of:
     0.16518795 = product of:
       0.68828315 = sum of:
         0.047995336 = weight(abstract_txt:method in 273) [ClassicSimilarity], result of:
           0.047995336 = score(doc=273,freq=3.0), product of:
             0.07884081 = queryWeight, product of:
               1.2140876 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.014434566 = queryNorm
             0.6087626 = fieldWeight in 273, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
         0.033587575 = weight(abstract_txt:applied in 273) [ClassicSimilarity], result of:
           0.033587575 = score(doc=273,freq=1.0), product of:
             0.089628175 = queryWeight, product of:
               1.2944843 = boost
               4.7967167 = idf(docFreq=996, maxDocs=44421)
               0.014434566 = queryNorm
             0.3747435 = fieldWeight in 273, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7967167 = idf(docFreq=996, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
         0.036303792 = weight(abstract_txt:very in 273) [ClassicSimilarity], result of:
           0.036303792 = score(doc=273,freq=1.0), product of:
             0.09439742 = queryWeight, product of:
               1.3284786 = boost
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.014434566 = queryNorm
             0.3845846 = fieldWeight in 273, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
         0.030120784 = weight(abstract_txt:text in 273) [ClassicSimilarity], result of:
           0.030120784 = score(doc=273,freq=1.0), product of:
             0.09541135 = queryWeight, product of:
               1.6357621 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014434566 = queryNorm
             0.3156939 = fieldWeight in 273, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
         0.36708876 = weight(abstract_txt:classifiers in 273) [ClassicSimilarity], result of:
           0.36708876 = score(doc=273,freq=2.0), product of:
             0.44140732 = queryWeight, product of:
               4.0626483 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.014434566 = queryNorm
             0.83163273 = fieldWeight in 273, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
         0.1731869 = weight(abstract_txt:classification in 273) [ClassicSimilarity], result of:
           0.1731869 = score(doc=273,freq=5.0), product of:
             0.2483317 = queryWeight, product of:
               4.3094373 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.014434566 = queryNorm
             0.6974015 = fieldWeight in 273, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.078125 = fieldNorm(doc=273)
       0.24 = coord(6/25)
   

4. Desale, S.K.; Kumbhar, R.: Research on automatic classification of documents in library environment : a literature review (2013) 0.15

   0.151873 = sum of:
     0.151873 = product of:
       0.6328042 = sum of:
         0.036303792 = weight(abstract_txt:very in 2071) [ClassicSimilarity], result of:
           0.036303792 = score(doc=2071,freq=1.0), product of:
             0.09439742 = queryWeight, product of:
               1.3284786 = boost
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.014434566 = queryNorm
             0.3845846 = fieldWeight in 2071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
         0.030120784 = weight(abstract_txt:text in 2071) [ClassicSimilarity], result of:
           0.030120784 = score(doc=2071,freq=1.0), product of:
             0.09541135 = queryWeight, product of:
               1.6357621 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014434566 = queryNorm
             0.3156939 = fieldWeight in 2071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
         0.036146756 = weight(abstract_txt:document in 2071) [ClassicSimilarity], result of:
           0.036146756 = score(doc=2071,freq=1.0), product of:
             0.107746236 = queryWeight, product of:
               1.7382858 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.014434566 = queryNorm
             0.33548045 = fieldWeight in 2071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
         0.08094512 = weight(abstract_txt:training in 2071) [ClassicSimilarity], result of:
           0.08094512 = score(doc=2071,freq=1.0), product of:
             0.20298435 = queryWeight, product of:
               2.7549946 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.014434566 = queryNorm
             0.39877516 = fieldWeight in 2071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
         0.259571 = weight(abstract_txt:classifiers in 2071) [ClassicSimilarity], result of:
           0.259571 = score(doc=2071,freq=1.0), product of:
             0.44140732 = queryWeight, product of:
               4.0626483 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.014434566 = queryNorm
             0.58805317 = fieldWeight in 2071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
         0.18971677 = weight(abstract_txt:classification in 2071) [ClassicSimilarity], result of:
           0.18971677 = score(doc=2071,freq=6.0), product of:
             0.2483317 = queryWeight, product of:
               4.3094373 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.014434566 = queryNorm
             0.7639652 = fieldWeight in 2071, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.078125 = fieldNorm(doc=2071)
       0.24 = coord(6/25)
   

5. Liu, R.-L.: Context-based term frequency assessment for text classification (2010) 0.15

   0.15038182 = sum of:
     0.15038182 = product of:
       0.7519091 = sum of:
         0.058927268 = weight(abstract_txt:efficient in 318) [ClassicSimilarity], result of:
           0.058927268 = score(doc=318,freq=1.0), product of:
             0.1303776 = queryWeight, product of:
               1.5612627 = boost
               5.7852654 = idf(docFreq=370, maxDocs=44421)
               0.014434566 = queryNorm
             0.45197386 = fieldWeight in 318, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7852654 = idf(docFreq=370, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.06024157 = weight(abstract_txt:text in 318) [ClassicSimilarity], result of:
           0.06024157 = score(doc=318,freq=4.0), product of:
             0.09541135 = queryWeight, product of:
               1.6357621 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014434566 = queryNorm
             0.6313878 = fieldWeight in 318, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.036146756 = weight(abstract_txt:document in 318) [ClassicSimilarity], result of:
           0.036146756 = score(doc=318,freq=1.0), product of:
             0.107746236 = queryWeight, product of:
               1.7382858 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.014434566 = queryNorm
             0.33548045 = fieldWeight in 318, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.519142 = weight(abstract_txt:classifiers in 318) [ClassicSimilarity], result of:
           0.519142 = score(doc=318,freq=4.0), product of:
             0.44140732 = queryWeight, product of:
               4.0626483 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.014434566 = queryNorm
             1.1761063 = fieldWeight in 318, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
         0.077451535 = weight(abstract_txt:classification in 318) [ClassicSimilarity], result of:
           0.077451535 = score(doc=318,freq=1.0), product of:
             0.2483317 = queryWeight, product of:
               4.3094373 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.014434566 = queryNorm
             0.31188744 = fieldWeight in 318, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.078125 = fieldNorm(doc=318)
       0.2 = coord(5/25)