Document (#32936)

Author

Tseng, Y.-H.
Lin, C.-J.
Lin, Y.-I.

Title

Text mining techniques for patent analysis

Source

Information processing and management. 43(2007) no.5, S.1216-1247

Year

2007

Abstract

Patent documents contain important research results. However, they are lengthy and rich in technical terminology such that it takes a lot of human efforts for analyses. Automatic tools for assisting patent engineers or decision makers in patent analysis are in great demand. This paper describes a series of text mining techniques that conforms to the analytical process used by patent analysts. These techniques include text segmentation, summary extraction, feature selection, term association, cluster generation, topic identification, and information mapping. The issues of efficiency and effectiveness are considered in the design of these techniques. Some important features of the proposed methodology include a rigorous approach to verify the usefulness of segment extracts as the document surrogates, a corpus- and dictionary-free algorithm for keyphrase extraction, an efficient co-word analysis method that can be applied to large volume of patents, and an automatic procedure to create generic cluster titles for ease of result interpretation. Evaluation of these techniques was conducted. The results confirm that the machine-generated summaries do preserve more important content words than some other sections for classification. To demonstrate the feasibility, the proposed methodology was applied to a real-world patent set for domain analysis and mapping, which shows that our approach is more effective than existing classification systems. The attempt in this paper to automate the whole process not only helps create final patent maps for topic analyses, but also facilitates or improves other patent analysis tasks such as patent classification, organization, knowledge sharing, and prior art searches.

Footnote

Beitrag innerhalb eines Themenschwerpunkt "special issue on patent processing"

Field

Patentinformation

Similar documents (author)

1. Tseng, Y.-H.: Automatic cataloguing and searching for retrospective data by use of OCR text (2001) 4.57

   4.5682592 = sum of:
     4.5682592 = weight(author_txt:tseng in 5420) [ClassicSimilarity], result of:
       4.5682592 = fieldWeight in 5420, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.5 = fieldNorm(doc=5420)
   

2. Tseng, Y.-H.: Keyword extraction techniques and relevance feedback (1997) 4.57

   4.5682592 = sum of:
     4.5682592 = weight(author_txt:tseng in 2830) [ClassicSimilarity], result of:
       4.5682592 = fieldWeight in 2830, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.5 = fieldNorm(doc=2830)
   

3. Tseng, Y.-H.: Solving vocabulary problems with interactive query expansion (1998) 4.57

   4.5682592 = sum of:
     4.5682592 = weight(author_txt:tseng in 6159) [ClassicSimilarity], result of:
       4.5682592 = fieldWeight in 6159, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.5 = fieldNorm(doc=6159)
   

4. Tseng, Y.H.; Lin, Y.I.: Evaluation of fuzzy search, term suggestion, and term relevance feedback in an OPAC system (1998) 4.57

   4.5682592 = sum of:
     4.5682592 = weight(author_txt:tseng in 430) [ClassicSimilarity], result of:
       4.5682592 = fieldWeight in 430, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.5 = fieldNorm(doc=430)
   

5. Tseng, Y.-H.: Automatic thesaurus generation for Chinese documents (2002) 4.57

   4.5682592 = sum of:
     4.5682592 = weight(author_txt:tseng in 226) [ClassicSimilarity], result of:
       4.5682592 = fieldWeight in 226, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.5 = fieldNorm(doc=226)
   

Similar documents (content)

1. Kim, J.-H.; Choi, K.-S.: Patent document categorization based on semantic structural information (2007) 0.33

   0.33097115 = sum of:
     0.33097115 = product of:
       1.1820399 = sum of:
         0.015680617 = weight(abstract_txt:process in 1933) [ClassicSimilarity], result of:
           0.015680617 = score(doc=1933,freq=1.0), product of:
             0.06196461 = queryWeight, product of:
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.015303977 = queryNorm
             0.25305763 = fieldWeight in 1933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         0.011426022 = weight(abstract_txt:these in 1933) [ClassicSimilarity], result of:
           0.011426022 = score(doc=1933,freq=1.0), product of:
             0.057437483 = queryWeight, product of:
               1.1791565 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.015303977 = queryNorm
             0.19892971 = fieldWeight in 1933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         0.03313393 = weight(abstract_txt:automatic in 1933) [ClassicSimilarity], result of:
           0.03313393 = score(doc=1933,freq=1.0), product of:
             0.10203526 = queryWeight, product of:
               1.2832264 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.015303977 = queryNorm
             0.32473022 = fieldWeight in 1933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         0.011047337 = weight(abstract_txt:that in 1933) [ClassicSimilarity], result of:
           0.011047337 = score(doc=1933,freq=2.0), product of:
             0.0528498 = queryWeight, product of:
               1.4602251 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015303977 = queryNorm
             0.20903271 = fieldWeight in 1933, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         0.022545496 = weight(abstract_txt:classification in 1933) [ClassicSimilarity], result of:
           0.022545496 = score(doc=1933,freq=1.0), product of:
             0.0903591 = queryWeight, product of:
               1.4789712 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.015303977 = queryNorm
             0.24950996 = fieldWeight in 1933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         0.02644844 = weight(abstract_txt:important in 1933) [ClassicSimilarity], result of:
           0.02644844 = score(doc=1933,freq=1.0), product of:
             0.100507565 = queryWeight, product of:
               1.5598152 = boost
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.015303977 = queryNorm
             0.26314875 = fieldWeight in 1933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
         1.061758 = weight(abstract_txt:patent in 1933) [ClassicSimilarity], result of:
           1.061758 = score(doc=1933,freq=9.0), product of:
             0.81703746 = queryWeight, product of:
               7.70292 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.015303977 = queryNorm
             1.2995218 = fieldWeight in 1933, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=1933)
       0.28 = coord(7/25)
   

2. Lawson, M.: Automatic extraction of citations from the text of English-language patents : an example of template mining (1996) 0.31

   0.3079359 = sum of:
     0.3079359 = product of:
       1.099771 = sum of:
         0.011426022 = weight(abstract_txt:these in 3654) [ClassicSimilarity], result of:
           0.011426022 = score(doc=3654,freq=1.0), product of:
             0.057437483 = queryWeight, product of:
               1.1791565 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.015303977 = queryNorm
             0.19892971 = fieldWeight in 3654, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.026270123 = weight(abstract_txt:include in 3654) [ClassicSimilarity], result of:
           0.026270123 = score(doc=3654,freq=1.0), product of:
             0.08740636 = queryWeight, product of:
               1.1876806 = boost
               4.808826 = idf(docFreq=984, maxDocs=44421)
               0.015303977 = queryNorm
             0.30055162 = fieldWeight in 3654, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.808826 = idf(docFreq=984, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.013530169 = weight(abstract_txt:that in 3654) [ClassicSimilarity], result of:
           0.013530169 = score(doc=3654,freq=3.0), product of:
             0.0528498 = queryWeight, product of:
               1.4602251 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015303977 = queryNorm
             0.25601172 = fieldWeight in 3654, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.046762172 = weight(abstract_txt:text in 3654) [ClassicSimilarity], result of:
           0.046762172 = score(doc=3654,freq=4.0), product of:
             0.09257815 = queryWeight, product of:
               1.4970214 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.015303977 = queryNorm
             0.50511026 = fieldWeight in 3654, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.055543188 = weight(abstract_txt:mining in 3654) [ClassicSimilarity], result of:
           0.055543188 = score(doc=3654,freq=1.0), product of:
             0.14398663 = queryWeight, product of:
               1.5243659 = boost
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.015303977 = queryNorm
             0.3857524 = fieldWeight in 3654, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1720386 = idf(docFreq=251, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.07931757 = weight(abstract_txt:extraction in 3654) [ClassicSimilarity], result of:
           0.07931757 = score(doc=3654,freq=2.0), product of:
             0.1449232 = queryWeight, product of:
               1.5293155 = boost
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.015303977 = queryNorm
             0.5473076 = fieldWeight in 3654, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
         0.86692184 = weight(abstract_txt:patent in 3654) [ClassicSimilarity], result of:
           0.86692184 = score(doc=3654,freq=6.0), product of:
             0.81703746 = queryWeight, product of:
               7.70292 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.015303977 = queryNorm
             1.0610552 = fieldWeight in 3654, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=3654)
       0.28 = coord(7/25)
   

3. Kang, I.-S.; Na, S.-H.; Kim, J.; Lee, J.-H.: Cluster-based patent retrieval (2007) 0.30

   0.29915148 = sum of:
     0.29915148 = product of:
       1.2464645 = sum of:
         0.011426022 = weight(abstract_txt:these in 1930) [ClassicSimilarity], result of:
           0.011426022 = score(doc=1930,freq=1.0), product of:
             0.057437483 = queryWeight, product of:
               1.1791565 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.015303977 = queryNorm
             0.19892971 = fieldWeight in 1930, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
         0.013530169 = weight(abstract_txt:that in 1930) [ClassicSimilarity], result of:
           0.013530169 = score(doc=1930,freq=3.0), product of:
             0.0528498 = queryWeight, product of:
               1.4602251 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015303977 = queryNorm
             0.25601172 = fieldWeight in 1930, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
         0.031884145 = weight(abstract_txt:classification in 1930) [ClassicSimilarity], result of:
           0.031884145 = score(doc=1930,freq=2.0), product of:
             0.0903591 = queryWeight, product of:
               1.4789712 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.015303977 = queryNorm
             0.35286036 = fieldWeight in 1930, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
         0.17549103 = weight(abstract_txt:cluster in 1930) [ClassicSimilarity], result of:
           0.17549103 = score(doc=1930,freq=7.0), product of:
             0.1620711 = queryWeight, product of:
               1.617264 = boost
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.015303977 = queryNorm
             1.0828028 = fieldWeight in 1930, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
         0.077750534 = weight(abstract_txt:techniques in 1930) [ClassicSimilarity], result of:
           0.077750534 = score(doc=1930,freq=2.0), product of:
             0.19409181 = queryWeight, product of:
               2.7983482 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.015303977 = queryNorm
             0.40058637 = fieldWeight in 1930, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
         0.93638253 = weight(abstract_txt:patent in 1930) [ClassicSimilarity], result of:
           0.93638253 = score(doc=1930,freq=7.0), product of:
             0.81703746 = queryWeight, product of:
               7.70292 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.015303977 = queryNorm
             1.1460705 = fieldWeight in 1930, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=1930)
       0.24 = coord(6/25)
   

4. Lai, K.-K.; Wu, S.-J.: Using the patent co-citation approach to establish a new patent classification system (2005) 0.29

   0.294428 = sum of:
     0.294428 = product of:
       1.2267833 = sum of:
         0.023115337 = weight(abstract_txt:proposed in 2013) [ClassicSimilarity], result of:
           0.023115337 = score(doc=2013,freq=1.0), product of:
             0.080260485 = queryWeight, product of:
               1.1380963 = boost
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.015303977 = queryNorm
             0.28800395 = fieldWeight in 2013, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
         0.031774018 = weight(abstract_txt:create in 2013) [ClassicSimilarity], result of:
           0.031774018 = score(doc=2013,freq=1.0), product of:
             0.09922392 = queryWeight, product of:
               1.2654247 = boost
               5.123606 = idf(docFreq=718, maxDocs=44421)
               0.015303977 = queryNorm
             0.3202254 = fieldWeight in 2013, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.123606 = idf(docFreq=718, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
         0.007811647 = weight(abstract_txt:that in 2013) [ClassicSimilarity], result of:
           0.007811647 = score(doc=2013,freq=1.0), product of:
             0.0528498 = queryWeight, product of:
               1.4602251 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015303977 = queryNorm
             0.14780845 = fieldWeight in 2013, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
         0.045090992 = weight(abstract_txt:classification in 2013) [ClassicSimilarity], result of:
           0.045090992 = score(doc=2013,freq=4.0), product of:
             0.0903591 = queryWeight, product of:
               1.4789712 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.015303977 = queryNorm
             0.49901992 = fieldWeight in 2013, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
         0.057233304 = weight(abstract_txt:analysis in 2013) [ClassicSimilarity], result of:
           0.057233304 = score(doc=2013,freq=4.0), product of:
             0.12559167 = queryWeight, product of:
               2.251016 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.015303977 = queryNorm
             0.4557094 = fieldWeight in 2013, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
         1.061758 = weight(abstract_txt:patent in 2013) [ClassicSimilarity], result of:
           1.061758 = score(doc=2013,freq=9.0), product of:
             0.81703746 = queryWeight, product of:
               7.70292 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.015303977 = queryNorm
             1.2995218 = fieldWeight in 2013, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=2013)
       0.24 = coord(6/25)
   

5. Liu, D.-R.; Shih, M.-J.: Hybrid-patent classification based on patent-network analysis (2011) 0.29

   0.29216492 = sum of:
     0.29216492 = product of:
       1.4608246 = sum of:
         0.032690022 = weight(abstract_txt:proposed in 189) [ClassicSimilarity], result of:
           0.032690022 = score(doc=189,freq=2.0), product of:
             0.080260485 = queryWeight, product of:
               1.1380963 = boost
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.015303977 = queryNorm
             0.4072991 = fieldWeight in 189, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.0625 = fieldNorm(doc=189)
         0.015623294 = weight(abstract_txt:that in 189) [ClassicSimilarity], result of:
           0.015623294 = score(doc=189,freq=4.0), product of:
             0.0528498 = queryWeight, product of:
               1.4602251 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015303977 = queryNorm
             0.2956169 = fieldWeight in 189, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=189)
         0.059649773 = weight(abstract_txt:classification in 189) [ClassicSimilarity], result of:
           0.059649773 = score(doc=189,freq=7.0), product of:
             0.0903591 = queryWeight, product of:
               1.4789712 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.015303977 = queryNorm
             0.6601413 = fieldWeight in 189, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.0625 = fieldNorm(doc=189)
         0.028616652 = weight(abstract_txt:analysis in 189) [ClassicSimilarity], result of:
           0.028616652 = score(doc=189,freq=1.0), product of:
             0.12559167 = queryWeight, product of:
               2.251016 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.015303977 = queryNorm
             0.2278547 = fieldWeight in 189, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=189)
         1.3242449 = weight(abstract_txt:patent in 189) [ClassicSimilarity], result of:
           1.3242449 = score(doc=189,freq=14.0), product of:
             0.81703746 = queryWeight, product of:
               7.70292 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.015303977 = queryNorm
             1.6207885 = fieldWeight in 189, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=189)
       0.2 = coord(5/25)