Document (#36759)

Author

Cortez, E.
Herrera, M.R.
Silva, A.S. da
Moura, E.S. de
Neubert, M.

Title

Lightweight methods for large-scale product categorization

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.9, S.1839-1848

Year

2011

Abstract

In this article, we present a study about classification methods for large-scale categorization of product offers on e-shopping web sites. We present a study about the performance of previously proposed approaches and deployed a probabilistic approach to model the classification problem. We also studied an alternative way of modeling information about the description of product offers and investigated the usage of price and store of product offers as features adopted in the classification process. Our experiments used two collections of over a million product offers previously categorized by human editors and taxonomies of hundreds of categories from a real e-shopping web site. In these experiments, our method achieved an improvement of up to 9% in the quality of the categorization in comparison with the best baseline we have found.

Theme

Automatisches Klassifizieren

Area

Informationswirtschaft

Similar documents (author)

1. Cortez, E.; Silva, A.S. da; Gonçalves, M.A.; Mesquita, F.; Moura, E.S. de: ¬A flexible approach for extracting metadata from bibliographic citations (2009) 1.67

   1.674741 = sum of:
     1.674741 = product of:
       2.791235 = sum of:
         0.59919703 = weight(author_txt:silva in 3848) [ClassicSimilarity], result of:
           0.59919703 = score(doc=3848,freq=1.0), product of:
             0.3190692 = queryWeight, product of:
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.04247566 = queryNorm
             1.8779532 = fieldWeight in 3848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.25 = fieldNorm(doc=3848)
         0.932721 = weight(author_txt:moura in 3848) [ClassicSimilarity], result of:
           0.932721 = score(doc=3848,freq=1.0), product of:
             0.42855474 = queryWeight, product of:
               1.1589394 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.04247566 = queryNorm
             2.1764338 = fieldWeight in 3848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.25 = fieldNorm(doc=3848)
         1.2593169 = weight(author_txt:cortez in 3848) [ClassicSimilarity], result of:
           1.2593169 = score(doc=3848,freq=1.0), product of:
             0.5235142 = queryWeight, product of:
               1.2809194 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.04247566 = queryNorm
             2.4055066 = fieldWeight in 3848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.25 = fieldNorm(doc=3848)
       0.6 = coord(3/5)
   

2. Cortez, E.M.: Use of metadata vocabularies in data retrieval (1999) 0.63

   0.6296584 = sum of:
     0.6296584 = product of:
       3.148292 = sum of:
         3.148292 = weight(author_txt:cortez in 5057) [ClassicSimilarity], result of:
           3.148292 = score(doc=5057,freq=1.0), product of:
             0.5235142 = queryWeight, product of:
               1.2809194 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.04247566 = queryNorm
             6.0137663 = fieldWeight in 5057, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=5057)
       0.2 = coord(1/5)
   

3. Cortez, E.M.: Planning and implementing a high performance knowledge base (1999) 0.63

   0.6296584 = sum of:
     0.6296584 = product of:
       3.148292 = sum of:
         3.148292 = weight(author_txt:cortez in 551) [ClassicSimilarity], result of:
           3.148292 = score(doc=551,freq=1.0), product of:
             0.5235142 = queryWeight, product of:
               1.2809194 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.04247566 = queryNorm
             6.0137663 = fieldWeight in 551, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=551)
       0.2 = coord(1/5)
   

4. Moura, E.S. de; Fernandes, D.; Ribeiro-Neto, B.; Silva, A.S. da; Gonçalves, M.A.: Using structural information to improve search in Web collections (2010) 0.61

   0.6127672 = sum of:
     0.6127672 = product of:
       1.531918 = sum of:
         0.59919703 = weight(author_txt:silva in 119) [ClassicSimilarity], result of:
           0.59919703 = score(doc=119,freq=1.0), product of:
             0.3190692 = queryWeight, product of:
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.04247566 = queryNorm
             1.8779532 = fieldWeight in 119, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.25 = fieldNorm(doc=119)
         0.932721 = weight(author_txt:moura in 119) [ClassicSimilarity], result of:
           0.932721 = score(doc=119,freq=1.0), product of:
             0.42855474 = queryWeight, product of:
               1.1589394 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.04247566 = queryNorm
             2.1764338 = fieldWeight in 119, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.25 = fieldNorm(doc=119)
       0.4 = coord(2/5)
   

5. Costa Carvalho, A. da; Rossi, C.; Moura, E.S. de; Silva, A.S. da; Fernandes, D.: LePrEF: Learn to precompute evidence fusion for efficient query evaluation (2012) 0.61

   0.6127672 = sum of:
     0.6127672 = product of:
       1.531918 = sum of:
         0.59919703 = weight(author_txt:silva in 1278) [ClassicSimilarity], result of:
           0.59919703 = score(doc=1278,freq=1.0), product of:
             0.3190692 = queryWeight, product of:
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.04247566 = queryNorm
             1.8779532 = fieldWeight in 1278, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.25 = fieldNorm(doc=1278)
         0.932721 = weight(author_txt:moura in 1278) [ClassicSimilarity], result of:
           0.932721 = score(doc=1278,freq=1.0), product of:
             0.42855474 = queryWeight, product of:
               1.1589394 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.04247566 = queryNorm
             2.1764338 = fieldWeight in 1278, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.25 = fieldNorm(doc=1278)
       0.4 = coord(2/5)
   

Similar documents (content)

1. Li, Y.; Xu, S.; Luo, X.; Lin, S.: ¬A new algorithm for product image search based on salient edge characterization (2014) 0.19

   0.19098671 = sum of:
     0.19098671 = product of:
       0.9549335 = sum of:
         0.030060098 = weight(abstract_txt:large in 2552) [ClassicSimilarity], result of:
           0.030060098 = score(doc=2552,freq=1.0), product of:
             0.10826734 = queryWeight, product of:
               1.4450177 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016865972 = queryNorm
             0.27764696 = fieldWeight in 2552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=2552)
         0.0517663 = weight(abstract_txt:experiments in 2552) [ClassicSimilarity], result of:
           0.0517663 = score(doc=2552,freq=1.0), product of:
             0.1555495 = queryWeight, product of:
               1.7320433 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.016865972 = queryNorm
             0.3327963 = fieldWeight in 2552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=2552)
         0.0560893 = weight(abstract_txt:scale in 2552) [ClassicSimilarity], result of:
           0.0560893 = score(doc=2552,freq=1.0), product of:
             0.16409318 = queryWeight, product of:
               1.7789744 = boost
               5.4690194 = idf(docFreq=508, maxDocs=44421)
               0.016865972 = queryNorm
             0.3418137 = fieldWeight in 2552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4690194 = idf(docFreq=508, maxDocs=44421)
               0.0625 = fieldNorm(doc=2552)
         0.26493964 = weight(abstract_txt:shopping in 2552) [ClassicSimilarity], result of:
           0.26493964 = score(doc=2552,freq=2.0), product of:
             0.36665574 = queryWeight, product of:
               2.6592164 = boost
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.016865972 = queryNorm
             0.7225842 = fieldWeight in 2552, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.0625 = fieldNorm(doc=2552)
         0.5520782 = weight(abstract_txt:product in 2552) [ClassicSimilarity], result of:
           0.5520782 = score(doc=2552,freq=9.0), product of:
             0.4917414 = queryWeight, product of:
               4.8692584 = boost
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.016865972 = queryNorm
             1.1227002 = fieldWeight in 2552, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.0625 = fieldNorm(doc=2552)
       0.2 = coord(5/25)
   

2. Goren-Bar, D.; Kuflik, T.: Supporting user-subjective categorization with self-organizing maps and learning vector quantization (2005) 0.17

   0.16842592 = sum of:
     0.16842592 = product of:
       0.70177466 = sum of:
         0.013658385 = weight(abstract_txt:study in 4325) [ClassicSimilarity], result of:
           0.013658385 = score(doc=4325,freq=1.0), product of:
             0.06398872 = queryWeight, product of:
               1.110903 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.016865972 = queryNorm
             0.21344988 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.07754365 = weight(abstract_txt:hundreds in 4325) [ClassicSimilarity], result of:
           0.07754365 = score(doc=4325,freq=1.0), product of:
             0.16163102 = queryWeight, product of:
               1.2484518 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.016865972 = queryNorm
             0.47975725 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.024391871 = weight(abstract_txt:methods in 4325) [ClassicSimilarity], result of:
           0.024391871 = score(doc=4325,freq=1.0), product of:
             0.09418909 = queryWeight, product of:
               1.3477978 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.016865972 = queryNorm
             0.25896704 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.04367186 = weight(abstract_txt:about in 4325) [ClassicSimilarity], result of:
           0.04367186 = score(doc=4325,freq=2.0), product of:
             0.12618046 = queryWeight, product of:
               1.9105839 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.016865972 = queryNorm
             0.34610638 = fieldWeight in 4325, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.03272401 = weight(abstract_txt:classification in 4325) [ClassicSimilarity], result of:
           0.03272401 = score(doc=4325,freq=1.0), product of:
             0.13115312 = queryWeight, product of:
               1.9478674 = boost
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.016865972 = queryNorm
             0.24950996 = fieldWeight in 4325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9921594 = idf(docFreq=2228, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
         0.5097849 = weight(abstract_txt:categorization in 4325) [ClassicSimilarity], result of:
           0.5097849 = score(doc=4325,freq=12.0), product of:
             0.35732645 = queryWeight, product of:
               3.2151606 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.016865972 = queryNorm
             1.4266642 = fieldWeight in 4325, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.0625 = fieldNorm(doc=4325)
       0.24 = coord(6/25)
   

3. Li, H.; Bhowmick, S.S.; Sun, A.: AffRank: affinity-driven ranking of products in online social rating networks (2011) 0.14

   0.14275382 = sum of:
     0.14275382 = product of:
       0.7137691 = sum of:
         0.0554726 = weight(abstract_txt:baseline in 483) [ClassicSimilarity], result of:
           0.0554726 = score(doc=483,freq=1.0), product of:
             0.12928443 = queryWeight, product of:
               1.1165612 = boost
               6.8651857 = idf(docFreq=125, maxDocs=44421)
               0.016865972 = queryNorm
             0.4290741 = fieldWeight in 483, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8651857 = idf(docFreq=125, maxDocs=44421)
               0.0625 = fieldNorm(doc=483)
         0.024391871 = weight(abstract_txt:methods in 483) [ClassicSimilarity], result of:
           0.024391871 = score(doc=483,freq=1.0), product of:
             0.09418909 = queryWeight, product of:
               1.3477978 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.016865972 = queryNorm
             0.25896704 = fieldWeight in 483, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=483)
         0.030060098 = weight(abstract_txt:large in 483) [ClassicSimilarity], result of:
           0.030060098 = score(doc=483,freq=1.0), product of:
             0.10826734 = queryWeight, product of:
               1.4450177 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016865972 = queryNorm
             0.27764696 = fieldWeight in 483, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=483)
         0.0517663 = weight(abstract_txt:experiments in 483) [ClassicSimilarity], result of:
           0.0517663 = score(doc=483,freq=1.0), product of:
             0.1555495 = queryWeight, product of:
               1.7320433 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.016865972 = queryNorm
             0.3327963 = fieldWeight in 483, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=483)
         0.5520782 = weight(abstract_txt:product in 483) [ClassicSimilarity], result of:
           0.5520782 = score(doc=483,freq=9.0), product of:
             0.4917414 = queryWeight, product of:
               4.8692584 = boost
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.016865972 = queryNorm
             1.1227002 = fieldWeight in 483, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.0625 = fieldNorm(doc=483)
       0.2 = coord(5/25)
   

4. Rijnsoever, F.J. van; Castaldi, C.: Extending consumer categorization based on innovativeness : intentions and technology clusters in consumer electronics (2011) 0.12

   0.12269924 = sum of:
     0.12269924 = product of:
       0.76687026 = sum of:
         0.059775356 = weight(abstract_txt:improvement in 634) [ClassicSimilarity], result of:
           0.059775356 = score(doc=634,freq=1.0), product of:
             0.10370057 = queryWeight, product of:
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.016865972 = queryNorm
             0.57642263 = fieldWeight in 634, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.09375 = fieldNorm(doc=634)
         0.1188776 = weight(abstract_txt:previously in 634) [ClassicSimilarity], result of:
           0.1188776 = score(doc=634,freq=1.0), product of:
             0.20662192 = queryWeight, product of:
               1.9962394 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.016865972 = queryNorm
             0.5753388 = fieldWeight in 634, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.09375 = fieldNorm(doc=634)
         0.3121782 = weight(abstract_txt:categorization in 634) [ClassicSimilarity], result of:
           0.3121782 = score(doc=634,freq=2.0), product of:
             0.35732645 = queryWeight, product of:
               3.2151606 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.016865972 = queryNorm
             0.87364984 = fieldWeight in 634, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.09375 = fieldNorm(doc=634)
         0.2760391 = weight(abstract_txt:product in 634) [ClassicSimilarity], result of:
           0.2760391 = score(doc=634,freq=1.0), product of:
             0.4917414 = queryWeight, product of:
               4.8692584 = boost
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.016865972 = queryNorm
             0.5613501 = fieldWeight in 634, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.09375 = fieldNorm(doc=634)
       0.16 = coord(4/25)
   

5. Yang, Y.; Wilbur, J.: Using corpus statistics to remove redundant words in text categorization (1996) 0.11

   0.11178219 = sum of:
     0.11178219 = product of:
       0.55891097 = sum of:
         0.049812797 = weight(abstract_txt:improvement in 4267) [ClassicSimilarity], result of:
           0.049812797 = score(doc=4267,freq=1.0), product of:
             0.10370057 = queryWeight, product of:
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.016865972 = queryNorm
             0.4803522 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.017072981 = weight(abstract_txt:study in 4267) [ClassicSimilarity], result of:
           0.017072981 = score(doc=4267,freq=1.0), product of:
             0.06398872 = queryWeight, product of:
               1.110903 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.016865972 = queryNorm
             0.26681235 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.04311914 = weight(abstract_txt:methods in 4267) [ClassicSimilarity], result of:
           0.04311914 = score(doc=4267,freq=2.0), product of:
             0.09418909 = queryWeight, product of:
               1.3477978 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.016865972 = queryNorm
             0.45779335 = fieldWeight in 4267, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.037575122 = weight(abstract_txt:large in 4267) [ClassicSimilarity], result of:
           0.037575122 = score(doc=4267,freq=1.0), product of:
             0.10826734 = queryWeight, product of:
               1.4450177 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016865972 = queryNorm
             0.3470587 = fieldWeight in 4267, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
         0.41133094 = weight(abstract_txt:categorization in 4267) [ClassicSimilarity], result of:
           0.41133094 = score(doc=4267,freq=5.0), product of:
             0.35732645 = queryWeight, product of:
               3.2151606 = boost
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.016865972 = queryNorm
             1.1511348 = fieldWeight in 4267, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.58948 = idf(docFreq=165, maxDocs=44421)
               0.078125 = fieldNorm(doc=4267)
       0.2 = coord(5/25)