Document (#37836)

Author

Tirilly, P.
Julien, C.-A.

Title

Random walks for subject hierarchy simplification

Source

Categories, contexts and relations in knowledge organization: Proceedings of the Twelfth International ISKO Conference 6-9 August 2012, Mysore, India. Eds.: Neelameghan, A. u. K.S. Raghavan

Imprint

Würzburg : Ergon Verlag

Year

2012

Pages

S.117-123

Series

Advances in knowledge organization; vol.13

Abstract

Although subject hierarchies are widely used to index document collections, few tools leverage their structure to facilitate collection browsing. This is mostly due to the complexity of such structures that include thousands of nodes. This paper proposes a new approach to simplify subject hierarchies based on the distribution of documents among the nodes. A random walk algorithm simulates the route of a user within the hierarchy, under the assumption that the user is attracted by the most populated nodes. Poorly visited nodes can be identified and eliminated, leaving a structure containing only the nodes that best represent the content of the collection. Experiments on a collection indexed using the Library of Congress Subject Headings (LCSH) show that, as compared to the state-of-the-art simplification method, the random walk-based approach gives access to a larger part of the collection for the same structure size, and offers more flexibility to customize the complexity of thestructure.

Theme

Verbale Doksprachen im Online-Retrieval

Object

LCSH

Similar documents (author)

1. Julien, S.: ¬The future of GUI development tools (1992) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:julien in 4645) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 4645, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=4645)
   

2. Julien, H.: Trends in the recent information needs and uses literature : a content analysis (1995) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:julien in 3414) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 3414, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=3414)
   

3. Julien, H.: ¬A content analysis of the recent information needs and uses literature (1996) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:julien in 944) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 944, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=944)
   

4. Julien, H.E.: How career information helps adolescents' decision-making (1997) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:julien in 1992) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 1992, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=1992)
   

5. Julien, H.: Bibliographic instruction trends in Canadian academic libraries (1997) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:julien in 3072) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 3072, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=3072)
   

Similar documents (content)

1. Botafogo, R.A.; Shneiderman, B.; Rivlin, E.: Structural analysis of hypertexts identifying hierarchies and useful metrics (1992) 0.16

   0.15595378 = sum of:
     0.15595378 = product of:
       0.64980745 = sum of:
         0.012448494 = weight(abstract_txt:that in 4026) [ClassicSimilarity], result of:
           0.012448494 = score(doc=4026,freq=2.0), product of:
             0.04764228 = queryWeight, product of:
               1.283419 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015696572 = queryNorm
             0.2612909 = fieldWeight in 4026, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.06852739 = weight(abstract_txt:complexity in 4026) [ClassicSimilarity], result of:
           0.06852739 = score(doc=4026,freq=1.0), product of:
             0.1485334 = queryWeight, product of:
               1.6023939 = boost
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.015696572 = queryNorm
             0.46136016 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.093675956 = weight(abstract_txt:hierarchy in 4026) [ClassicSimilarity], result of:
           0.093675956 = score(doc=4026,freq=1.0), product of:
             0.18295042 = queryWeight, product of:
               1.7783773 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.015696572 = queryNorm
             0.5120292 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.1194135 = weight(abstract_txt:hierarchies in 4026) [ClassicSimilarity], result of:
           0.1194135 = score(doc=4026,freq=1.0), product of:
             0.21508838 = queryWeight, product of:
               1.9282604 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.015696572 = queryNorm
             0.5551834 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.06689509 = weight(abstract_txt:collection in 4026) [ClassicSimilarity], result of:
           0.06689509 = score(doc=4026,freq=1.0), product of:
             0.18415669 = queryWeight, product of:
               2.523283 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.015696572 = queryNorm
             0.36325094 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.288847 = weight(abstract_txt:nodes in 4026) [ClassicSimilarity], result of:
           0.288847 = score(doc=4026,freq=1.0), product of:
             0.52602524 = queryWeight, product of:
               4.767937 = boost
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.015696572 = queryNorm
             0.54911244 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
       0.24 = coord(6/25)
   

2. Kumar, H.P.; Plaisant, C.; Shneiderman, B.: Browsing hierarchical data with multi-level dynamic queries and pruning (1997) 0.14

   0.14008366 = sum of:
     0.14008366 = product of:
       0.87552285 = sum of:
         0.008802414 = weight(abstract_txt:that in 750) [ClassicSimilarity], result of:
           0.008802414 = score(doc=750,freq=1.0), product of:
             0.04764228 = queryWeight, product of:
               1.283419 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015696572 = queryNorm
             0.18476056 = fieldWeight in 750, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=750)
         0.1194135 = weight(abstract_txt:hierarchies in 750) [ClassicSimilarity], result of:
           0.1194135 = score(doc=750,freq=1.0), product of:
             0.21508838 = queryWeight, product of:
               1.9282604 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.015696572 = queryNorm
             0.5551834 = fieldWeight in 750, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.078125 = fieldNorm(doc=750)
         0.039779194 = weight(abstract_txt:subject in 750) [ClassicSimilarity], result of:
           0.039779194 = score(doc=750,freq=1.0), product of:
             0.13022529 = queryWeight, product of:
               2.1218753 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.015696572 = queryNorm
             0.30546445 = fieldWeight in 750, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.078125 = fieldNorm(doc=750)
         0.70752776 = weight(abstract_txt:nodes in 750) [ClassicSimilarity], result of:
           0.70752776 = score(doc=750,freq=6.0), product of:
             0.52602524 = queryWeight, product of:
               4.767937 = boost
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.015696572 = queryNorm
             1.3450453 = fieldWeight in 750, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.078125 = fieldNorm(doc=750)
       0.16 = coord(4/25)
   

3. Torres, S.D.; Hiemstra, D.; Weber, I.; Serdyukov, P.: Query recommendation in the information domain of children (2014) 0.11

   0.11039405 = sum of:
     0.11039405 = product of:
       0.55197024 = sum of:
         0.013938542 = weight(abstract_txt:approach in 2300) [ClassicSimilarity], result of:
           0.013938542 = score(doc=2300,freq=1.0), product of:
             0.059611894 = queryWeight, product of:
               1.0151347 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.015696572 = queryNorm
             0.2338215 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.10151175 = weight(abstract_txt:walks in 2300) [ClassicSimilarity], result of:
           0.10151175 = score(doc=2300,freq=1.0), product of:
             0.1777688 = queryWeight, product of:
               1.2395669 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.015696572 = queryNorm
             0.5710324 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.014083862 = weight(abstract_txt:that in 2300) [ClassicSimilarity], result of:
           0.014083862 = score(doc=2300,freq=4.0), product of:
             0.04764228 = queryWeight, product of:
               1.283419 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015696572 = queryNorm
             0.2956169 = fieldWeight in 2300, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.22977604 = weight(abstract_txt:walk in 2300) [ClassicSimilarity], result of:
           0.22977604 = score(doc=2300,freq=2.0), product of:
             0.3064652 = queryWeight, product of:
               2.301695 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.015696572 = queryNorm
             0.74976224 = fieldWeight in 2300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.19266006 = weight(abstract_txt:random in 2300) [ClassicSimilarity], result of:
           0.19266006 = score(doc=2300,freq=3.0), product of:
             0.27250376 = queryWeight, product of:
               2.6582088 = boost
               6.5309834 = idf(docFreq=175, maxDocs=44421)
               0.015696572 = queryNorm
             0.70699966 = fieldWeight in 2300, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.5309834 = idf(docFreq=175, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
       0.2 = coord(5/25)
   

4. Frank, E.; Paynter, G.W.: Predicting Library of Congress Classifications from Library of Congress Subject Headings (2004) 0.11

   0.10864907 = sum of:
     0.10864907 = product of:
       0.5432453 = sum of:
         0.015246227 = weight(abstract_txt:that in 3218) [ClassicSimilarity], result of:
           0.015246227 = score(doc=3218,freq=3.0), product of:
             0.04764228 = queryWeight, product of:
               1.283419 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015696572 = queryNorm
             0.32001466 = fieldWeight in 3218, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=3218)
         0.1324778 = weight(abstract_txt:hierarchy in 3218) [ClassicSimilarity], result of:
           0.1324778 = score(doc=3218,freq=2.0), product of:
             0.18295042 = queryWeight, product of:
               1.7783773 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.015696572 = queryNorm
             0.7241186 = fieldWeight in 3218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.078125 = fieldNorm(doc=3218)
         0.039779194 = weight(abstract_txt:subject in 3218) [ClassicSimilarity], result of:
           0.039779194 = score(doc=3218,freq=1.0), product of:
             0.13022529 = queryWeight, product of:
               2.1218753 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.015696572 = queryNorm
             0.30546445 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.078125 = fieldNorm(doc=3218)
         0.06689509 = weight(abstract_txt:collection in 3218) [ClassicSimilarity], result of:
           0.06689509 = score(doc=3218,freq=1.0), product of:
             0.18415669 = queryWeight, product of:
               2.523283 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.015696572 = queryNorm
             0.36325094 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=3218)
         0.288847 = weight(abstract_txt:nodes in 3218) [ClassicSimilarity], result of:
           0.288847 = score(doc=3218,freq=1.0), product of:
             0.52602524 = queryWeight, product of:
               4.767937 = boost
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.015696572 = queryNorm
             0.54911244 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.078125 = fieldNorm(doc=3218)
       0.2 = coord(5/25)
   

5. Zhang, J.; Zeng, M.L.: ¬A new similarity measure for subject hierarchical structures (2014) 0.11

   0.1056689 = sum of:
     0.1056689 = product of:
       0.5283445 = sum of:
         0.013938542 = weight(abstract_txt:approach in 2778) [ClassicSimilarity], result of:
           0.013938542 = score(doc=2778,freq=1.0), product of:
             0.059611894 = queryWeight, product of:
               1.0151347 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.015696572 = queryNorm
             0.2338215 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=2778)
         0.009958795 = weight(abstract_txt:that in 2778) [ClassicSimilarity], result of:
           0.009958795 = score(doc=2778,freq=2.0), product of:
             0.04764228 = queryWeight, product of:
               1.283419 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015696572 = queryNorm
             0.20903271 = fieldWeight in 2778, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2778)
         0.03304984 = weight(abstract_txt:structure in 2778) [ClassicSimilarity], result of:
           0.03304984 = score(doc=2778,freq=1.0), product of:
             0.12133832 = queryWeight, product of:
               1.7737885 = boost
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.015696572 = queryNorm
             0.27237758 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.0625 = fieldNorm(doc=2778)
         0.07115919 = weight(abstract_txt:subject in 2778) [ClassicSimilarity], result of:
           0.07115919 = score(doc=2778,freq=5.0), product of:
             0.13022529 = queryWeight, product of:
               2.1218753 = boost
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.015696572 = queryNorm
             0.5464314 = fieldWeight in 2778, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.9099448 = idf(docFreq=2419, maxDocs=44421)
               0.0625 = fieldNorm(doc=2778)
         0.40023813 = weight(abstract_txt:nodes in 2778) [ClassicSimilarity], result of:
           0.40023813 = score(doc=2778,freq=3.0), product of:
             0.52602524 = queryWeight, product of:
               4.767937 = boost
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.015696572 = queryNorm
             0.7608725 = fieldWeight in 2778, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.028639 = idf(docFreq=106, maxDocs=44421)
               0.0625 = fieldNorm(doc=2778)
       0.2 = coord(5/25)