Document (#25038)

Author

Sanderson, M.
Lawrie, D.

Title

Building, testing, and applying concept hierarchies

Source

Advances in information retrieval: Recent research from the Center for Intelligent Information Retrieval. Ed.: W.B. Croft

Imprint

Boston, MA : Kluwer Academic Publ.

Year

2000

Pages

S.235-266

Series

The Kluwer international series on information retrieval; 7

Abstract

A means of automatically deriving a hierarchical organization of concepts from a set of documents without use of training data or standard clustering techniques is presented. Using a process that extracts salient words and phrases from the documents, these terms are organized hierarchically using a type of co-occurrence known as subsumption. The resulting structure is displayed as a series of hierarchical menus. When generated from a set of retrieved documents, a user browsing the menus gains an overview of their content in a manner distinct from existing techniques. The methods used to build the structure are simple and appear to be effective. The formation and presentation of the hierarchy is described along with a study of some of its properties, including a preliminary experiment, which indicates that users may find the hierarchy a more efficient means of locating relevant documents than the classic method of scanning a ranked document list

Theme

Semantisches Umfeld in Indexierung u. Retrieval

Similar documents (author)

1. Sanderson, M.: ¬The Reuters test collection (1996) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:sanderson in 40) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 40, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=40)
   

2. Sanderson, M.: Revisiting h measured on UK LIS and IR academics (2008) 5.35

   5.353733 = sum of:
     5.353733 = weight(author_txt:sanderson in 2867) [ClassicSimilarity], result of:
       5.353733 = fieldWeight in 2867, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.625 = fieldNorm(doc=2867)
   

3. Purves, R.S.; Sanderson, M.: ¬A methodology to allow avalanche forecasting on an information retrieval system (1998) 4.28

   4.2829866 = sum of:
     4.2829866 = weight(author_txt:sanderson in 2073) [ClassicSimilarity], result of:
       4.2829866 = fieldWeight in 2073, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.5 = fieldNorm(doc=2073)
   

4. Sanderson, M.; Ruthven, I.: Report on the Glasgow IR group (glair4) submission (1997) 4.28

   4.2829866 = sum of:
     4.2829866 = weight(author_txt:sanderson in 4088) [ClassicSimilarity], result of:
       4.2829866 = fieldWeight in 4088, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.5 = fieldNorm(doc=4088)
   

5. Clough, P.; Sanderson, M.: User experiments with the Eurovision Cross-Language Image Retrieval System (2006) 4.28

   4.2829866 = sum of:
     4.2829866 = weight(author_txt:sanderson in 52) [ClassicSimilarity], result of:
       4.2829866 = fieldWeight in 52, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.565973 = idf(docFreq=22, maxDocs=44421)
         0.5 = fieldNorm(doc=52)
   

Similar documents (content)

1. Gauch, S.; Chandramouli, A.; Ranganathan, S.: Training a hierarchical classifier using inter document relationships (2009) 0.17

   0.17374617 = sum of:
     0.17374617 = product of:
       0.7239424 = sum of:
         0.021497887 = weight(abstract_txt:using in 3697) [ClassicSimilarity], result of:
           0.021497887 = score(doc=3697,freq=1.0), product of:
             0.07960175 = queryWeight, product of:
               1.0896565 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.02113245 = queryNorm
             0.27006802 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.14879662 = weight(abstract_txt:hierarchically in 3697) [ClassicSimilarity], result of:
           0.14879662 = score(doc=3697,freq=1.0), product of:
             0.22946201 = queryWeight, product of:
               1.3081837 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.02113245 = queryNorm
             0.6484586 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.030926788 = weight(abstract_txt:from in 3697) [ClassicSimilarity], result of:
           0.030926788 = score(doc=3697,freq=2.0), product of:
             0.10144142 = queryWeight, product of:
               1.7396063 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.02113245 = queryNorm
             0.30487338 = fieldWeight in 3697, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.16959678 = weight(abstract_txt:hierarchical in 3697) [ClassicSimilarity], result of:
           0.16959678 = score(doc=3697,freq=3.0), product of:
             0.21872416 = queryWeight, product of:
               1.8062451 = boost
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.02113245 = queryNorm
             0.77539116 = fieldWeight in 3697, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.20719312 = weight(abstract_txt:hierarchy in 3697) [ClassicSimilarity], result of:
           0.20719312 = score(doc=3697,freq=2.0), product of:
             0.28613147 = queryWeight, product of:
               2.0659087 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.02113245 = queryNorm
             0.7241186 = fieldWeight in 3697, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.14593117 = weight(abstract_txt:documents in 3697) [ClassicSimilarity], result of:
           0.14593117 = score(doc=3697,freq=4.0), product of:
             0.22650658 = queryWeight, product of:
               2.5994635 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.02113245 = queryNorm
             0.64426905 = fieldWeight in 3697, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
       0.24 = coord(6/25)
   

2. Allen, R.B.: Navigating and searching in digital library catalogs (1994) 0.13

   0.13472214 = sum of:
     0.13472214 = product of:
       0.6736107 = sum of:
         0.07534981 = weight(abstract_txt:displayed in 3414) [ClassicSimilarity], result of:
           0.07534981 = score(doc=3414,freq=1.0), product of:
             0.16916488 = queryWeight, product of:
               1.1232293 = boost
               7.1267567 = idf(docFreq=96, maxDocs=44421)
               0.02113245 = queryNorm
             0.4454223 = fieldWeight in 3414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1267567 = idf(docFreq=96, maxDocs=44421)
               0.0625 = fieldNorm(doc=3414)
         0.048733246 = weight(abstract_txt:structure in 3414) [ClassicSimilarity], result of:
           0.048733246 = score(doc=3414,freq=2.0), product of:
             0.12651412 = queryWeight, product of:
               1.3737187 = boost
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.02113245 = queryNorm
             0.38520005 = fieldWeight in 3414, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.0625 = fieldNorm(doc=3414)
         0.23441225 = weight(abstract_txt:hierarchy in 3414) [ClassicSimilarity], result of:
           0.23441225 = score(doc=3414,freq=4.0), product of:
             0.28613147 = queryWeight, product of:
               2.0659087 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.02113245 = queryNorm
             0.81924665 = fieldWeight in 3414, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.0625 = fieldNorm(doc=3414)
         0.23256424 = weight(abstract_txt:menus in 3414) [ClassicSimilarity], result of:
           0.23256424 = score(doc=3414,freq=1.0), product of:
             0.45181507 = queryWeight, product of:
               2.5960238 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.02113245 = queryNorm
             0.51473325 = fieldWeight in 3414, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.0625 = fieldNorm(doc=3414)
         0.08255114 = weight(abstract_txt:documents in 3414) [ClassicSimilarity], result of:
           0.08255114 = score(doc=3414,freq=2.0), product of:
             0.22650658 = queryWeight, product of:
               2.5994635 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.02113245 = queryNorm
             0.3644536 = fieldWeight in 3414, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3414)
       0.2 = coord(5/25)
   

3. Yang, C.C.; Wang, F.L.: Hierarchical summarization of large documents (2008) 0.13

   0.13185482 = sum of:
     0.13185482 = product of:
       0.47091007 = sum of:
         0.017198311 = weight(abstract_txt:using in 2719) [ClassicSimilarity], result of:
           0.017198311 = score(doc=2719,freq=1.0), product of:
             0.07960175 = queryWeight, product of:
               1.0896565 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.02113245 = queryNorm
             0.21605442 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.089323744 = weight(abstract_txt:salient in 2719) [ClassicSimilarity], result of:
           0.089323744 = score(doc=2719,freq=1.0), product of:
             0.18948147 = queryWeight, product of:
               1.1887668 = boost
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.02113245 = queryNorm
             0.47141153 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.06891922 = weight(abstract_txt:structure in 2719) [ClassicSimilarity], result of:
           0.06891922 = score(doc=2719,freq=4.0), product of:
             0.12651412 = queryWeight, product of:
               1.3737187 = boost
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.02113245 = queryNorm
             0.54475516 = fieldWeight in 2719, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.038756076 = weight(abstract_txt:techniques in 2719) [ClassicSimilarity], result of:
           0.038756076 = score(doc=2719,freq=1.0), product of:
             0.13682285 = queryWeight, product of:
               1.42859 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.02113245 = queryNorm
             0.28325734 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.017494835 = weight(abstract_txt:from in 2719) [ClassicSimilarity], result of:
           0.017494835 = score(doc=2719,freq=1.0), product of:
             0.10144142 = queryWeight, product of:
               1.7396063 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.02113245 = queryNorm
             0.17246243 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.1566668 = weight(abstract_txt:hierarchical in 2719) [ClassicSimilarity], result of:
           0.1566668 = score(doc=2719,freq=4.0), product of:
             0.21872416 = queryWeight, product of:
               1.8062451 = boost
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.02113245 = queryNorm
             0.7162757 = fieldWeight in 2719, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
         0.08255114 = weight(abstract_txt:documents in 2719) [ClassicSimilarity], result of:
           0.08255114 = score(doc=2719,freq=2.0), product of:
             0.22650658 = queryWeight, product of:
               2.5994635 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.02113245 = queryNorm
             0.3644536 = fieldWeight in 2719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=2719)
       0.28 = coord(7/25)
   

4. Zhang, Y.; Zhang, C.; Li, J.: Joint modeling of characters, words, and conversation contexts for microblog keyphrase extraction (2020) 0.12

   0.12355293 = sum of:
     0.12355293 = product of:
       0.5148039 = sum of:
         0.12632285 = weight(abstract_txt:salient in 816) [ClassicSimilarity], result of:
           0.12632285 = score(doc=816,freq=2.0), product of:
             0.18948147 = queryWeight, product of:
               1.1887668 = boost
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.02113245 = queryNorm
             0.6666766 = fieldWeight in 816, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
         0.08988442 = weight(abstract_txt:extracts in 816) [ClassicSimilarity], result of:
           0.08988442 = score(doc=816,freq=1.0), product of:
             0.19027354 = queryWeight, product of:
               1.1912489 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.02113245 = queryNorm
             0.4723958 = fieldWeight in 816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
         0.11903729 = weight(abstract_txt:hierarchically in 816) [ClassicSimilarity], result of:
           0.11903729 = score(doc=816,freq=1.0), product of:
             0.22946201 = queryWeight, product of:
               1.3081837 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.02113245 = queryNorm
             0.5187669 = fieldWeight in 816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
         0.04285342 = weight(abstract_txt:from in 816) [ClassicSimilarity], result of:
           0.04285342 = score(doc=816,freq=6.0), product of:
             0.10144142 = queryWeight, product of:
               1.7396063 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.02113245 = queryNorm
             0.42244497 = fieldWeight in 816, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
         0.0783334 = weight(abstract_txt:hierarchical in 816) [ClassicSimilarity], result of:
           0.0783334 = score(doc=816,freq=1.0), product of:
             0.21872416 = queryWeight, product of:
               1.8062451 = boost
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.02113245 = queryNorm
             0.35813785 = fieldWeight in 816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
         0.05837247 = weight(abstract_txt:documents in 816) [ClassicSimilarity], result of:
           0.05837247 = score(doc=816,freq=1.0), product of:
             0.22650658 = queryWeight, product of:
               2.5994635 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.02113245 = queryNorm
             0.25770763 = fieldWeight in 816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=816)
       0.24 = coord(6/25)
   

5. Dolin, R.; Agrawal, D.; El Abbadi, A.; Pearlman, J.: Using automated classification for summarizing and selecting heterogeneous information sources (1998) 0.12

   0.12074394 = sum of:
     0.12074394 = product of:
       0.3353998 = sum of:
         0.033794384 = weight(abstract_txt:phrases in 2253) [ClassicSimilarity], result of:
           0.033794384 = score(doc=2253,freq=1.0), product of:
             0.15733975 = queryWeight, product of:
               1.0832596 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.02113245 = queryNorm
             0.21478605 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.03783949 = weight(abstract_txt:locating in 2253) [ClassicSimilarity], result of:
           0.03783949 = score(doc=2253,freq=1.0), product of:
             0.1696572 = queryWeight, product of:
               1.1248626 = boost
               7.1371193 = idf(docFreq=95, maxDocs=44421)
               0.02113245 = queryNorm
             0.22303498 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1371193 = idf(docFreq=95, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.059518646 = weight(abstract_txt:hierarchically in 2253) [ClassicSimilarity], result of:
           0.059518646 = score(doc=2253,freq=1.0), product of:
             0.22946201 = queryWeight, product of:
               1.3081837 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.02113245 = queryNorm
             0.25938344 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.017229805 = weight(abstract_txt:structure in 2253) [ClassicSimilarity], result of:
           0.017229805 = score(doc=2253,freq=1.0), product of:
             0.12651412 = queryWeight, product of:
               1.3737187 = boost
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.02113245 = queryNorm
             0.13618879 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3580413 = idf(docFreq=1545, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.019378038 = weight(abstract_txt:techniques in 2253) [ClassicSimilarity], result of:
           0.019378038 = score(doc=2253,freq=1.0), product of:
             0.13682285 = queryWeight, product of:
               1.42859 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.02113245 = queryNorm
             0.14162867 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.012370716 = weight(abstract_txt:from in 2253) [ClassicSimilarity], result of:
           0.012370716 = score(doc=2253,freq=2.0), product of:
             0.10144142 = queryWeight, product of:
               1.7396063 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.02113245 = queryNorm
             0.12194935 = fieldWeight in 2253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.055390075 = weight(abstract_txt:hierarchical in 2253) [ClassicSimilarity], result of:
           0.055390075 = score(doc=2253,freq=2.0), product of:
             0.21872416 = queryWeight, product of:
               1.8062451 = boost
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.02113245 = queryNorm
             0.2532417 = fieldWeight in 2253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7302055 = idf(docFreq=391, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.058603063 = weight(abstract_txt:hierarchy in 2253) [ClassicSimilarity], result of:
           0.058603063 = score(doc=2253,freq=1.0), product of:
             0.28613147 = queryWeight, product of:
               2.0659087 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.02113245 = queryNorm
             0.20481166 = fieldWeight in 2253, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
         0.04127557 = weight(abstract_txt:documents in 2253) [ClassicSimilarity], result of:
           0.04127557 = score(doc=2253,freq=2.0), product of:
             0.22650658 = queryWeight, product of:
               2.5994635 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.02113245 = queryNorm
             0.1822268 = fieldWeight in 2253, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.03125 = fieldNorm(doc=2253)
       0.36 = coord(9/25)