Document (#37128)

Author

Witschel, H.F.

Title

Global and local resources for peer-to-peer text retrieval

Imprint

Leipzig : Universität / Fakultät für Mathematik und Informatik Institut für Informatik

Year

2008

Pages

X, 189 S

Abstract

This thesis is organised as follows: Chapter 2 gives a general introduction to the field of information retrieval, covering its most important aspects. Further, the tasks of distributed and peer-to-peer information retrieval (P2PIR) are introduced, motivating their application and characterising the special challenges that they involve, including a review of existing architectures and search protocols in P2PIR. Finally, chapter 2 presents approaches to evaluating the e ectiveness of both traditional and peer-to-peer IR systems. Chapter 3 contains a detailed account of state-of-the-art information retrieval models and algorithms. This encompasses models for matching queries against document representations, term weighting algorithms, approaches to feedback and associative retrieval as well as distributed retrieval. It thus defines important terminology for the following chapters. The notion of "multi-level association graphs" (MLAGs) is introduced in chapter 4. An MLAG is a simple, graph-based framework that allows to model most of the theoretical and practical approaches to IR presented in chapter 3. Moreover, it provides an easy-to-grasp way of defining and including new entities into IR modeling, such as paragraphs or peers, dividing them conceptually while at the same time connecting them to each other in a meaningful way. This allows for a unified view on many IR tasks, including that of distributed and peer-to-peer search. Starting from related work and a formal defiition of the framework, the possibilities of modeling that it provides are discussed in detail, followed by an experimental section that shows how new insights gained from modeling inside the framework can lead to novel combinations of principles and eventually to improved retrieval effectiveness.
Chapter 5 empirically tackles the first of the two research questions formulated above, namely the question of global collection statistics. More precisely, it studies possibilities of radically simplified results merging. The simplification comes from the attempt - without having knowledge of the complete collection - to equip all peers with the same global statistics, making document scores comparable across peers. Chapter 5 empirically tackles the first of the two research questions formulated above, namely the question of global collection statistics. More precisely, it studies possibilities of radically simplified results merging. The simplification comes from the attempt - without having knowledge of the complete collection - to equip all peers with the same global statistics, making document scores comparable across peers. What is examined, is the question of how we can obtain such global statistics and to what extent their use will lead to a drop in retrieval effectiveness. In chapter 6, the second research question is tackled, namely that of making forwarding decisions for queries, based on profiles of other peers. After a review of related work in that area, the chapter first defines the approaches that will be compared against each other. Then, a novel evaluation framework is introduced, including a new measure for comparing results of a distributed search engine against those of a centralised one. Finally, the actual evaluation is performed using the new framework.

Content

Dissertation zur Erlangung des akademischen Grades doctor rerum naturalium (Dr. rer. nat.) im Fachgebiet Informatik.

Theme

Computerlinguistik

Similar documents (author)

1. Witschel, H.F.: Global term weights in distributed environments (2008) 6.19

   6.1935673 = sum of:
     6.1935673 = weight(author_txt:witschel in 3096) [ClassicSimilarity], result of:
       6.1935673 = fieldWeight in 3096, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.625 = fieldNorm(doc=3096)
   

2. Witschel, H.F.: Terminologie-Extraktion : Möglichkeiten der Kombination statistischer uns musterbasierter Verfahren (2004) 6.19

   6.1935673 = sum of:
     6.1935673 = weight(author_txt:witschel in 1123) [ClassicSimilarity], result of:
       6.1935673 = fieldWeight in 1123, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.625 = fieldNorm(doc=1123)
   

3. Witschel, H.F.: Text, Wörter, Morpheme : Möglichkeiten einer automatischen Terminologie-Extraktion (2004) 6.19

   6.1935673 = sum of:
     6.1935673 = weight(author_txt:witschel in 1126) [ClassicSimilarity], result of:
       6.1935673 = fieldWeight in 1126, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.625 = fieldNorm(doc=1126)
   

4. Witschel, H.F.: Terminology extraction and automatic indexing : comparison and qualitative evaluation of methods (2005) 6.19

   6.1935673 = sum of:
     6.1935673 = weight(author_txt:witschel in 2842) [ClassicSimilarity], result of:
       6.1935673 = fieldWeight in 2842, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.625 = fieldNorm(doc=2842)
   

Similar documents (content)

1. Fensel, D.; Staab, S.; Studer, R.; Harmelen, F. van; Davies, J.: ¬A future perspective : exploiting peer-to-peer and the Semantic Web for knowledge management (2004) 0.17

   0.16932248 = sum of:
     0.16932248 = product of:
       0.84661233 = sum of:
         0.07557116 = weight(abstract_txt:possibilities in 3262) [ClassicSimilarity], result of:
           0.07557116 = score(doc=3262,freq=1.0), product of:
             0.13175811 = queryWeight, product of:
               1.216686 = boost
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.01770074 = queryNorm
             0.5735598 = fieldWeight in 3262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.09375 = fieldNorm(doc=3262)
         0.060497247 = weight(abstract_txt:approaches in 3262) [ClassicSimilarity], result of:
           0.060497247 = score(doc=3262,freq=2.0), product of:
             0.09923541 = queryWeight, product of:
               1.2192494 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.01770074 = queryNorm
             0.6096337 = fieldWeight in 3262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.09375 = fieldNorm(doc=3262)
         0.016461719 = weight(abstract_txt:that in 3262) [ClassicSimilarity], result of:
           0.016461719 = score(doc=3262,freq=2.0), product of:
             0.052501254 = queryWeight, product of:
               1.2541776 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01770074 = queryNorm
             0.31354907 = fieldWeight in 3262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=3262)
         0.3388177 = weight(abstract_txt:peer in 3262) [ClassicSimilarity], result of:
           0.3388177 = score(doc=3262,freq=2.0), product of:
             0.39430317 = queryWeight, product of:
               3.4370775 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01770074 = queryNorm
             0.85928214 = fieldWeight in 3262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.09375 = fieldNorm(doc=3262)
         0.35526457 = weight(abstract_txt:chapter in 3262) [ClassicSimilarity], result of:
           0.35526457 = score(doc=3262,freq=2.0), product of:
             0.42325783 = queryWeight, product of:
               3.777052 = boost
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.01770074 = queryNorm
             0.8393574 = fieldWeight in 3262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.09375 = fieldNorm(doc=3262)
       0.2 = coord(5/25)
   

2. Habernal, I.; Konopík, M.; Rohlík, O.: Question answering (2012) 0.11

   0.11439458 = sum of:
     0.11439458 = product of:
       0.4766441 = sum of:
         0.062975965 = weight(abstract_txt:possibilities in 1101) [ClassicSimilarity], result of:
           0.062975965 = score(doc=1101,freq=1.0), product of:
             0.13175811 = queryWeight, product of:
               1.216686 = boost
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.01770074 = queryNorm
             0.47796652 = fieldWeight in 1101, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
         0.035648346 = weight(abstract_txt:approaches in 1101) [ClassicSimilarity], result of:
           0.035648346 = score(doc=1101,freq=1.0), product of:
             0.09923541 = queryWeight, product of:
               1.2192494 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.01770074 = queryNorm
             0.3592301 = fieldWeight in 1101, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
         0.0097001605 = weight(abstract_txt:that in 1101) [ClassicSimilarity], result of:
           0.0097001605 = score(doc=1101,freq=1.0), product of:
             0.052501254 = queryWeight, product of:
               1.2541776 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01770074 = queryNorm
             0.18476056 = fieldWeight in 1101, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
         0.1154004 = weight(abstract_txt:question in 1101) [ClassicSimilarity], result of:
           0.1154004 = score(doc=1101,freq=5.0), product of:
             0.12699558 = queryWeight, product of:
               1.3792834 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.01770074 = queryNorm
             0.9086962 = fieldWeight in 1101, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
         0.043577567 = weight(abstract_txt:retrieval in 1101) [ClassicSimilarity], result of:
           0.043577567 = score(doc=1101,freq=2.0), product of:
             0.11345293 = queryWeight, product of:
               1.8436651 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01770074 = queryNorm
             0.3841026 = fieldWeight in 1101, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
         0.20934166 = weight(abstract_txt:chapter in 1101) [ClassicSimilarity], result of:
           0.20934166 = score(doc=1101,freq=1.0), product of:
             0.42325783 = queryWeight, product of:
               3.777052 = boost
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.01770074 = queryNorm
             0.49459606 = fieldWeight in 1101, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.078125 = fieldNorm(doc=1101)
       0.24 = coord(6/25)
   

3. Aringhieri, R.; Damiani, E.; De Capitani di Vimercati, S.; Paraboschi, S.; Samarati, P.: Fuzzy techniques for trust and reputation management in anonymous peer-to-peer systems (2006) 0.11

   0.11218271 = sum of:
     0.11218271 = product of:
       0.70114195 = sum of:
         0.035648346 = weight(abstract_txt:approaches in 279) [ClassicSimilarity], result of:
           0.035648346 = score(doc=279,freq=1.0), product of:
             0.09923541 = queryWeight, product of:
               1.2192494 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.01770074 = queryNorm
             0.3592301 = fieldWeight in 279, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.078125 = fieldNorm(doc=279)
         0.0097001605 = weight(abstract_txt:that in 279) [ClassicSimilarity], result of:
           0.0097001605 = score(doc=279,freq=1.0), product of:
             0.052501254 = queryWeight, product of:
               1.2541776 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01770074 = queryNorm
             0.18476056 = fieldWeight in 279, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=279)
         0.3734454 = weight(abstract_txt:peers in 279) [ClassicSimilarity], result of:
           0.3734454 = score(doc=279,freq=2.0), product of:
             0.43166372 = queryWeight, product of:
               3.114423 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.01770074 = queryNorm
             0.86513036 = fieldWeight in 279, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.078125 = fieldNorm(doc=279)
         0.28234807 = weight(abstract_txt:peer in 279) [ClassicSimilarity], result of:
           0.28234807 = score(doc=279,freq=2.0), product of:
             0.39430317 = queryWeight, product of:
               3.4370775 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01770074 = queryNorm
             0.71606845 = fieldWeight in 279, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.078125 = fieldNorm(doc=279)
       0.16 = coord(4/25)
   

4. Laut, J.; Cappa, F.; Nov, O.; Porfiri, M.: Increasing citizen science contribution using a virtual peer (2017) 0.11

   0.10933605 = sum of:
     0.10933605 = product of:
       0.6833503 = sum of:
         0.023992136 = weight(abstract_txt:including in 4427) [ClassicSimilarity], result of:
           0.023992136 = score(doc=4427,freq=1.0), product of:
             0.08843544 = queryWeight, product of:
               1.1509922 = boost
               4.340728 = idf(docFreq=1572, maxDocs=44421)
               0.01770074 = queryNorm
             0.2712955 = fieldWeight in 4427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.340728 = idf(docFreq=1572, maxDocs=44421)
               0.0625 = fieldNorm(doc=4427)
         0.01097448 = weight(abstract_txt:that in 4427) [ClassicSimilarity], result of:
           0.01097448 = score(doc=4427,freq=2.0), product of:
             0.052501254 = queryWeight, product of:
               1.2541776 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01770074 = queryNorm
             0.20903271 = fieldWeight in 4427, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=4427)
         0.42250526 = weight(abstract_txt:peers in 4427) [ClassicSimilarity], result of:
           0.42250526 = score(doc=4427,freq=4.0), product of:
             0.43166372 = queryWeight, product of:
               3.114423 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.01770074 = queryNorm
             0.9787833 = fieldWeight in 4427, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.0625 = fieldNorm(doc=4427)
         0.22587845 = weight(abstract_txt:peer in 4427) [ClassicSimilarity], result of:
           0.22587845 = score(doc=4427,freq=2.0), product of:
             0.39430317 = queryWeight, product of:
               3.4370775 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01770074 = queryNorm
             0.57285476 = fieldWeight in 4427, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=4427)
       0.16 = coord(4/25)
   

5. Chang, Y.; Ounis, I.; Kim, M.: Query reformulation using automatically generated query concepts from a document space (2006) 0.11

   0.10889476 = sum of:
     0.10889476 = product of:
       0.38890985 = sum of:
         0.07867229 = weight(abstract_txt:precisely in 1972) [ClassicSimilarity], result of:
           0.07867229 = score(doc=1972,freq=1.0), product of:
             0.13350932 = queryWeight, product of:
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.01770074 = queryNorm
             0.5892644 = fieldWeight in 1972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.051266372 = weight(abstract_txt:introduced in 1972) [ClassicSimilarity], result of:
           0.051266372 = score(doc=1972,freq=1.0), product of:
             0.11487245 = queryWeight, product of:
               1.1360509 = boost
               5.7125063 = idf(docFreq=398, maxDocs=44421)
               0.01770074 = queryNorm
             0.44628954 = fieldWeight in 1972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7125063 = idf(docFreq=398, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.059333984 = weight(abstract_txt:modeling in 1972) [ClassicSimilarity], result of:
           0.059333984 = score(doc=1972,freq=1.0), product of:
             0.12662803 = queryWeight, product of:
               1.1927646 = boost
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.01770074 = queryNorm
             0.46856913 = fieldWeight in 1972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.035648346 = weight(abstract_txt:approaches in 1972) [ClassicSimilarity], result of:
           0.035648346 = score(doc=1972,freq=1.0), product of:
             0.09923541 = queryWeight, product of:
               1.2192494 = boost
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.01770074 = queryNorm
             0.3592301 = fieldWeight in 1972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5981455 = idf(docFreq=1215, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.05212624 = weight(abstract_txt:collection in 1972) [ClassicSimilarity], result of:
           0.05212624 = score(doc=1972,freq=2.0), product of:
             0.10146929 = queryWeight, product of:
               1.2328962 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.01770074 = queryNorm
             0.51371443 = fieldWeight in 1972, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.016801171 = weight(abstract_txt:that in 1972) [ClassicSimilarity], result of:
           0.016801171 = score(doc=1972,freq=3.0), product of:
             0.052501254 = queryWeight, product of:
               1.2541776 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01770074 = queryNorm
             0.32001466 = fieldWeight in 1972, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
         0.09506145 = weight(abstract_txt:global in 1972) [ClassicSimilarity], result of:
           0.09506145 = score(doc=1972,freq=1.0), product of:
             0.21844417 = queryWeight, product of:
               2.215517 = boost
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.01770074 = queryNorm
             0.43517506 = fieldWeight in 1972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.078125 = fieldNorm(doc=1972)
       0.28 = coord(7/25)