Document (#38654)

Author

Líska, M.

Title

Evaluation of mathematics retrieval

Imprint

Brno : Masaryk University, Brno, Faculty of Informatics

Year

2013

Pages

63 S

Abstract

The thesis deals with the evaluation of mathematics information retrieval (IR). It gives an overview of the history of regular IR evaluation, initiatives that are engaged in this field of research as well as most common methods and measures used for evaluation. The findings are applied to the specifics of mathematics retrieval. This thesis also summarizes the state-of-the-art of MIaS math search system, which is already being used in an international web portal. Latest developments aiming towards the second version of the system are described. In addition to participating in the international evaluation conference and workshop, MIaS is tested for effectiveness and efficiency in this work. Measured performance indicators are evaluated and future work is suggested accordingly.

Content

Master Thesis, Masaryk University, Brno, Faculty of Informatics; Advisor: Petr Sojka.

Field

Mathematik

Similar documents (content)

1. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.14

   0.1404262 = sum of:
     0.1404262 = product of:
       0.70213103 = sum of:
         0.15633829 = weight(abstract_txt:workshop in 877) [ClassicSimilarity], result of:
           0.15633829 = score(doc=877,freq=1.0), product of:
             0.15128282 = queryWeight, product of:
               1.0971653 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.020847874 = queryNorm
             1.0334173 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.16234556 = weight(abstract_txt:summarizes in 877) [ClassicSimilarity], result of:
           0.16234556 = score(doc=877,freq=1.0), product of:
             0.15513375 = queryWeight, product of:
               1.1110419 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.020847874 = queryNorm
             1.0464877 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.02258569 = weight(abstract_txt:this in 877) [ClassicSimilarity], result of:
           0.02258569 = score(doc=877,freq=1.0), product of:
             0.06007245 = queryWeight, product of:
               1.1975002 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020847874 = queryNorm
             0.37597418 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.11797956 = weight(abstract_txt:retrieval in 877) [ClassicSimilarity], result of:
           0.11797956 = score(doc=877,freq=3.0), product of:
             0.12539606 = queryWeight, product of:
               1.7301345 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020847874 = queryNorm
             0.9408554 = fieldWeight in 877, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.2428819 = weight(abstract_txt:evaluation in 877) [ClassicSimilarity], result of:
           0.2428819 = score(doc=877,freq=1.0), product of:
             0.34700266 = queryWeight, product of:
               3.7155976 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020847874 = queryNorm
             0.69994247 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
       0.2 = coord(5/25)
   

2. Sojka, P.: Exploiting semantic annotations in math information retrieval (2012) 0.14

   0.13754216 = sum of:
     0.13754216 = product of:
       0.57309234 = sum of:
         0.01635761 = weight(abstract_txt:used in 1032) [ClassicSimilarity], result of:
           0.01635761 = score(doc=1032,freq=1.0), product of:
             0.077958345 = queryWeight, product of:
               1.113842 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.020847874 = queryNorm
             0.20982501 = fieldWeight in 1032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
         0.028728364 = weight(abstract_txt:system in 1032) [ClassicSimilarity], result of:
           0.028728364 = score(doc=1032,freq=3.0), product of:
             0.078683354 = queryWeight, product of:
               1.1190094 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.020847874 = queryNorm
             0.36511362 = fieldWeight in 1032, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
         0.009034276 = weight(abstract_txt:this in 1032) [ClassicSimilarity], result of:
           0.009034276 = score(doc=1032,freq=1.0), product of:
             0.06007245 = queryWeight, product of:
               1.1975002 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020847874 = queryNorm
             0.15038967 = fieldWeight in 1032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
         0.21947263 = weight(abstract_txt:math in 1032) [ClassicSimilarity], result of:
           0.21947263 = score(doc=1032,freq=3.0), product of:
             0.24224372 = queryWeight, product of:
               1.3883647 = boost
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.020847874 = queryNorm
             0.90599924 = fieldWeight in 1032, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
         0.027246213 = weight(abstract_txt:retrieval in 1032) [ClassicSimilarity], result of:
           0.027246213 = score(doc=1032,freq=1.0), product of:
             0.12539606 = queryWeight, product of:
               1.7301345 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020847874 = queryNorm
             0.21728125 = fieldWeight in 1032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
         0.27225322 = weight(abstract_txt:mathematics in 1032) [ClassicSimilarity], result of:
           0.27225322 = score(doc=1032,freq=2.0), product of:
             0.46172684 = queryWeight, product of:
               3.3199418 = boost
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.020847874 = queryNorm
             0.5896413 = fieldWeight in 1032, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.0625 = fieldNorm(doc=1032)
       0.24 = coord(6/25)
   

3. Rousseau, R.; Egghe, L.; Guns, R.: Becoming metric-wise : a bibliometric guide for researchers (2018) 0.13

   0.13294399 = sum of:
     0.13294399 = product of:
       0.47479993 = sum of:
         0.13392267 = weight(abstract_txt:indicators in 226) [ClassicSimilarity], result of:
           0.13392267 = score(doc=226,freq=8.0), product of:
             0.125674 = queryWeight, product of:
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.020847874 = queryNorm
             1.0656354 = fieldWeight in 226, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.054845378 = weight(abstract_txt:initiatives in 226) [ClassicSimilarity], result of:
           0.054845378 = score(doc=226,freq=1.0), product of:
             0.13861154 = queryWeight, product of:
               1.050212 = boost
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.020847874 = queryNorm
             0.39567685 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3308296 = idf(docFreq=214, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.01635761 = weight(abstract_txt:used in 226) [ClassicSimilarity], result of:
           0.01635761 = score(doc=226,freq=1.0), product of:
             0.077958345 = queryWeight, product of:
               1.113842 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.020847874 = queryNorm
             0.20982501 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.009034276 = weight(abstract_txt:this in 226) [ClassicSimilarity], result of:
           0.009034276 = score(doc=226,freq=1.0), product of:
             0.06007245 = queryWeight, product of:
               1.1975002 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020847874 = queryNorm
             0.15038967 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.02352357 = weight(abstract_txt:work in 226) [ClassicSimilarity], result of:
           0.02352357 = score(doc=226,freq=1.0), product of:
             0.099323384 = queryWeight, product of:
               1.2572396 = boost
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.020847874 = queryNorm
             0.23683818 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.044604346 = weight(abstract_txt:international in 226) [ClassicSimilarity], result of:
           0.044604346 = score(doc=226,freq=1.0), product of:
             0.15216011 = queryWeight, product of:
               1.5561186 = boost
               4.6902537 = idf(docFreq=1108, maxDocs=44421)
               0.020847874 = queryNorm
             0.29314086 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6902537 = idf(docFreq=1108, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.1925121 = weight(abstract_txt:mathematics in 226) [ClassicSimilarity], result of:
           0.1925121 = score(doc=226,freq=1.0), product of:
             0.46172684 = queryWeight, product of:
               3.3199418 = boost
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.020847874 = queryNorm
             0.41693935 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
       0.28 = coord(7/25)
   

4. Sojka, P.; Liska, M.: ¬The art of mathematics retrieval (2011) 0.13

   0.13102861 = sum of:
     0.13102861 = product of:
       0.81892884 = sum of:
         0.050274633 = weight(abstract_txt:system in 4450) [ClassicSimilarity], result of:
           0.050274633 = score(doc=4450,freq=3.0), product of:
             0.078683354 = queryWeight, product of:
               1.1190094 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.020847874 = queryNorm
             0.6389488 = fieldWeight in 4450, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.109375 = fieldNorm(doc=4450)
         0.3840771 = weight(abstract_txt:math in 4450) [ClassicSimilarity], result of:
           0.3840771 = score(doc=4450,freq=3.0), product of:
             0.24224372 = queryWeight, product of:
               1.3883647 = boost
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.020847874 = queryNorm
             1.5854987 = fieldWeight in 4450, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.109375 = fieldNorm(doc=4450)
         0.047680873 = weight(abstract_txt:retrieval in 4450) [ClassicSimilarity], result of:
           0.047680873 = score(doc=4450,freq=1.0), product of:
             0.12539606 = queryWeight, product of:
               1.7301345 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020847874 = queryNorm
             0.3802422 = fieldWeight in 4450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=4450)
         0.33689618 = weight(abstract_txt:mathematics in 4450) [ClassicSimilarity], result of:
           0.33689618 = score(doc=4450,freq=1.0), product of:
             0.46172684 = queryWeight, product of:
               3.3199418 = boost
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.020847874 = queryNorm
             0.7296439 = fieldWeight in 4450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.109375 = fieldNorm(doc=4450)
       0.16 = coord(4/25)
   

5. Shechtman, N.; Chung, M.; Roschelle, J.: Supporting member collaboration in the Math Tools digital library : a formative user study (2004) 0.13

   0.12780252 = sum of:
     0.12780252 = product of:
       0.6390126 = sum of:
         0.020447014 = weight(abstract_txt:used in 2163) [ClassicSimilarity], result of:
           0.020447014 = score(doc=2163,freq=1.0), product of:
             0.077958345 = queryWeight, product of:
               1.113842 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.020847874 = queryNorm
             0.26228127 = fieldWeight in 2163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.078125 = fieldNorm(doc=2163)
         0.019559782 = weight(abstract_txt:this in 2163) [ClassicSimilarity], result of:
           0.019559782 = score(doc=2163,freq=3.0), product of:
             0.06007245 = queryWeight, product of:
               1.1975002 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020847874 = queryNorm
             0.3256032 = fieldWeight in 2163, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=2163)
         0.041584186 = weight(abstract_txt:work in 2163) [ClassicSimilarity], result of:
           0.041584186 = score(doc=2163,freq=2.0), product of:
             0.099323384 = queryWeight, product of:
               1.2572396 = boost
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.020847874 = queryNorm
             0.41867468 = fieldWeight in 2163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.078125 = fieldNorm(doc=2163)
         0.31678146 = weight(abstract_txt:math in 2163) [ClassicSimilarity], result of:
           0.31678146 = score(doc=2163,freq=4.0), product of:
             0.24224372 = queryWeight, product of:
               1.3883647 = boost
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.020847874 = queryNorm
             1.3076973 = fieldWeight in 2163, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.078125 = fieldNorm(doc=2163)
         0.24064012 = weight(abstract_txt:mathematics in 2163) [ClassicSimilarity], result of:
           0.24064012 = score(doc=2163,freq=1.0), product of:
             0.46172684 = queryWeight, product of:
               3.3199418 = boost
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.020847874 = queryNorm
             0.5211742 = fieldWeight in 2163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.078125 = fieldNorm(doc=2163)
       0.2 = coord(5/25)