Document (#25267)

Author

Kluck, M.
Mandl, T.
Womser-Hacker, C.

Title

Cross-Language Evaluation Forum (CLEF) : Europäische Initiative zur Bewertung sprachübergreifender Retrievalverfahren

Source

Information - Wissenschaft und Praxis. 53(2002) H.2, S.82-89

Year

2002

Abstract

Seit einigen Jahren hat sich in Europa eine Initiative zur Bewertung von Information Retrieval in mehrsprachigen Kontexten etabliert. Das Cross Language Evaluation forum (CLEF) wird von der EU gefördert und kooperiert mit Evaluierungsprojekten in den USA (TREC) und in Japan (NTCIR). Dieser Artikel stellt das CLEF in den Rahmen der anderen internationalen Initiativen. Neue Entwicklungen sowohl bei den Information Retrieval Systemen als auch bei den Evaluierungsmethoden werden aufgezeit. Die hohe Anzahl von Teilnehmern aus Forschungsinstitutionen und der Industrie beweist die steigende Bedeutung des sprachübergreifenden Retrievals

Theme

Retrievalstudien
Multilinguale Probleme

Object

CLEF

Similar documents (author)

1. Mandl, T.; Womser-Hacker, C.: ¬Ein adaptives Information-Retrieval-Modell für Digitale Bibliotheken (2000) 3.77

   3.7698512 = sum of:
     3.7698512 = product of:
       5.0264683 = sum of:
         1.6390303 = weight(author_txt:hacker in 6481) [ClassicSimilarity], result of:
           1.6390303 = score(doc=6481,freq=1.0), product of:
             0.45989445 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05645565 = queryNorm
             3.5639272 = fieldWeight in 6481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.4375 = fieldNorm(doc=6481)
         1.6937189 = weight(author_txt:mandl in 6481) [ClassicSimilarity], result of:
           1.6937189 = score(doc=6481,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.6031327 = fieldWeight in 6481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.4375 = fieldNorm(doc=6481)
         1.6937189 = weight(author_txt:womser in 6481) [ClassicSimilarity], result of:
           1.6937189 = score(doc=6481,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.6031327 = fieldWeight in 6481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.4375 = fieldNorm(doc=6481)
       0.75 = coord(3/4)
   

2. Womser-Hacker, C.; Mandl. T.: Information Seeking Behaviour (ISB) (2013) 3.77

   3.7698512 = sum of:
     3.7698512 = product of:
       5.0264683 = sum of:
         1.6390303 = weight(author_txt:hacker in 1709) [ClassicSimilarity], result of:
           1.6390303 = score(doc=1709,freq=1.0), product of:
             0.45989445 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05645565 = queryNorm
             3.5639272 = fieldWeight in 1709, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.4375 = fieldNorm(doc=1709)
         1.6937189 = weight(author_txt:mandl in 1709) [ClassicSimilarity], result of:
           1.6937189 = score(doc=1709,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.6031327 = fieldWeight in 1709, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.4375 = fieldNorm(doc=1709)
         1.6937189 = weight(author_txt:womser in 1709) [ClassicSimilarity], result of:
           1.6937189 = score(doc=1709,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.6031327 = fieldWeight in 1709, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.4375 = fieldNorm(doc=1709)
       0.75 = coord(3/4)
   

3. Hanke, P.; Mandl, T.; Womser-Hacker, C.: ¬Ein "Virtuelles Bibliotheksregal" für die Informationswissenschaft als Anwendungsfall semantischer Heterogenität (2002) 3.23

   3.2313008 = sum of:
     3.2313008 = product of:
       4.308401 = sum of:
         1.4048831 = weight(author_txt:hacker in 5858) [ClassicSimilarity], result of:
           1.4048831 = score(doc=5858,freq=1.0), product of:
             0.45989445 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05645565 = queryNorm
             3.0547948 = fieldWeight in 5858, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.375 = fieldNorm(doc=5858)
         1.4517591 = weight(author_txt:mandl in 5858) [ClassicSimilarity], result of:
           1.4517591 = score(doc=5858,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 5858, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=5858)
         1.4517591 = weight(author_txt:womser in 5858) [ClassicSimilarity], result of:
           1.4517591 = score(doc=5858,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 5858, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=5858)
       0.75 = coord(3/4)
   

4. Becks, D.; Mandl, T.; Womser-Hacker, C.: Spezielle Anforderungen bei der Evaluierung von Patent-Retrieval-Systemen (2010) 3.23

   3.2313008 = sum of:
     3.2313008 = product of:
       4.308401 = sum of:
         1.4048831 = weight(author_txt:hacker in 667) [ClassicSimilarity], result of:
           1.4048831 = score(doc=667,freq=1.0), product of:
             0.45989445 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05645565 = queryNorm
             3.0547948 = fieldWeight in 667, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.375 = fieldNorm(doc=667)
         1.4517591 = weight(author_txt:mandl in 667) [ClassicSimilarity], result of:
           1.4517591 = score(doc=667,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 667, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=667)
         1.4517591 = weight(author_txt:womser in 667) [ClassicSimilarity], result of:
           1.4517591 = score(doc=667,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 667, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=667)
       0.75 = coord(3/4)
   

5. Furtner, K.C.; Mandl, T.; Womser-Hacker, C.: Effects of auto-suggest on the usability of search in eCommerce (2015) 3.23

   3.2313008 = sum of:
     3.2313008 = product of:
       4.308401 = sum of:
         1.4048831 = weight(author_txt:hacker in 3993) [ClassicSimilarity], result of:
           1.4048831 = score(doc=3993,freq=1.0), product of:
             0.45989445 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.05645565 = queryNorm
             3.0547948 = fieldWeight in 3993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.375 = fieldNorm(doc=3993)
         1.4517591 = weight(author_txt:mandl in 3993) [ClassicSimilarity], result of:
           1.4517591 = score(doc=3993,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 3993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=3993)
         1.4517591 = weight(author_txt:womser in 3993) [ClassicSimilarity], result of:
           1.4517591 = score(doc=3993,freq=1.0), product of:
             0.47006842 = queryWeight, product of:
               1.0110008 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.05645565 = queryNorm
             3.0883994 = fieldWeight in 3993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.375 = fieldNorm(doc=3993)
       0.75 = coord(3/4)
   

Similar documents (content)

1. Peters, C.; Braschler, M.: Cross-language system evaluation : the CLEF campaigns (2001) 0.18

   0.17994295 = sum of:
     0.17994295 = product of:
       0.8997147 = sum of:
         0.038584 = weight(abstract_txt:language in 979) [ClassicSimilarity], result of:
           0.038584 = score(doc=979,freq=1.0), product of:
             0.084576614 = queryWeight, product of:
               1.1755391 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017249413 = queryNorm
             0.45620176 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.109375 = fieldNorm(doc=979)
         0.082790054 = weight(abstract_txt:evaluation in 979) [ClassicSimilarity], result of:
           0.082790054 = score(doc=979,freq=3.0), product of:
             0.09755671 = queryWeight, product of:
               1.2625265 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017249413 = queryNorm
             0.84863514 = fieldWeight in 979, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=979)
         0.09343764 = weight(abstract_txt:cross in 979) [ClassicSimilarity], result of:
           0.09343764 = score(doc=979,freq=1.0), product of:
             0.15251997 = queryWeight, product of:
               1.5786116 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.017249413 = queryNorm
             0.6126256 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.109375 = fieldNorm(doc=979)
         0.17574142 = weight(abstract_txt:forum in 979) [ClassicSimilarity], result of:
           0.17574142 = score(doc=979,freq=1.0), product of:
             0.23239577 = queryWeight, product of:
               1.9486151 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.017249413 = queryNorm
             0.7562161 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.109375 = fieldNorm(doc=979)
         0.5091616 = weight(abstract_txt:clef in 979) [ClassicSimilarity], result of:
           0.5091616 = score(doc=979,freq=1.0), product of:
             0.54064596 = queryWeight, product of:
               3.6401062 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.017249413 = queryNorm
             0.94176525 = fieldWeight in 979, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.109375 = fieldNorm(doc=979)
       0.2 = coord(5/25)
   

2. Scheufen, J.-H.: RECOIN: Modell offener Schnittstellen für Information-Retrieval-Systeme und -Komponenten (2006) 0.17

   0.17294471 = sum of:
     0.17294471 = product of:
       0.8647235 = sum of:
         0.038584 = weight(abstract_txt:language in 5901) [ClassicSimilarity], result of:
           0.038584 = score(doc=5901,freq=1.0), product of:
             0.084576614 = queryWeight, product of:
               1.1755391 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017249413 = queryNorm
             0.45620176 = fieldWeight in 5901, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.109375 = fieldNorm(doc=5901)
         0.04779886 = weight(abstract_txt:evaluation in 5901) [ClassicSimilarity], result of:
           0.04779886 = score(doc=5901,freq=1.0), product of:
             0.09755671 = queryWeight, product of:
               1.2625265 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017249413 = queryNorm
             0.48995975 = fieldWeight in 5901, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=5901)
         0.09343764 = weight(abstract_txt:cross in 5901) [ClassicSimilarity], result of:
           0.09343764 = score(doc=5901,freq=1.0), product of:
             0.15251997 = queryWeight, product of:
               1.5786116 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.017249413 = queryNorm
             0.6126256 = fieldWeight in 5901, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.109375 = fieldNorm(doc=5901)
         0.17574142 = weight(abstract_txt:forum in 5901) [ClassicSimilarity], result of:
           0.17574142 = score(doc=5901,freq=1.0), product of:
             0.23239577 = queryWeight, product of:
               1.9486151 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.017249413 = queryNorm
             0.7562161 = fieldWeight in 5901, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.109375 = fieldNorm(doc=5901)
         0.5091616 = weight(abstract_txt:clef in 5901) [ClassicSimilarity], result of:
           0.5091616 = score(doc=5901,freq=1.0), product of:
             0.54064596 = queryWeight, product of:
               3.6401062 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.017249413 = queryNorm
             0.94176525 = fieldWeight in 5901, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.109375 = fieldNorm(doc=5901)
       0.2 = coord(5/25)
   

3. Effektive Information Retrieval Verfahren in Theorie und Praxis : ausgewählte und erweiterte Beiträge des Vierten Hildesheimer Evaluierungs- und Retrievalworkshop (HIER 2005), Hildesheim, 20.7.2005 (2006) 0.15

   0.14823833 = sum of:
     0.14823833 = product of:
       0.7411916 = sum of:
         0.033072 = weight(abstract_txt:language in 973) [ClassicSimilarity], result of:
           0.033072 = score(doc=973,freq=1.0), product of:
             0.084576614 = queryWeight, product of:
               1.1755391 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017249413 = queryNorm
             0.39103007 = fieldWeight in 973, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.09375 = fieldNorm(doc=973)
         0.040970452 = weight(abstract_txt:evaluation in 973) [ClassicSimilarity], result of:
           0.040970452 = score(doc=973,freq=1.0), product of:
             0.09755671 = queryWeight, product of:
               1.2625265 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017249413 = queryNorm
             0.4199655 = fieldWeight in 973, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=973)
         0.080089405 = weight(abstract_txt:cross in 973) [ClassicSimilarity], result of:
           0.080089405 = score(doc=973,freq=1.0), product of:
             0.15251997 = queryWeight, product of:
               1.5786116 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.017249413 = queryNorm
             0.5251077 = fieldWeight in 973, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.09375 = fieldNorm(doc=973)
         0.15063551 = weight(abstract_txt:forum in 973) [ClassicSimilarity], result of:
           0.15063551 = score(doc=973,freq=1.0), product of:
             0.23239577 = queryWeight, product of:
               1.9486151 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.017249413 = queryNorm
             0.64818525 = fieldWeight in 973, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.09375 = fieldNorm(doc=973)
         0.43642423 = weight(abstract_txt:clef in 973) [ClassicSimilarity], result of:
           0.43642423 = score(doc=973,freq=1.0), product of:
             0.54064596 = queryWeight, product of:
               3.6401062 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.017249413 = queryNorm
             0.8072274 = fieldWeight in 973, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.09375 = fieldNorm(doc=973)
       0.2 = coord(5/25)
   

4. García Cumbreras, M.A.; Perea-Ortega, J.M.; García Vega, M.; Ureña López, L.A.: Information retrieval with geographical references : relevant documents filtering vs. query expansion (2009) 0.15

   0.14823833 = sum of:
     0.14823833 = product of:
       0.7411916 = sum of:
         0.033072 = weight(abstract_txt:language in 222) [ClassicSimilarity], result of:
           0.033072 = score(doc=222,freq=1.0), product of:
             0.084576614 = queryWeight, product of:
               1.1755391 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017249413 = queryNorm
             0.39103007 = fieldWeight in 222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.09375 = fieldNorm(doc=222)
         0.040970452 = weight(abstract_txt:evaluation in 222) [ClassicSimilarity], result of:
           0.040970452 = score(doc=222,freq=1.0), product of:
             0.09755671 = queryWeight, product of:
               1.2625265 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017249413 = queryNorm
             0.4199655 = fieldWeight in 222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=222)
         0.080089405 = weight(abstract_txt:cross in 222) [ClassicSimilarity], result of:
           0.080089405 = score(doc=222,freq=1.0), product of:
             0.15251997 = queryWeight, product of:
               1.5786116 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.017249413 = queryNorm
             0.5251077 = fieldWeight in 222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.09375 = fieldNorm(doc=222)
         0.15063551 = weight(abstract_txt:forum in 222) [ClassicSimilarity], result of:
           0.15063551 = score(doc=222,freq=1.0), product of:
             0.23239577 = queryWeight, product of:
               1.9486151 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.017249413 = queryNorm
             0.64818525 = fieldWeight in 222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.09375 = fieldNorm(doc=222)
         0.43642423 = weight(abstract_txt:clef in 222) [ClassicSimilarity], result of:
           0.43642423 = score(doc=222,freq=1.0), product of:
             0.54064596 = queryWeight, product of:
               3.6401062 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.017249413 = queryNorm
             0.8072274 = fieldWeight in 222, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.09375 = fieldNorm(doc=222)
       0.2 = coord(5/25)
   

5. Fujita, S.: NTCIR-2 as a Rosetta stone in laboratory experiments of IR systems (2005) 0.06

   0.060319986 = sum of:
     0.060319986 = product of:
       0.3769999 = sum of:
         0.038975727 = weight(abstract_txt:language in 2017) [ClassicSimilarity], result of:
           0.038975727 = score(doc=2017,freq=2.0), product of:
             0.084576614 = queryWeight, product of:
               1.1755391 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.017249413 = queryNorm
             0.46083337 = fieldWeight in 2017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2017)
         0.04828414 = weight(abstract_txt:evaluation in 2017) [ClassicSimilarity], result of:
           0.04828414 = score(doc=2017,freq=2.0), product of:
             0.09755671 = queryWeight, product of:
               1.2625265 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017249413 = queryNorm
             0.49493405 = fieldWeight in 2017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=2017)
         0.19535378 = weight(abstract_txt:ntcir in 2017) [ClassicSimilarity], result of:
           0.19535378 = score(doc=2017,freq=2.0), product of:
             0.19660386 = queryWeight, product of:
               1.2673395 = boost
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.017249413 = queryNorm
             0.9936416 = fieldWeight in 2017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.078125 = fieldNorm(doc=2017)
         0.09438627 = weight(abstract_txt:cross in 2017) [ClassicSimilarity], result of:
           0.09438627 = score(doc=2017,freq=2.0), product of:
             0.15251997 = queryWeight, product of:
               1.5786116 = boost
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.017249413 = queryNorm
             0.61884534 = fieldWeight in 2017, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6011486 = idf(docFreq=445, maxDocs=44421)
               0.078125 = fieldNorm(doc=2017)
       0.16 = coord(4/25)