Document (#36976)

Author

Farreús, M.
Costa-jussà, M.R.
Popovic' Morse, M.

Title

Study and correlation analysis of linguistic, perceptual, and automatic machine translation evaluations

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.1, S.174-184

Year

2012

Abstract

Evaluation of machine translation output is an important task. Various human evaluation techniques as well as automatic metrics have been proposed and investigated in the last decade. However, very few evaluation methods take the linguistic aspect into account. In this article, we use an objective evaluation method for machine translation output that classifies all translation errors into one of the five following linguistic levels: orthographic, morphological, lexical, semantic, and syntactic. Linguistic guidelines for the target language are required, and human evaluators use them in to classify the output errors. The experiments are performed on English-to-Catalan and Spanish-to-Catalan translation outputs generated by four different systems: 2 rule-based and 2 statistical. All translations are evaluated using the 3 following methods: a standard human perceptual evaluation method, several widely used automatic metrics, and the human linguistic evaluation. Pearson and Spearman correlation coefficients between the linguistic, perceptual, and automatic results are then calculated, showing that the semantic level correlates significantly with both perceptual evaluation and automatic metrics.

Theme

Computerlinguistik

Similar documents (author)

1. Morse, P.M.: Search theory and browsing (1970) 2.32

   2.3156893 = sum of:
     2.3156893 = product of:
       4.6313787 = sum of:
         4.6313787 = weight(author_txt:morse in 1447) [ClassicSimilarity], result of:
           4.6313787 = score(doc=1447,freq=1.0), product of:
             0.7701295 = queryWeight, product of:
               1.0987775 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07284293 = queryNorm
             6.0137663 = fieldWeight in 1447, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=1447)
       0.5 = coord(1/2)
   

2. Morse, P.M.: Browsing and search theory (1973) 2.32

   2.3156893 = sum of:
     2.3156893 = product of:
       4.6313787 = sum of:
         4.6313787 = weight(author_txt:morse in 4339) [ClassicSimilarity], result of:
           4.6313787 = score(doc=4339,freq=1.0), product of:
             0.7701295 = queryWeight, product of:
               1.0987775 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07284293 = queryNorm
             6.0137663 = fieldWeight in 4339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=4339)
       0.5 = coord(1/2)
   

3. Morse, T.: Mapping relationships : examining bibliographic relationships in sheet maps from Tillett to RDA (2012) 2.32

   2.3156893 = sum of:
     2.3156893 = product of:
       4.6313787 = sum of:
         4.6313787 = weight(author_txt:morse in 2896) [ClassicSimilarity], result of:
           4.6313787 = score(doc=2896,freq=1.0), product of:
             0.7701295 = queryWeight, product of:
               1.0987775 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07284293 = queryNorm
             6.0137663 = fieldWeight in 2896, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=2896)
       0.5 = coord(1/2)
   

4. Costa, F. Di -> Di Costa, F.: 1.48

   1.4812121 = sum of:
     1.4812121 = product of:
       2.9624243 = sum of:
         2.9624243 = weight(author_txt:costa in 567) [ClassicSimilarity], result of:
           2.9624243 = score(doc=567,freq=2.0), product of:
             0.63788766 = queryWeight, product of:
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.07284293 = queryNorm
             4.644116 = fieldWeight in 567, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.375 = fieldNorm(doc=567)
       0.5 = coord(1/2)
   

5. Oliveira, E. Costa => Costa Oliveira, E.: 1.48

   1.4812121 = sum of:
     1.4812121 = product of:
       2.9624243 = sum of:
         2.9624243 = weight(author_txt:costa in 1573) [ClassicSimilarity], result of:
           2.9624243 = score(doc=1573,freq=2.0), product of:
             0.63788766 = queryWeight, product of:
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.07284293 = queryNorm
             4.644116 = fieldWeight in 1573, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.375 = fieldNorm(doc=1573)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.23

   0.23020451 = sum of:
     0.23020451 = product of:
       0.82215893 = sum of:
         0.035024673 = weight(abstract_txt:methods in 1942) [ClassicSimilarity], result of:
           0.035024673 = score(doc=1942,freq=3.0), product of:
             0.062468197 = queryWeight, product of:
               1.1207353 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0134521425 = queryNorm
             0.5606801 = fieldWeight in 1942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.08332046 = weight(abstract_txt:coefficients in 1942) [ClassicSimilarity], result of:
           0.08332046 = score(doc=1942,freq=1.0), product of:
             0.12743081 = queryWeight, product of:
               1.131868 = boost
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.0134521425 = queryNorm
             0.65384865 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.05176568 = weight(abstract_txt:method in 1942) [ClassicSimilarity], result of:
           0.05176568 = score(doc=1942,freq=4.0), product of:
             0.07364184 = queryWeight, product of:
               1.2168467 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0134521425 = queryNorm
             0.7029385 = fieldWeight in 1942, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.07244759 = weight(abstract_txt:correlation in 1942) [ClassicSimilarity], result of:
           0.07244759 = score(doc=1942,freq=1.0), product of:
             0.14626238 = queryWeight, product of:
               1.7149042 = boost
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0134521425 = queryNorm
             0.49532622 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.082481764 = weight(abstract_txt:human in 1942) [ClassicSimilarity], result of:
           0.082481764 = score(doc=1942,freq=2.0), product of:
             0.15947354 = queryWeight, product of:
               2.5324032 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0134521425 = queryNorm
             0.51721287 = fieldWeight in 1942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.24415396 = weight(abstract_txt:automatic in 1942) [ClassicSimilarity], result of:
           0.24415396 = score(doc=1942,freq=6.0), product of:
             0.24555874 = queryWeight, product of:
               3.5133486 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0134521425 = queryNorm
             0.99427927 = fieldWeight in 1942, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.2529648 = weight(abstract_txt:evaluation in 1942) [ClassicSimilarity], result of:
           0.2529648 = score(doc=1942,freq=8.0), product of:
             0.25555405 = queryWeight, product of:
               4.2408113 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0134521425 = queryNorm
             0.9898681 = fieldWeight in 1942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
       0.28 = coord(7/25)
   

2. Olvera-Lobo, M.-D.; García-Santiago, L.: Analysis of errors in the automatic translation of questions for translingual QA systems (2010) 0.21

   0.20592728 = sum of:
     0.20592728 = product of:
       0.73545456 = sum of:
         0.010055471 = weight(abstract_txt:into in 943) [ClassicSimilarity], result of:
           0.010055471 = score(doc=943,freq=1.0), product of:
             0.049733944 = queryWeight, product of:
               3.697102 = idf(docFreq=2993, maxDocs=44421)
               0.0134521425 = queryNorm
             0.20218527 = fieldWeight in 943, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.697102 = idf(docFreq=2993, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.060004357 = weight(abstract_txt:translations in 943) [ClassicSimilarity], result of:
           0.060004357 = score(doc=943,freq=2.0), product of:
             0.10307495 = queryWeight, product of:
               1.0179703 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.0134521425 = queryNorm
             0.58214295 = fieldWeight in 943, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.07901218 = weight(abstract_txt:errors in 943) [ClassicSimilarity], result of:
           0.07901218 = score(doc=943,freq=2.0), product of:
             0.15601654 = queryWeight, product of:
               1.7711644 = boost
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.0134521425 = queryNorm
             0.5064346 = fieldWeight in 943, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.548176 = idf(docFreq=172, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.09867364 = weight(abstract_txt:automatic in 943) [ClassicSimilarity], result of:
           0.09867364 = score(doc=943,freq=2.0), product of:
             0.24555874 = queryWeight, product of:
               3.5133486 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0134521425 = queryNorm
             0.40183315 = fieldWeight in 943, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.2620403 = weight(abstract_txt:translation in 943) [ClassicSimilarity], result of:
           0.2620403 = score(doc=943,freq=5.0), product of:
             0.34696582 = queryWeight, product of:
               4.176254 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0134521425 = queryNorm
             0.75523376 = fieldWeight in 943, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.10843607 = weight(abstract_txt:evaluation in 943) [ClassicSimilarity], result of:
           0.10843607 = score(doc=943,freq=3.0), product of:
             0.25555405 = queryWeight, product of:
               4.2408113 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0134521425 = queryNorm
             0.42431757 = fieldWeight in 943, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
         0.11723258 = weight(abstract_txt:linguistic in 943) [ClassicSimilarity], result of:
           0.11723258 = score(doc=943,freq=1.0), product of:
             0.36879975 = queryWeight, product of:
               4.7166047 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0134521425 = queryNorm
             0.31787598 = fieldWeight in 943, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0546875 = fieldNorm(doc=943)
       0.28 = coord(7/25)
   

3. Melby, A.: Some notes on 'The proper place of men and machines in language translation' (1997) 0.19

   0.19477986 = sum of:
     0.19477986 = product of:
       0.97389925 = sum of:
         0.05464413 = weight(abstract_txt:following in 1330) [ClassicSimilarity], result of:
           0.05464413 = score(doc=1330,freq=1.0), product of:
             0.09684123 = queryWeight, product of:
               1.395416 = boost
               5.1589956 = idf(docFreq=693, maxDocs=44421)
               0.0134521425 = queryNorm
             0.56426513 = fieldWeight in 1330, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1589956 = idf(docFreq=693, maxDocs=44421)
               0.109375 = fieldNorm(doc=1330)
         0.08761967 = weight(abstract_txt:machine in 1330) [ClassicSimilarity], result of:
           0.08761967 = score(doc=1330,freq=1.0), product of:
             0.15186678 = queryWeight, product of:
               2.1401813 = boost
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.0134521425 = queryNorm
             0.57695085 = fieldWeight in 1330, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.109375 = fieldNorm(doc=1330)
         0.24740903 = weight(abstract_txt:output in 1330) [ClassicSimilarity], result of:
           0.24740903 = score(doc=1330,freq=4.0), product of:
             0.19112554 = queryWeight, product of:
               2.4009247 = boost
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.0134521425 = queryNorm
             1.2944844 = fieldWeight in 1330, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.109375 = fieldNorm(doc=1330)
         0.115474485 = weight(abstract_txt:human in 1330) [ClassicSimilarity], result of:
           0.115474485 = score(doc=1330,freq=2.0), product of:
             0.15947354 = queryWeight, product of:
               2.5324032 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0134521425 = queryNorm
             0.7240981 = fieldWeight in 1330, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.109375 = fieldNorm(doc=1330)
         0.46875197 = weight(abstract_txt:translation in 1330) [ClassicSimilarity], result of:
           0.46875197 = score(doc=1330,freq=4.0), product of:
             0.34696582 = queryWeight, product of:
               4.176254 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0134521425 = queryNorm
             1.3510033 = fieldWeight in 1330, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.109375 = fieldNorm(doc=1330)
       0.2 = coord(5/25)
   

4. Zimmermann, H.H.: Language and language technology (1991) 0.17

   0.17374821 = sum of:
     0.17374821 = product of:
       1.0859263 = sum of:
         0.21680245 = weight(abstract_txt:machine in 3568) [ClassicSimilarity], result of:
           0.21680245 = score(doc=3568,freq=3.0), product of:
             0.15186678 = queryWeight, product of:
               2.1401813 = boost
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.0134521425 = queryNorm
             1.4275831 = fieldWeight in 3568, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.15625 = fieldNorm(doc=3568)
         0.19935085 = weight(abstract_txt:automatic in 3568) [ClassicSimilarity], result of:
           0.19935085 = score(doc=3568,freq=1.0), product of:
             0.24555874 = queryWeight, product of:
               3.5133486 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0134521425 = queryNorm
             0.8118255 = fieldWeight in 3568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.15625 = fieldNorm(doc=3568)
         0.3348228 = weight(abstract_txt:translation in 3568) [ClassicSimilarity], result of:
           0.3348228 = score(doc=3568,freq=1.0), product of:
             0.34696582 = queryWeight, product of:
               4.176254 = boost
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.0134521425 = queryNorm
             0.9650023 = fieldWeight in 3568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.176015 = idf(docFreq=250, maxDocs=44421)
               0.15625 = fieldNorm(doc=3568)
         0.33495024 = weight(abstract_txt:linguistic in 3568) [ClassicSimilarity], result of:
           0.33495024 = score(doc=3568,freq=1.0), product of:
             0.36879975 = queryWeight, product of:
               4.7166047 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0134521425 = queryNorm
             0.90821713 = fieldWeight in 3568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.15625 = fieldNorm(doc=3568)
       0.16 = coord(4/25)
   

5. Salton, G.: Automatic processing of foreign language documents (1985) 0.17

   0.16629098 = sum of:
     0.16629098 = product of:
       0.46191937 = sum of:
         0.014928503 = weight(abstract_txt:into in 4650) [ClassicSimilarity], result of:
           0.014928503 = score(doc=4650,freq=3.0), product of:
             0.049733944 = queryWeight, product of:
               3.697102 = idf(docFreq=2993, maxDocs=44421)
               0.0134521425 = queryNorm
             0.3001673 = fieldWeight in 4650, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.697102 = idf(docFreq=2993, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.012132904 = weight(abstract_txt:methods in 4650) [ClassicSimilarity], result of:
           0.012132904 = score(doc=4650,freq=1.0), product of:
             0.062468197 = queryWeight, product of:
               1.1207353 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0134521425 = queryNorm
             0.19422528 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.023418913 = weight(abstract_txt:following in 4650) [ClassicSimilarity], result of:
           0.023418913 = score(doc=4650,freq=1.0), product of:
             0.09684123 = queryWeight, product of:
               1.395416 = boost
               5.1589956 = idf(docFreq=693, maxDocs=44421)
               0.0134521425 = queryNorm
             0.24182792 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1589956 = idf(docFreq=693, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.043468554 = weight(abstract_txt:correlation in 4650) [ClassicSimilarity], result of:
           0.043468554 = score(doc=4650,freq=1.0), product of:
             0.14626238 = queryWeight, product of:
               1.7149042 = boost
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.0134521425 = queryNorm
             0.29719573 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3401756 = idf(docFreq=212, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.05301622 = weight(abstract_txt:output in 4650) [ClassicSimilarity], result of:
           0.05301622 = score(doc=4650,freq=1.0), product of:
             0.19112554 = queryWeight, product of:
               2.4009247 = boost
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.0134521425 = queryNorm
             0.2773895 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.034994055 = weight(abstract_txt:human in 4650) [ClassicSimilarity], result of:
           0.034994055 = score(doc=4650,freq=1.0), product of:
             0.15947354 = queryWeight, product of:
               2.5324032 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0134521425 = queryNorm
             0.21943486 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.10358574 = weight(abstract_txt:automatic in 4650) [ClassicSimilarity], result of:
           0.10358574 = score(doc=4650,freq=3.0), product of:
             0.24555874 = queryWeight, product of:
               3.5133486 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0134521425 = queryNorm
             0.4218369 = fieldWeight in 4650, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.075889446 = weight(abstract_txt:evaluation in 4650) [ClassicSimilarity], result of:
           0.075889446 = score(doc=4650,freq=2.0), product of:
             0.25555405 = queryWeight, product of:
               4.2408113 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0134521425 = queryNorm
             0.29696044 = fieldWeight in 4650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
         0.10048507 = weight(abstract_txt:linguistic in 4650) [ClassicSimilarity], result of:
           0.10048507 = score(doc=4650,freq=1.0), product of:
             0.36879975 = queryWeight, product of:
               4.7166047 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0134521425 = queryNorm
             0.27246514 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.046875 = fieldNorm(doc=4650)
       0.36 = coord(9/25)