Document (#36976)

Author

Farreús, M.
Costa-jussà, M.R.
Popovic' Morse, M.

Title

Study and correlation analysis of linguistic, perceptual, and automatic machine translation evaluations

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.1, S.174-184

Year

2012

Abstract

Evaluation of machine translation output is an important task. Various human evaluation techniques as well as automatic metrics have been proposed and investigated in the last decade. However, very few evaluation methods take the linguistic aspect into account. In this article, we use an objective evaluation method for machine translation output that classifies all translation errors into one of the five following linguistic levels: orthographic, morphological, lexical, semantic, and syntactic. Linguistic guidelines for the target language are required, and human evaluators use them in to classify the output errors. The experiments are performed on English-to-Catalan and Spanish-to-Catalan translation outputs generated by four different systems: 2 rule-based and 2 statistical. All translations are evaluated using the 3 following methods: a standard human perceptual evaluation method, several widely used automatic metrics, and the human linguistic evaluation. Pearson and Spearman correlation coefficients between the linguistic, perceptual, and automatic results are then calculated, showing that the semantic level correlates significantly with both perceptual evaluation and automatic metrics.

Theme

Computerlinguistik

Similar documents (author)

1. Morse, P.M.: Search theory and browsing (1970) 2.31

   2.3146756 = sum of:
     2.3146756 = product of:
       4.629351 = sum of:
         4.629351 = weight(author_txt:morse in 1448) [ClassicSimilarity], result of:
           4.629351 = score(doc=1448,freq=1.0), product of:
             0.77015895 = queryWeight, product of:
               1.0988293 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.07287698 = queryNorm
             6.010904 = fieldWeight in 1448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.625 = fieldNorm(doc=1448)
       0.5 = coord(1/2)
   

2. Morse, P.M.: Browsing and search theory (1973) 2.31

   2.3146756 = sum of:
     2.3146756 = product of:
       4.629351 = sum of:
         4.629351 = weight(author_txt:morse in 3339) [ClassicSimilarity], result of:
           4.629351 = score(doc=3339,freq=1.0), product of:
             0.77015895 = queryWeight, product of:
               1.0988293 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.07287698 = queryNorm
             6.010904 = fieldWeight in 3339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.625 = fieldNorm(doc=3339)
       0.5 = coord(1/2)
   

3. Morse, T.: Mapping relationships : examining bibliographic relationships in sheet maps from Tillett to RDA (2012) 2.31

   2.3146756 = sum of:
     2.3146756 = product of:
       4.629351 = sum of:
         4.629351 = weight(author_txt:morse in 1896) [ClassicSimilarity], result of:
           4.629351 = score(doc=1896,freq=1.0), product of:
             0.77015895 = queryWeight, product of:
               1.0988293 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.07287698 = queryNorm
             6.010904 = fieldWeight in 1896, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.625 = fieldNorm(doc=1896)
       0.5 = coord(1/2)
   

4. Costa, F. Di -> Di Costa, F.: 1.48

   1.4803545 = sum of:
     1.4803545 = product of:
       2.960709 = sum of:
         2.960709 = weight(author_txt:costa in 568) [ClassicSimilarity], result of:
           2.960709 = score(doc=568,freq=2.0), product of:
             0.637852 = queryWeight, product of:
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.07287698 = queryNorm
             4.6416864 = fieldWeight in 568, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.375 = fieldNorm(doc=568)
       0.5 = coord(1/2)
   

5. Oliveira, E. Costa => Costa Oliveira, E.: 1.48

   1.4803545 = sum of:
     1.4803545 = product of:
       2.960709 = sum of:
         2.960709 = weight(author_txt:costa in 573) [ClassicSimilarity], result of:
           2.960709 = score(doc=573,freq=2.0), product of:
             0.637852 = queryWeight, product of:
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.07287698 = queryNorm
             4.6416864 = fieldWeight in 573, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.375 = fieldNorm(doc=573)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.23

   0.23006228 = sum of:
     0.23006228 = product of:
       0.821651 = sum of:
         0.03500113 = weight(abstract_txt:methods in 942) [ClassicSimilarity], result of:
           0.03500113 = score(doc=942,freq=3.0), product of:
             0.06237683 = queryWeight, product of:
               1.1198571 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0134323705 = queryNorm
             0.56112385 = fieldWeight in 942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.08293077 = weight(abstract_txt:coefficients in 942) [ClassicSimilarity], result of:
           0.08293077 = score(doc=942,freq=1.0), product of:
             0.12690425 = queryWeight, product of:
               1.1294682 = boost
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.0134323705 = queryNorm
             0.6534909 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.364683 = idf(docFreq=27, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.05168205 = weight(abstract_txt:method in 942) [ClassicSimilarity], result of:
           0.05168205 = score(doc=942,freq=4.0), product of:
             0.07348785 = queryWeight, product of:
               1.2155105 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.0134323705 = queryNorm
             0.7032734 = fieldWeight in 942, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.072555974 = weight(abstract_txt:correlation in 942) [ClassicSimilarity], result of:
           0.072555974 = score(doc=942,freq=1.0), product of:
             0.14625964 = queryWeight, product of:
               1.7147988 = boost
               6.3497796 = idf(docFreq=209, maxDocs=44218)
               0.0134323705 = queryNorm
             0.49607652 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3497796 = idf(docFreq=209, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.08279758 = weight(abstract_txt:human in 942) [ClassicSimilarity], result of:
           0.08279758 = score(doc=942,freq=2.0), product of:
             0.1597181 = queryWeight, product of:
               2.5342124 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0134323705 = queryNorm
             0.5183982 = fieldWeight in 942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.24339934 = weight(abstract_txt:automatic in 942) [ClassicSimilarity], result of:
           0.24339934 = score(doc=942,freq=6.0), product of:
             0.24480383 = queryWeight, product of:
               3.5077615 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0134323705 = queryNorm
             0.99426275 = fieldWeight in 942, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.25328416 = weight(abstract_txt:evaluation in 942) [ClassicSimilarity], result of:
           0.25328416 = score(doc=942,freq=8.0), product of:
             0.25550953 = queryWeight, product of:
               4.240221 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0134323705 = queryNorm
             0.9912905 = fieldWeight in 942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
       0.28 = coord(7/25)
   

2. Olvera-Lobo, M.-D.; García-Santiago, L.: Analysis of errors in the automatic translation of questions for translingual QA systems (2010) 0.21

   0.2056106 = sum of:
     0.2056106 = product of:
       0.73432356 = sum of:
         0.010072369 = weight(abstract_txt:into in 3956) [ClassicSimilarity], result of:
           0.010072369 = score(doc=3956,freq=1.0), product of:
             0.049739122 = queryWeight, product of:
               3.7029297 = idf(docFreq=2962, maxDocs=44218)
               0.0134323705 = queryNorm
             0.20250396 = fieldWeight in 3956, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7029297 = idf(docFreq=2962, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.059712723 = weight(abstract_txt:translations in 3956) [ClassicSimilarity], result of:
           0.059712723 = score(doc=3956,freq=2.0), product of:
             0.10263645 = queryWeight, product of:
               1.0157498 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0134323705 = queryNorm
             0.58178866 = fieldWeight in 3956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.07881581 = weight(abstract_txt:errors in 3956) [ClassicSimilarity], result of:
           0.07881581 = score(doc=3956,freq=2.0), product of:
             0.15559988 = queryWeight, product of:
               1.7687056 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0134323705 = queryNorm
             0.50652874 = fieldWeight in 3956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.09836867 = weight(abstract_txt:automatic in 3956) [ClassicSimilarity], result of:
           0.09836867 = score(doc=3956,freq=2.0), product of:
             0.24480383 = queryWeight, product of:
               3.5077615 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0134323705 = queryNorm
             0.4018265 = fieldWeight in 3956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.26116872 = weight(abstract_txt:translation in 3956) [ClassicSimilarity], result of:
           0.26116872 = score(doc=3956,freq=5.0), product of:
             0.3458447 = queryWeight, product of:
               4.1692843 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0134323705 = queryNorm
             0.7551619 = fieldWeight in 3956, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.10857297 = weight(abstract_txt:evaluation in 3956) [ClassicSimilarity], result of:
           0.10857297 = score(doc=3956,freq=3.0), product of:
             0.25550953 = queryWeight, product of:
               4.240221 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0134323705 = queryNorm
             0.42492726 = fieldWeight in 3956, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
         0.11761231 = weight(abstract_txt:linguistic in 3956) [ClassicSimilarity], result of:
           0.11761231 = score(doc=3956,freq=1.0), product of:
             0.3692206 = queryWeight, product of:
               4.7190495 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0134323705 = queryNorm
             0.3185421 = fieldWeight in 3956, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3956)
       0.28 = coord(7/25)
   

3. Melby, A.: Some notes on 'The proper place of men and machines in language translation' (1997) 0.19

   0.19433399 = sum of:
     0.19433399 = product of:
       0.9716699 = sum of:
         0.05456195 = weight(abstract_txt:following in 330) [ClassicSimilarity], result of:
           0.05456195 = score(doc=330,freq=1.0), product of:
             0.09664594 = queryWeight, product of:
               1.3939357 = boost
               5.161646 = idf(docFreq=688, maxDocs=44218)
               0.0134323705 = queryNorm
             0.56455505 = fieldWeight in 330, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.161646 = idf(docFreq=688, maxDocs=44218)
               0.109375 = fieldNorm(doc=330)
         0.08752934 = weight(abstract_txt:machine in 330) [ClassicSimilarity], result of:
           0.08752934 = score(doc=330,freq=1.0), product of:
             0.15160838 = queryWeight, product of:
               2.1382484 = boost
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.0134323705 = queryNorm
             0.5773384 = fieldWeight in 330, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.109375 = fieldNorm(doc=330)
         0.24646923 = weight(abstract_txt:output in 330) [ClassicSimilarity], result of:
           0.24646923 = score(doc=330,freq=4.0), product of:
             0.19044779 = queryWeight, product of:
               2.3965392 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.0134323705 = queryNorm
             1.2941564 = fieldWeight in 330, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.109375 = fieldNorm(doc=330)
         0.1159166 = weight(abstract_txt:human in 330) [ClassicSimilarity], result of:
           0.1159166 = score(doc=330,freq=2.0), product of:
             0.1597181 = queryWeight, product of:
               2.5342124 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0134323705 = queryNorm
             0.7257575 = fieldWeight in 330, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.109375 = fieldNorm(doc=330)
         0.46719277 = weight(abstract_txt:translation in 330) [ClassicSimilarity], result of:
           0.46719277 = score(doc=330,freq=4.0), product of:
             0.3458447 = queryWeight, product of:
               4.1692843 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0134323705 = queryNorm
             1.3508745 = fieldWeight in 330, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.109375 = fieldNorm(doc=330)
       0.2 = coord(5/25)
   

4. Zimmermann, H.H.: Language and language technology (1991) 0.17

   0.17360927 = sum of:
     0.17360927 = product of:
       1.085058 = sum of:
         0.21657893 = weight(abstract_txt:machine in 2568) [ClassicSimilarity], result of:
           0.21657893 = score(doc=2568,freq=3.0), product of:
             0.15160838 = queryWeight, product of:
               2.1382484 = boost
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.0134323705 = queryNorm
             1.428542 = fieldWeight in 2568, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2785225 = idf(docFreq=612, maxDocs=44218)
               0.15625 = fieldNorm(doc=2568)
         0.19873473 = weight(abstract_txt:automatic in 2568) [ClassicSimilarity], result of:
           0.19873473 = score(doc=2568,freq=1.0), product of:
             0.24480383 = queryWeight, product of:
               3.5077615 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0134323705 = queryNorm
             0.81181216 = fieldWeight in 2568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.15625 = fieldNorm(doc=2568)
         0.33370912 = weight(abstract_txt:translation in 2568) [ClassicSimilarity], result of:
           0.33370912 = score(doc=2568,freq=1.0), product of:
             0.3458447 = queryWeight, product of:
               4.1692843 = boost
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.0134323705 = queryNorm
             0.9649104 = fieldWeight in 2568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1754265 = idf(docFreq=249, maxDocs=44218)
               0.15625 = fieldNorm(doc=2568)
         0.33603516 = weight(abstract_txt:linguistic in 2568) [ClassicSimilarity], result of:
           0.33603516 = score(doc=2568,freq=1.0), product of:
             0.3692206 = queryWeight, product of:
               4.7190495 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0134323705 = queryNorm
             0.91012025 = fieldWeight in 2568, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.15625 = fieldNorm(doc=2568)
       0.16 = coord(4/25)
   

5. Salton, G.: Automatic processing of foreign language documents (1985) 0.17

   0.16631997 = sum of:
     0.16631997 = product of:
       0.4619999 = sum of:
         0.014953591 = weight(abstract_txt:into in 3650) [ClassicSimilarity], result of:
           0.014953591 = score(doc=3650,freq=3.0), product of:
             0.049739122 = queryWeight, product of:
               3.7029297 = idf(docFreq=2962, maxDocs=44218)
               0.0134323705 = queryNorm
             0.30064043 = fieldWeight in 3650, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.7029297 = idf(docFreq=2962, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.012124746 = weight(abstract_txt:methods in 3650) [ClassicSimilarity], result of:
           0.012124746 = score(doc=3650,freq=1.0), product of:
             0.06237683 = queryWeight, product of:
               1.1198571 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0134323705 = queryNorm
             0.194379 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.023383692 = weight(abstract_txt:following in 3650) [ClassicSimilarity], result of:
           0.023383692 = score(doc=3650,freq=1.0), product of:
             0.09664594 = queryWeight, product of:
               1.3939357 = boost
               5.161646 = idf(docFreq=688, maxDocs=44218)
               0.0134323705 = queryNorm
             0.24195215 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.161646 = idf(docFreq=688, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.043533586 = weight(abstract_txt:correlation in 3650) [ClassicSimilarity], result of:
           0.043533586 = score(doc=3650,freq=1.0), product of:
             0.14625964 = queryWeight, product of:
               1.7147988 = boost
               6.3497796 = idf(docFreq=209, maxDocs=44218)
               0.0134323705 = queryNorm
             0.29764593 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3497796 = idf(docFreq=209, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.05281484 = weight(abstract_txt:output in 3650) [ClassicSimilarity], result of:
           0.05281484 = score(doc=3650,freq=1.0), product of:
             0.19044779 = queryWeight, product of:
               2.3965392 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.0134323705 = queryNorm
             0.27731925 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.03512804 = weight(abstract_txt:human in 3650) [ClassicSimilarity], result of:
           0.03512804 = score(doc=3650,freq=1.0), product of:
             0.1597181 = queryWeight, product of:
               2.5342124 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0134323705 = queryNorm
             0.21993774 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.10326558 = weight(abstract_txt:automatic in 3650) [ClassicSimilarity], result of:
           0.10326558 = score(doc=3650,freq=3.0), product of:
             0.24480383 = queryWeight, product of:
               3.5077615 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0134323705 = queryNorm
             0.42182994 = fieldWeight in 3650, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.07598525 = weight(abstract_txt:evaluation in 3650) [ClassicSimilarity], result of:
           0.07598525 = score(doc=3650,freq=2.0), product of:
             0.25550953 = queryWeight, product of:
               4.240221 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0134323705 = queryNorm
             0.29738715 = fieldWeight in 3650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
         0.10081054 = weight(abstract_txt:linguistic in 3650) [ClassicSimilarity], result of:
           0.10081054 = score(doc=3650,freq=1.0), product of:
             0.3692206 = queryWeight, product of:
               4.7190495 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0134323705 = queryNorm
             0.27303606 = fieldWeight in 3650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.046875 = fieldNorm(doc=3650)
       0.36 = coord(9/25)