Document (#35957)

Author
Olvera-Lobo, M.-D.
García-Santiago, L.
Title
Analysis of errors in the automatic translation of questions for translingual QA systems
Source
Journal of documentation. 66(2010) no.3, S.434-455
Year
2010
Abstract
Purpose - This study aims to focus on the evaluation of systems for the automatic translation of questions destined to translingual question-answer (QA) systems. The efficacy of online translators when performing as tools in QA systems is analysed using a collection of documents in the Spanish language. Design/methodology/approach - Automatic translation is evaluated in terms of the functionality of actual translations produced by three online translators (Google Translator, Promt Translator, and Worldlingo) by means of objective and subjective evaluation measures, and the typology of errors produced was identified. For this purpose, a comparative study of the quality of the translation of factual questions of the CLEF collection of queries was carried out, from German and French to Spanish. Findings - It was observed that the rates of error for the three systems evaluated here are greater in the translations pertaining to the language pair German-Spanish . Promt was identified as the most reliable translator of the three (on average) for the two linguistic combinations evaluated. However, for the Spanish-German pair, a good assessment of the Google online translator was obtained as well. Most errors (46.38 percent) tended to be of a lexical nature, followed by those due to a poor translation of the interrogative particle of the query (31.16 percent). Originality/value - The evaluation methodology applied focuses above all on the finality of the translation. That is, does the resulting question serve as effective input into a translingual QA system? Thus, instead of searching for "perfection", the functionality of the question and its capacity to lead one to an adequate response are appraised. The results obtained contribute to the development of improved translingual QA systems.
Theme
Multilinguale Probleme

Similar documents (author)

  1. Lobo, D.O.: Metodos y technicas para la indizacion y recuperacion de los recursos de la World Wide Web (1999) 1.34 
    1.3372463 = sum of:
  1.3372463 = product of:
    4.011739 = sum of:
      4.011739 = weight(author_txt:lobo in 3241) [ClassicSimilarity], result of:
        4.011739 = score(doc=3241,freq=1.0), product of:
          0.6477267 = queryWeight, product of:
            1.2248498 = boost
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.053363968 = queryNorm
          6.1935673 = fieldWeight in 3241, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.625 = fieldNorm(doc=3241)
    0.33333334 = coord(1/3)
  2. Lobo, R.: ¬Der Umgang mit der Verunsicherungssynthese der Zeiterfahrung : zu einer lebensnahen Theorie der Samädhi-Erfahrung in Yoga und Zen (1989) 1.34 
    1.3372463 = sum of:
  1.3372463 = product of:
    4.011739 = sum of:
      4.011739 = weight(author_txt:lobo in 1283) [ClassicSimilarity], result of:
        4.011739 = score(doc=1283,freq=1.0), product of:
          0.6477267 = queryWeight, product of:
            1.2248498 = boost
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.053363968 = queryNorm
          6.1935673 = fieldWeight in 1283, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.625 = fieldNorm(doc=1283)
    0.33333334 = coord(1/3)
  3. Lobo, S.: ¬Das Ende von Google, wie wir es kannten : Bessere Treffer durch ChatGPT (2022) 1.34 
    1.3372463 = sum of:
  1.3372463 = product of:
    4.011739 = sum of:
      4.011739 = weight(author_txt:lobo in 1853) [ClassicSimilarity], result of:
        4.011739 = score(doc=1853,freq=1.0), product of:
          0.6477267 = queryWeight, product of:
            1.2248498 = boost
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.053363968 = queryNorm
          6.1935673 = fieldWeight in 1853, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.625 = fieldNorm(doc=1853)
    0.33333334 = coord(1/3)
  4. Santiago, S.: International serials data system (1993) 1.28 
    1.2758074 = sum of:
  1.2758074 = product of:
    3.8274221 = sum of:
      3.8274221 = weight(author_txt:santiago in 4561) [ClassicSimilarity], result of:
        3.8274221 = score(doc=4561,freq=1.0), product of:
          0.627732 = queryWeight, product of:
            1.2057966 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.053363968 = queryNorm
          6.0972233 = fieldWeight in 4561, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.625 = fieldNorm(doc=4561)
    0.33333334 = coord(1/3)
  5. Santiago, S.: ISDS and union catalogues (1991) 1.28 
    1.2758074 = sum of:
  1.2758074 = product of:
    3.8274221 = sum of:
      3.8274221 = weight(author_txt:santiago in 5059) [ClassicSimilarity], result of:
        3.8274221 = score(doc=5059,freq=1.0), product of:
          0.627732 = queryWeight, product of:
            1.2057966 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.053363968 = queryNorm
          6.0972233 = fieldWeight in 5059, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.625 = fieldNorm(doc=5059)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Jahns, Y.; Karg, H.: Translingual retrieval : Moving between vocabularies - MACS 2010 (2011) 0.35 
    0.34677532 = sum of:
  0.34677532 = product of:
    2.1673458 = sum of:
      0.02955618 = weight(abstract_txt:produced in 1648) [ClassicSimilarity], result of:
        0.02955618 = score(doc=1648,freq=1.0), product of:
          0.085291706 = queryWeight, product of:
            1.1524575 = boost
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.01334813 = queryNorm
          0.34653053 = fieldWeight in 1648, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.0625 = fieldNorm(doc=1648)
      0.022202801 = weight(abstract_txt:three in 1648) [ClassicSimilarity], result of:
        0.022202801 = score(doc=1648,freq=1.0), product of:
          0.08068204 = queryWeight, product of:
            1.3727946 = boost
            4.4030223 = idf(docFreq=1477, maxDocs=44421)
            0.01334813 = queryNorm
          0.2751889 = fieldWeight in 1648, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4030223 = idf(docFreq=1477, maxDocs=44421)
            0.0625 = fieldNorm(doc=1648)
      0.09057413 = weight(abstract_txt:german in 1648) [ClassicSimilarity], result of:
        0.09057413 = score(doc=1648,freq=2.0), product of:
          0.16349249 = queryWeight, product of:
            1.9541867 = boost
            6.2677455 = idf(docFreq=228, maxDocs=44421)
            0.01334813 = queryNorm
          0.55399567 = fieldWeight in 1648, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.2677455 = idf(docFreq=228, maxDocs=44421)
            0.0625 = fieldNorm(doc=1648)
      2.0250127 = weight(title_txt:translingual in 1648) [ClassicSimilarity], result of:
        2.0250127 = score(doc=1648,freq=1.0), product of:
          0.5449236 = queryWeight, product of:
            4.119593 = boost
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.01334813 = queryNorm
          3.7161405 = fieldWeight in 1648, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.909708 = idf(docFreq=5, maxDocs=44421)
            0.375 = fieldNorm(doc=1648)
    0.16 = coord(4/25)
  2. Bernard, U.: Machine translation : success of failure using MT in an IT research and development environment (1996) 0.29 
    0.2903459 = sum of:
  0.2903459 = product of:
    1.2097746 = sum of:
      0.051723316 = weight(abstract_txt:produced in 214) [ClassicSimilarity], result of:
        0.051723316 = score(doc=214,freq=1.0), product of:
          0.085291706 = queryWeight, product of:
            1.1524575 = boost
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.01334813 = queryNorm
          0.60642844 = fieldWeight in 214, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
      0.18301919 = weight(abstract_txt:translations in 214) [ClassicSimilarity], result of:
        0.18301919 = score(doc=214,freq=2.0), product of:
          0.15719438 = queryWeight, product of:
            1.5645521 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.01334813 = queryNorm
          1.1642859 = fieldWeight in 214, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
      0.19412784 = weight(abstract_txt:german in 214) [ClassicSimilarity], result of:
        0.19412784 = score(doc=214,freq=3.0), product of:
          0.16349249 = queryWeight, product of:
            1.9541867 = boost
            6.2677455 = idf(docFreq=228, maxDocs=44421)
            0.01334813 = queryNorm
          1.1873808 = fieldWeight in 214, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.2677455 = idf(docFreq=228, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
      0.036135595 = weight(abstract_txt:systems in 214) [ClassicSimilarity], result of:
        0.036135595 = score(doc=214,freq=1.0), product of:
          0.09685302 = queryWeight, product of:
            2.127104 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.01334813 = queryNorm
          0.37309727 = fieldWeight in 214, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
      0.44147512 = weight(abstract_txt:translator in 214) [ClassicSimilarity], result of:
        0.44147512 = score(doc=214,freq=1.0), product of:
          0.4488109 = queryWeight, product of:
            3.7386792 = boost
            8.993418 = idf(docFreq=14, maxDocs=44421)
            0.01334813 = queryNorm
          0.9836551 = fieldWeight in 214, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.993418 = idf(docFreq=14, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
      0.30329362 = weight(abstract_txt:translation in 214) [ClassicSimilarity], result of:
        0.30329362 = score(doc=214,freq=2.0), product of:
          0.317484 = queryWeight, product of:
            3.8511734 = boost
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.01334813 = queryNorm
          0.9553036 = fieldWeight in 214, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.109375 = fieldNorm(doc=214)
    0.24 = coord(6/25)
  3. Reyes Ayala, B.; Knudson, R.; Chen, J.; Cao, G.; Wang, X.: Metadata records machine translation combining multi-engine outputs with limited parallel data (2018) 0.28 
    0.2808555 = sum of:
  0.2808555 = product of:
    0.638308 = sum of:
      0.02674586 = weight(abstract_txt:google in 10) [ClassicSimilarity], result of:
        0.02674586 = score(doc=10,freq=1.0), product of:
          0.07979561 = queryWeight, product of:
            1.1147077 = boost
            5.3628736 = idf(docFreq=565, maxDocs=44421)
            0.01334813 = queryNorm
          0.3351796 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3628736 = idf(docFreq=565, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.022170993 = weight(abstract_txt:online in 10) [ClassicSimilarity], result of:
        0.022170993 = score(doc=10,freq=3.0), product of:
          0.055888362 = queryWeight, product of:
            1.1425569 = boost
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.01334813 = queryNorm
          0.39670143 = fieldWeight in 10, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.02955618 = weight(abstract_txt:produced in 10) [ClassicSimilarity], result of:
        0.02955618 = score(doc=10,freq=1.0), product of:
          0.085291706 = queryWeight, product of:
            1.1524575 = boost
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.01334813 = queryNorm
          0.34653053 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5444884 = idf(docFreq=471, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.033025164 = weight(abstract_txt:obtained in 10) [ClassicSimilarity], result of:
        0.033025164 = score(doc=10,freq=1.0), product of:
          0.09184128 = queryWeight, product of:
            1.1958879 = boost
            5.7534328 = idf(docFreq=382, maxDocs=44421)
            0.01334813 = queryNorm
          0.35958955 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7534328 = idf(docFreq=382, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.022202801 = weight(abstract_txt:three in 10) [ClassicSimilarity], result of:
        0.022202801 = score(doc=10,freq=1.0), product of:
          0.08068204 = queryWeight, product of:
            1.3727946 = boost
            4.4030223 = idf(docFreq=1477, maxDocs=44421)
            0.01334813 = queryNorm
          0.2751889 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4030223 = idf(docFreq=1477, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.023382025 = weight(abstract_txt:evaluation in 10) [ClassicSimilarity], result of:
        0.023382025 = score(doc=10,freq=1.0), product of:
          0.083514094 = queryWeight, product of:
            1.3966805 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.01334813 = queryNorm
          0.279977 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.073950924 = weight(abstract_txt:translations in 10) [ClassicSimilarity], result of:
        0.073950924 = score(doc=10,freq=1.0), product of:
          0.15719438 = queryWeight, product of:
            1.5645521 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.01334813 = queryNorm
          0.47044253 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.048616175 = weight(abstract_txt:evaluated in 10) [ClassicSimilarity], result of:
        0.048616175 = score(doc=10,freq=1.0), product of:
          0.13604802 = queryWeight, product of:
            1.7826384 = boost
            5.717531 = idf(docFreq=396, maxDocs=44421)
            0.01334813 = queryNorm
          0.3573457 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.717531 = idf(docFreq=396, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.029201971 = weight(abstract_txt:systems in 10) [ClassicSimilarity], result of:
        0.029201971 = score(doc=10,freq=2.0), product of:
          0.09685302 = queryWeight, product of:
            2.127104 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.01334813 = queryNorm
          0.30150813 = fieldWeight in 10, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.11719459 = weight(abstract_txt:spanish in 10) [ClassicSimilarity], result of:
        0.11719459 = score(doc=10,freq=1.0), product of:
          0.26920906 = queryWeight, product of:
            2.895552 = boost
            6.965269 = idf(docFreq=113, maxDocs=44421)
            0.01334813 = queryNorm
          0.43532932 = fieldWeight in 10, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.965269 = idf(docFreq=113, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
      0.21226129 = weight(abstract_txt:translation in 10) [ClassicSimilarity], result of:
        0.21226129 = score(doc=10,freq=3.0), product of:
          0.317484 = queryWeight, product of:
            3.8511734 = boost
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.01334813 = queryNorm
          0.6685732 = fieldWeight in 10, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.0625 = fieldNorm(doc=10)
    0.44 = coord(11/25)
  4. Greiner-Petter, A.; Schubotz, M.; Cohl, H.S.; Gipp, B.: Semantic preserving bijective mappings for expressions involving special functions between computer algebra systems and document preparation systems (2019) 0.28 
    0.2800867 = sum of:
  0.2800867 = product of:
    0.7780186 = sum of:
      0.01810254 = weight(abstract_txt:online in 499) [ClassicSimilarity], result of:
        0.01810254 = score(doc=499,freq=2.0), product of:
          0.055888362 = queryWeight, product of:
            1.1425569 = boost
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.01334813 = queryNorm
          0.32390535 = fieldWeight in 499, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.6645708 = idf(docFreq=3092, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.023382025 = weight(abstract_txt:evaluation in 499) [ClassicSimilarity], result of:
        0.023382025 = score(doc=499,freq=1.0), product of:
          0.083514094 = queryWeight, product of:
            1.3966805 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.01334813 = queryNorm
          0.279977 = fieldWeight in 499, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.06765259 = weight(abstract_txt:percent in 499) [ClassicSimilarity], result of:
        0.06765259 = score(doc=499,freq=1.0), product of:
          0.14813723 = queryWeight, product of:
            1.5188106 = boost
            7.3070183 = idf(docFreq=80, maxDocs=44421)
            0.01334813 = queryNorm
          0.45668864 = fieldWeight in 499, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.3070183 = idf(docFreq=80, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.10458239 = weight(abstract_txt:translations in 499) [ClassicSimilarity], result of:
        0.10458239 = score(doc=499,freq=2.0), product of:
          0.15719438 = queryWeight, product of:
            1.5645521 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.01334813 = queryNorm
          0.6653062 = fieldWeight in 499, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.036482383 = weight(abstract_txt:automatic in 499) [ClassicSimilarity], result of:
        0.036482383 = score(doc=499,freq=1.0), product of:
          0.112346746 = queryWeight, product of:
            1.6199343 = boost
            5.1956835 = idf(docFreq=668, maxDocs=44421)
            0.01334813 = queryNorm
          0.32473022 = fieldWeight in 499, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1956835 = idf(docFreq=668, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.07303249 = weight(abstract_txt:errors in 499) [ClassicSimilarity], result of:
        0.07303249 = score(doc=499,freq=1.0), product of:
          0.17844968 = queryWeight, product of:
            2.0416205 = boost
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.01334813 = queryNorm
          0.409261 = fieldWeight in 499, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.029201971 = weight(abstract_txt:systems in 499) [ClassicSimilarity], result of:
        0.029201971 = score(doc=499,freq=2.0), product of:
          0.09685302 = queryWeight, product of:
            2.127104 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.01334813 = queryNorm
          0.30150813 = fieldWeight in 499, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.2522715 = weight(abstract_txt:translator in 499) [ClassicSimilarity], result of:
        0.2522715 = score(doc=499,freq=1.0), product of:
          0.4488109 = queryWeight, product of:
            3.7386792 = boost
            8.993418 = idf(docFreq=14, maxDocs=44421)
            0.01334813 = queryNorm
          0.5620886 = fieldWeight in 499, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.993418 = idf(docFreq=14, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
      0.17331062 = weight(abstract_txt:translation in 499) [ClassicSimilarity], result of:
        0.17331062 = score(doc=499,freq=2.0), product of:
          0.317484 = queryWeight, product of:
            3.8511734 = boost
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.01334813 = queryNorm
          0.54588777 = fieldWeight in 499, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.0625 = fieldNorm(doc=499)
    0.36 = coord(9/25)
  5. Farreús, M.; Costa-jussà, M.R.; Popovic' Morse, M.: Study and correlation analysis of linguistic, perceptual, and automatic machine translation evaluations (2012) 0.24 
    0.23795845 = sum of:
  0.23795845 = product of:
    0.74362016 = sum of:
      0.06186302 = weight(abstract_txt:evaluation in 975) [ClassicSimilarity], result of:
        0.06186302 = score(doc=975,freq=7.0), product of:
          0.083514094 = queryWeight, product of:
            1.3966805 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.01334813 = queryNorm
          0.7407495 = fieldWeight in 975, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.073950924 = weight(abstract_txt:translations in 975) [ClassicSimilarity], result of:
        0.073950924 = score(doc=975,freq=1.0), product of:
          0.15719438 = queryWeight, product of:
            1.5645521 = boost
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.01334813 = queryNorm
          0.47044253 = fieldWeight in 975, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.5270805 = idf(docFreq=64, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.072964765 = weight(abstract_txt:automatic in 975) [ClassicSimilarity], result of:
        0.072964765 = score(doc=975,freq=4.0), product of:
          0.112346746 = queryWeight, product of:
            1.6199343 = boost
            5.1956835 = idf(docFreq=668, maxDocs=44421)
            0.01334813 = queryNorm
          0.64946043 = fieldWeight in 975, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.1956835 = idf(docFreq=668, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.048616175 = weight(abstract_txt:evaluated in 975) [ClassicSimilarity], result of:
        0.048616175 = score(doc=975,freq=1.0), product of:
          0.13604802 = queryWeight, product of:
            1.7826384 = boost
            5.717531 = idf(docFreq=396, maxDocs=44421)
            0.01334813 = queryNorm
          0.3573457 = fieldWeight in 975, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.717531 = idf(docFreq=396, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.10328354 = weight(abstract_txt:errors in 975) [ClassicSimilarity], result of:
        0.10328354 = score(doc=975,freq=2.0), product of:
          0.17844968 = queryWeight, product of:
            2.0416205 = boost
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.01334813 = queryNorm
          0.57878244 = fieldWeight in 975, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.548176 = idf(docFreq=172, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.020648912 = weight(abstract_txt:systems in 975) [ClassicSimilarity], result of:
        0.020648912 = score(doc=975,freq=1.0), product of:
          0.09685302 = queryWeight, product of:
            2.127104 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.01334813 = queryNorm
          0.21319844 = fieldWeight in 975, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.11719459 = weight(abstract_txt:spanish in 975) [ClassicSimilarity], result of:
        0.11719459 = score(doc=975,freq=1.0), product of:
          0.26920906 = queryWeight, product of:
            2.895552 = boost
            6.965269 = idf(docFreq=113, maxDocs=44421)
            0.01334813 = queryNorm
          0.43532932 = fieldWeight in 975, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.965269 = idf(docFreq=113, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
      0.24509823 = weight(abstract_txt:translation in 975) [ClassicSimilarity], result of:
        0.24509823 = score(doc=975,freq=4.0), product of:
          0.317484 = queryWeight, product of:
            3.8511734 = boost
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.01334813 = queryNorm
          0.77200186 = fieldWeight in 975, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            6.176015 = idf(docFreq=250, maxDocs=44421)
            0.0625 = fieldNorm(doc=975)
    0.32 = coord(8/25)