Document (#39879)

Author
Olmos, R.
Jorge-Botana, G.
Luzón, J.M.
Martín-Cordero, J.I.
León, J.A.
Title
Transforming LSA space dimensions into a rubric for an automatic assessment and feedback system
Source
Information processing and management. 52(2016) no.3, S.359-373
Year
2016
Abstract
The purpose of this article is to validate, through two empirical studies, a new method for automatic evaluation of written texts, called Inbuilt Rubric, based on the Latent Semantic Analysis (LSA) technique, which constitutes an innovative and distinct turn with respect to LSA application so far. In the first empirical study, evidence of the validity of the method to identify and evaluate the conceptual axes of a text in a sample of 78 summaries by secondary school students is sought. Results show that the proposed method has a significantly higher degree of reliability than classic LSA methods of text evaluation, and displays very high sensitivity to identify which conceptual axes are included or not in each summary. A second study evaluates the method's capacity to interact and provide feedback about quality in a real online system on a sample of 924 discursive texts written by university students. Results show that students improved the quality of their written texts using this system, and also rated the experience very highly. The final conclusion is that this new method opens a very interesting way regarding the role of automatic assessors in the identification of presence/absence and quality of elaboration of relevant conceptual information in texts written by students with lower time costs than the usual LSA-based methods.
Content
Vgl.: 10.1016/j.ipm.2015.12.002.
Theme
Semantisches Umfeld in Indexierung u. Retrieval
Object
Latent semantic analysis

Similar documents (author)

  1. Martín, A. Martín- => Martín-Martín, A.: 6.65
    6.6511908 = sum of:
      6.6511908 = weight(author_txt:martín in 2139) [ClassicSimilarity], result of:
        6.6511908 = fieldWeight in 2139, product of:
          2.0 = tf(freq=4.0), with freq of:
            4.0 = termFreq=4.0
          8.868255 = idf(docFreq=16, maxDocs=44421)
          0.375 = fieldNorm(doc=2139)
    
  2. Martín, A.C.; Gómez Prada, R.: RDA and rare materials at the National Library of Spain (2016) 3.88
    3.8798614 = sum of:
      3.8798614 = weight(author_txt:martín in 129) [ClassicSimilarity], result of:
        3.8798614 = fieldWeight in 129, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.868255 = idf(docFreq=16, maxDocs=44421)
          0.4375 = fieldNorm(doc=129)
    
  3. Bautista, M.J. Mártin- -> Martín-Bautista, M.J.: 3.33
    3.3255954 = sum of:
      3.3255954 = weight(author_txt:martín in 3775) [ClassicSimilarity], result of:
        3.3255954 = fieldWeight in 3775, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.868255 = idf(docFreq=16, maxDocs=44421)
          0.375 = fieldNorm(doc=3775)
    
  4. Martín-Martín, A.; Ayllón, J.M.; López-Cózar, E.D.; Orduna-Malea, E.: Nature's top 100 Re-revisited (2015) 3.14
    3.1354015 = sum of:
      3.1354015 = weight(author_txt:martín in 3352) [ClassicSimilarity], result of:
        3.1354015 = fieldWeight in 3352, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          8.868255 = idf(docFreq=16, maxDocs=44421)
          0.25 = fieldNorm(doc=3352)
    
  5. Delgado-Quirós, L.; Aguillo, I.F.; Martín-Martín, A.; López-Cózar, E.D.; Orduña-Malea, E.; Ortega, J.L.: Why are these publications missing? : uncovering the reasons behind the exclusion of documents in free-access scholarly databases (2024) 3.14
    3.1354015 = sum of:
      3.1354015 = weight(author_txt:martín in 2203) [ClassicSimilarity], result of:
        3.1354015 = fieldWeight in 2203, product of:
          1.4142135 = tf(freq=2.0), with freq of:
            2.0 = termFreq=2.0
          8.868255 = idf(docFreq=16, maxDocs=44421)
          0.25 = fieldNorm(doc=2203)
    

Similar documents (content)

  1. Abdi, A.; Idris, N.; Alguliev, R.M.; Aliguliyev, R.M.: Automatic summarization assessment through a combination of semantic and syntactic information for intelligent educational systems (2015) 0.16
    0.16341458 = sum of:
      0.16341458 = product of:
        0.5106706 = sum of:
          0.019782586 = weight(abstract_txt:text in 3681) [ClassicSimilarity], result of:
            0.019782586 = score(doc=3681,freq=1.0), product of:
              0.07832977 = queryWeight, product of:
                1.0265392 = boost
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.018883182 = queryNorm
              0.25255513 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.03811505 = weight(abstract_txt:evaluation in 3681) [ClassicSimilarity], result of:
            0.03811505 = score(doc=3681,freq=2.0), product of:
              0.09626295 = queryWeight, product of:
                1.1379985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.018883182 = queryNorm
              0.39594725 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.017254721 = weight(abstract_txt:system in 3681) [ClassicSimilarity], result of:
            0.017254721 = score(doc=3681,freq=1.0), product of:
              0.08185412 = queryWeight, product of:
                1.2852215 = boost
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.018883182 = queryNorm
              0.21079844 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.053647727 = weight(abstract_txt:very in 3681) [ClassicSimilarity], result of:
            0.053647727 = score(doc=3681,freq=1.0), product of:
              0.17436907 = queryWeight, product of:
                1.8758255 = boost
                4.922683 = idf(docFreq=878, maxDocs=44421)
                0.018883182 = queryNorm
              0.30766767 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.922683 = idf(docFreq=878, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.063077405 = weight(abstract_txt:automatic in 3681) [ClassicSimilarity], result of:
            0.063077405 = score(doc=3681,freq=1.0), product of:
              0.19424558 = queryWeight, product of:
                1.9798546 = boost
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.018883182 = queryNorm
              0.32473022 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.10919593 = weight(abstract_txt:method in 3681) [ClassicSimilarity], result of:
            0.10919593 = score(doc=3681,freq=4.0), product of:
              0.1941776 = queryWeight, product of:
                2.285739 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.018883182 = queryNorm
              0.5623508 = fieldWeight in 3681, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.10215214 = weight(abstract_txt:students in 3681) [ClassicSimilarity], result of:
            0.10215214 = score(doc=3681,freq=2.0), product of:
              0.23401111 = queryWeight, product of:
                2.509258 = boost
                4.938738 = idf(docFreq=864, maxDocs=44421)
                0.018883182 = queryNorm
              0.43652686 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.938738 = idf(docFreq=864, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.10744503 = weight(abstract_txt:texts in 3681) [ClassicSimilarity], result of:
            0.10744503 = score(doc=3681,freq=1.0), product of:
              0.3049339 = queryWeight, product of:
                2.8643754 = boost
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.018883182 = queryNorm
              0.35235515 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
        0.32 = coord(8/25)
    
  2. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.16
    0.16265936 = sum of:
      0.16265936 = product of:
        0.5809263 = sum of:
          0.046176247 = weight(abstract_txt:methods in 1942) [ClassicSimilarity], result of:
            0.046176247 = score(doc=1942,freq=3.0), product of:
              0.08235756 = queryWeight, product of:
                1.0526011 = boost
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.018883182 = queryNorm
              0.5606801 = fieldWeight in 1942, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.031946044 = weight(abstract_txt:show in 1942) [ClassicSimilarity], result of:
            0.031946044 = score(doc=1942,freq=1.0), product of:
              0.09291294 = queryWeight, product of:
                1.1180216 = boost
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.018883182 = queryNorm
              0.34382772 = fieldWeight in 1942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.09528762 = weight(abstract_txt:evaluation in 1942) [ClassicSimilarity], result of:
            0.09528762 = score(doc=1942,freq=8.0), product of:
              0.09626295 = queryWeight, product of:
                1.1379985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.018883182 = queryNorm
              0.9898681 = fieldWeight in 1942, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.021568403 = weight(abstract_txt:system in 1942) [ClassicSimilarity], result of:
            0.021568403 = score(doc=1942,freq=1.0), product of:
              0.08185412 = queryWeight, product of:
                1.2852215 = boost
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.018883182 = queryNorm
              0.26349807 = fieldWeight in 1942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.05631878 = weight(abstract_txt:quality in 1942) [ClassicSimilarity], result of:
            0.05631878 = score(doc=1942,freq=1.0), product of:
              0.15521394 = queryWeight, product of:
                1.7697955 = boost
                4.6444306 = idf(docFreq=1160, maxDocs=44421)
                0.018883182 = queryNorm
              0.36284614 = fieldWeight in 1942, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6444306 = idf(docFreq=1160, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.19313435 = weight(abstract_txt:automatic in 1942) [ClassicSimilarity], result of:
            0.19313435 = score(doc=1942,freq=6.0), product of:
              0.19424558 = queryWeight, product of:
                1.9798546 = boost
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.018883182 = queryNorm
              0.99427927 = fieldWeight in 1942, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
          0.1364949 = weight(abstract_txt:method in 1942) [ClassicSimilarity], result of:
            0.1364949 = score(doc=1942,freq=4.0), product of:
              0.1941776 = queryWeight, product of:
                2.285739 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.018883182 = queryNorm
              0.7029385 = fieldWeight in 1942, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.078125 = fieldNorm(doc=1942)
        0.28 = coord(7/25)
    
  3. Wang, W.M.; Cheung, C.F.; Lee, W.B.; Kwok, S.K.: Mining knowledge from natural language texts using fuzzy associated concept mapping (2008) 0.15
    0.15395011 = sum of:
      0.15395011 = product of:
        0.4810941 = sum of:
          0.038705807 = weight(abstract_txt:text in 3121) [ClassicSimilarity], result of:
            0.038705807 = score(doc=3121,freq=5.0), product of:
              0.07832977 = queryWeight, product of:
                1.0265392 = boost
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.018883182 = queryNorm
              0.49413916 = fieldWeight in 3121, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.02236223 = weight(abstract_txt:show in 3121) [ClassicSimilarity], result of:
            0.02236223 = score(doc=3121,freq=1.0), product of:
              0.09291294 = queryWeight, product of:
                1.1180216 = boost
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.018883182 = queryNorm
              0.2406794 = fieldWeight in 3121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.023582485 = weight(abstract_txt:evaluation in 3121) [ClassicSimilarity], result of:
            0.023582485 = score(doc=3121,freq=1.0), product of:
              0.09626295 = queryWeight, product of:
                1.1379985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.018883182 = queryNorm
              0.24497987 = fieldWeight in 3121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.03942314 = weight(abstract_txt:quality in 3121) [ClassicSimilarity], result of:
            0.03942314 = score(doc=3121,freq=1.0), product of:
              0.15521394 = queryWeight, product of:
                1.7697955 = boost
                4.6444306 = idf(docFreq=1160, maxDocs=44421)
                0.018883182 = queryNorm
              0.2539923 = fieldWeight in 3121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6444306 = idf(docFreq=1160, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.055192735 = weight(abstract_txt:automatic in 3121) [ClassicSimilarity], result of:
            0.055192735 = score(doc=3121,freq=1.0), product of:
              0.19424558 = queryWeight, product of:
                1.9798546 = boost
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.018883182 = queryNorm
              0.28413895 = fieldWeight in 3121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1956835 = idf(docFreq=668, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.06756154 = weight(abstract_txt:method in 3121) [ClassicSimilarity], result of:
            0.06756154 = score(doc=3121,freq=2.0), product of:
              0.1941776 = queryWeight, product of:
                2.285739 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.018883182 = queryNorm
              0.3479368 = fieldWeight in 3121, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.13295645 = weight(abstract_txt:texts in 3121) [ClassicSimilarity], result of:
            0.13295645 = score(doc=3121,freq=2.0), product of:
              0.3049339 = queryWeight, product of:
                2.8643754 = boost
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.018883182 = queryNorm
              0.43601727 = fieldWeight in 3121, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
          0.10130972 = weight(abstract_txt:written in 3121) [ClassicSimilarity], result of:
            0.10130972 = score(doc=3121,freq=1.0), product of:
              0.32051143 = queryWeight, product of:
                2.9366274 = boost
                5.779889 = idf(docFreq=372, maxDocs=44421)
                0.018883182 = queryNorm
              0.3160877 = fieldWeight in 3121, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.779889 = idf(docFreq=372, maxDocs=44421)
                0.0546875 = fieldNorm(doc=3121)
        0.32 = coord(8/25)
    
  4. Hjoerland, B.; Hartel, J.: Introduction to a Special Issue of Knowledge Organization (2003) 0.13
    0.12641619 = sum of:
      0.12641619 = product of:
        0.3511561 = sum of:
          0.013195961 = weight(abstract_txt:methods in 4013) [ClassicSimilarity], result of:
            0.013195961 = score(doc=4013,freq=2.0), product of:
              0.08235756 = queryWeight, product of:
                1.0526011 = boost
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.018883182 = queryNorm
              0.16022767 = fieldWeight in 4013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.00754894 = weight(abstract_txt:system in 4013) [ClassicSimilarity], result of:
            0.00754894 = score(doc=4013,freq=1.0), product of:
              0.08185412 = queryWeight, product of:
                1.2852215 = boost
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.018883182 = queryNorm
              0.092224315 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.04128085 = weight(abstract_txt:empirical in 4013) [ClassicSimilarity], result of:
            0.04128085 = score(doc=4013,freq=5.0), product of:
              0.12979616 = queryWeight, product of:
                1.3214265 = boost
                5.2016807 = idf(docFreq=664, maxDocs=44421)
                0.018883182 = queryNorm
              0.31804368 = fieldWeight in 4013, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.2016807 = idf(docFreq=664, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.022901408 = weight(abstract_txt:conceptual in 4013) [ClassicSimilarity], result of:
            0.022901408 = score(doc=4013,freq=1.0), product of:
              0.17153709 = queryWeight, product of:
                1.8605301 = boost
                4.8825436 = idf(docFreq=914, maxDocs=44421)
                0.018883182 = queryNorm
              0.13350704 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.8825436 = idf(docFreq=914, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.033192836 = weight(abstract_txt:very in 4013) [ClassicSimilarity], result of:
            0.033192836 = score(doc=4013,freq=2.0), product of:
              0.17436907 = queryWeight, product of:
                1.8758255 = boost
                4.922683 = idf(docFreq=878, maxDocs=44421)
                0.018883182 = queryNorm
              0.19035967 = fieldWeight in 4013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.922683 = idf(docFreq=878, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.12689292 = weight(abstract_txt:axes in 4013) [ClassicSimilarity], result of:
            0.12689292 = score(doc=4013,freq=2.0), product of:
              0.3724212 = queryWeight, product of:
                2.2383566 = boost
                8.811096 = idf(docFreq=17, maxDocs=44421)
                0.018883182 = queryNorm
              0.34072423 = fieldWeight in 4013, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                8.811096 = idf(docFreq=17, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.02388661 = weight(abstract_txt:method in 4013) [ClassicSimilarity], result of:
            0.02388661 = score(doc=4013,freq=1.0), product of:
              0.1941776 = queryWeight, product of:
                2.285739 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.018883182 = queryNorm
              0.12301424 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.03160171 = weight(abstract_txt:students in 4013) [ClassicSimilarity], result of:
            0.03160171 = score(doc=4013,freq=1.0), product of:
              0.23401111 = queryWeight, product of:
                2.509258 = boost
                4.938738 = idf(docFreq=864, maxDocs=44421)
                0.018883182 = queryNorm
              0.13504362 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.938738 = idf(docFreq=864, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
          0.05065486 = weight(abstract_txt:written in 4013) [ClassicSimilarity], result of:
            0.05065486 = score(doc=4013,freq=1.0), product of:
              0.32051143 = queryWeight, product of:
                2.9366274 = boost
                5.779889 = idf(docFreq=372, maxDocs=44421)
                0.018883182 = queryNorm
              0.15804385 = fieldWeight in 4013, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.779889 = idf(docFreq=372, maxDocs=44421)
                0.02734375 = fieldNorm(doc=4013)
        0.36 = coord(9/25)
    
  5. Reeve, L.H.; Han, H.; Brooks, A.D.: ¬The use of domain-specific concepts in biomedical text summarization (2007) 0.12
    0.11891967 = sum of:
      0.11891967 = product of:
        0.4247131 = sum of:
          0.044235207 = weight(abstract_txt:text in 1955) [ClassicSimilarity], result of:
            0.044235207 = score(doc=1955,freq=5.0), product of:
              0.07832977 = queryWeight, product of:
                1.0265392 = boost
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.018883182 = queryNorm
              0.56473047 = fieldWeight in 1955, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.040882 = idf(docFreq=2122, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.04265579 = weight(abstract_txt:methods in 1955) [ClassicSimilarity], result of:
            0.04265579 = score(doc=1955,freq=4.0), product of:
              0.08235756 = queryWeight, product of:
                1.0526011 = boost
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.018883182 = queryNorm
              0.5179341 = fieldWeight in 1955, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.1434727 = idf(docFreq=1915, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.025556836 = weight(abstract_txt:show in 1955) [ClassicSimilarity], result of:
            0.025556836 = score(doc=1955,freq=1.0), product of:
              0.09291294 = queryWeight, product of:
                1.1180216 = boost
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.018883182 = queryNorm
              0.27506217 = fieldWeight in 1955, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.400995 = idf(docFreq=1480, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.04668121 = weight(abstract_txt:evaluation in 1955) [ClassicSimilarity], result of:
            0.04668121 = score(doc=1955,freq=3.0), product of:
              0.09626295 = queryWeight, product of:
                1.1379985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.018883182 = queryNorm
              0.48493436 = fieldWeight in 1955, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.024401858 = weight(abstract_txt:system in 1955) [ClassicSimilarity], result of:
            0.024401858 = score(doc=1955,freq=2.0), product of:
              0.08185412 = queryWeight, product of:
                1.2852215 = boost
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.018883182 = queryNorm
              0.298114 = fieldWeight in 1955, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.372775 = idf(docFreq=4140, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.13373716 = weight(abstract_txt:method in 1955) [ClassicSimilarity], result of:
            0.13373716 = score(doc=1955,freq=6.0), product of:
              0.1941776 = queryWeight, product of:
                2.285739 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.018883182 = queryNorm
              0.6887363 = fieldWeight in 1955, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
          0.10744503 = weight(abstract_txt:texts in 1955) [ClassicSimilarity], result of:
            0.10744503 = score(doc=1955,freq=1.0), product of:
              0.3049339 = queryWeight, product of:
                2.8643754 = boost
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.018883182 = queryNorm
              0.35235515 = fieldWeight in 1955, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6376824 = idf(docFreq=429, maxDocs=44421)
                0.0625 = fieldNorm(doc=1955)
        0.28 = coord(7/25)