Document (#12069)

Author

Lancaster, F.W.
Ulvila, J.W.
Humphrey, S.M.
Smith, L.C.
Allen, B.
Herner, S.

Title

Evaluation of interactive knowledge-based systems : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.57-69

Year

1996

Abstract

An overview of levels and approaches in the evalution of knowledge-based systems is presented. There is a need for empirical studies using objective criteria in advance of completing the technical evaluation of such systems. A methodology for this type of evaluation developed for a particular knowledge-based indexing system is presented. It is suggested that the proposed study may serve as a model for the design of any evaluation in which the results of existing intellectual procedures are compared with results achieved when these procedures are aided by use of an appropriate expert system

Similar documents (author)

1. Lancaster, F.W.; Smith, L.C.: Compatibility issues affecting information systems and services (1983) 1.48

   1.4840708 = sum of:
     1.4840708 = product of:
       2.9681416 = sum of:
         1.0488183 = weight(author_txt:smith in 7129) [ClassicSimilarity], result of:
           1.0488183 = score(doc=7129,freq=1.0), product of:
             0.3249911 = queryWeight, product of:
               6.4544435 = idf(docFreq=189, maxDocs=44421)
               0.05035153 = queryNorm
             3.2272217 = fieldWeight in 7129, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4544435 = idf(docFreq=189, maxDocs=44421)
               0.5 = fieldNorm(doc=7129)
         1.9193232 = weight(author_txt:lancaster in 7129) [ClassicSimilarity], result of:
           1.9193232 = score(doc=7129,freq=1.0), product of:
             0.48622435 = queryWeight, product of:
               1.2231581 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.05035153 = queryNorm
             3.9474025 = fieldWeight in 7129, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.5 = fieldNorm(doc=7129)
       0.5 = coord(2/4)
   

2. Allen, F.R.; Smith, R.H.: ¬A survey of telephone enquiries : case study and operational impact in an academic library reference department (1993) 1.38

   1.3773544 = sum of:
     1.3773544 = product of:
       2.7547088 = sum of:
         1.0488183 = weight(author_txt:smith in 5029) [ClassicSimilarity], result of:
           1.0488183 = score(doc=5029,freq=1.0), product of:
             0.3249911 = queryWeight, product of:
               6.4544435 = idf(docFreq=189, maxDocs=44421)
               0.05035153 = queryNorm
             3.2272217 = fieldWeight in 5029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4544435 = idf(docFreq=189, maxDocs=44421)
               0.5 = fieldNorm(doc=5029)
         1.7058905 = weight(author_txt:allen in 5029) [ClassicSimilarity], result of:
           1.7058905 = score(doc=5029,freq=1.0), product of:
             0.44947487 = queryWeight, product of:
               1.1760261 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.05035153 = queryNorm
             3.795297 = fieldWeight in 5029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.5 = fieldNorm(doc=5029)
       0.5 = coord(2/4)
   

3. Qin, J.; Lancaster, F.W.; Allen, B.: Types and levels of collaboration in interdisciplinary research in the sciences (1997) 1.36

   1.3594551 = sum of:
     1.3594551 = product of:
       2.7189102 = sum of:
         1.279418 = weight(author_txt:allen in 2593) [ClassicSimilarity], result of:
           1.279418 = score(doc=2593,freq=1.0), product of:
             0.44947487 = queryWeight, product of:
               1.1760261 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.05035153 = queryNorm
             2.8464727 = fieldWeight in 2593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.375 = fieldNorm(doc=2593)
         1.4394923 = weight(author_txt:lancaster in 2593) [ClassicSimilarity], result of:
           1.4394923 = score(doc=2593,freq=1.0), product of:
             0.48622435 = queryWeight, product of:
               1.2231581 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.05035153 = queryNorm
             2.9605517 = fieldWeight in 2593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.375 = fieldNorm(doc=2593)
       0.5 = coord(2/4)
   

4. Humphrey, S.M.: Use and management of classification systems for knowledge-based indexing (1992) 0.98

   0.9815743 = sum of:
     0.9815743 = product of:
       3.9262972 = sum of:
         3.9262972 = weight(author_txt:humphrey in 2093) [ClassicSimilarity], result of:
           3.9262972 = score(doc=2093,freq=1.0), product of:
             0.6752326 = queryWeight, product of:
               1.4414214 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.05035153 = queryNorm
             5.814733 = fieldWeight in 2093, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=2093)
       0.25 = coord(1/4)
   

5. Humphrey, S.M.: Indexing biomedical documents : from thesaural to knowledge-based retrieval systems (1992) 0.98

   0.9815743 = sum of:
     0.9815743 = product of:
       3.9262972 = sum of:
         3.9262972 = weight(author_txt:humphrey in 7640) [ClassicSimilarity], result of:
           3.9262972 = score(doc=7640,freq=1.0), product of:
             0.6752326 = queryWeight, product of:
               1.4414214 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.05035153 = queryNorm
             5.814733 = fieldWeight in 7640, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=7640)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.28

   0.27761605 = sum of:
     0.27761605 = product of:
       0.63094556 = sum of:
         0.030610729 = weight(abstract_txt:levels in 3019) [ClassicSimilarity], result of:
           0.030610729 = score(doc=3019,freq=1.0), product of:
             0.12525047 = queryWeight, product of:
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.024022952 = queryNorm
             0.24439612 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.046069045 = weight(abstract_txt:appropriate in 3019) [ClassicSimilarity], result of:
           0.046069045 = score(doc=3019,freq=2.0), product of:
             0.13055487 = queryWeight, product of:
               1.0209556 = boost
               5.3230414 = idf(docFreq=588, maxDocs=44421)
               0.024022952 = queryNorm
             0.35287112 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3230414 = idf(docFreq=588, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.06420407 = weight(abstract_txt:interactive in 3019) [ClassicSimilarity], result of:
           0.06420407 = score(doc=3019,freq=3.0), product of:
             0.1422978 = queryWeight, product of:
               1.0658827 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.024022952 = queryNorm
             0.45119506 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.052605394 = weight(abstract_txt:criteria in 3019) [ClassicSimilarity], result of:
           0.052605394 = score(doc=3019,freq=2.0), product of:
             0.14262876 = queryWeight, product of:
               1.0671215 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.024022952 = queryNorm
             0.3688274 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.023438064 = weight(abstract_txt:system in 3019) [ClassicSimilarity], result of:
           0.023438064 = score(doc=3019,freq=2.0), product of:
             0.104828194 = queryWeight, product of:
               1.2937917 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024022952 = queryNorm
             0.2235855 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.018183405 = weight(abstract_txt:results in 3019) [ClassicSimilarity], result of:
           0.018183405 = score(doc=3019,freq=1.0), product of:
             0.11151254 = queryWeight, product of:
               1.3344035 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024022952 = queryNorm
             0.16306151 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.0450109 = weight(abstract_txt:presented in 3019) [ClassicSimilarity], result of:
           0.0450109 = score(doc=3019,freq=1.0), product of:
             0.20405726 = queryWeight, product of:
               1.8051003 = boost
               4.7057014 = idf(docFreq=1091, maxDocs=44421)
               0.024022952 = queryNorm
             0.22057974 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7057014 = idf(docFreq=1091, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.020896647 = weight(abstract_txt:based in 3019) [ClassicSimilarity], result of:
           0.020896647 = score(doc=3019,freq=1.0), product of:
             0.14005171 = queryWeight, product of:
               1.8315347 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024022952 = queryNorm
             0.14920665 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.06804512 = weight(abstract_txt:systems in 3019) [ClassicSimilarity], result of:
           0.06804512 = score(doc=3019,freq=7.0), product of:
             0.16084318 = queryWeight, product of:
               1.9627829 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024022952 = queryNorm
             0.42305255 = fieldWeight in 3019, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.028899902 = weight(abstract_txt:knowledge in 3019) [ClassicSimilarity], result of:
           0.028899902 = score(doc=3019,freq=1.0), product of:
             0.17384742 = queryWeight, product of:
               2.0405867 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.024022952 = queryNorm
             0.16623716 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.23298228 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
           0.23298228 = score(doc=3019,freq=9.0), product of:
             0.3698435 = queryWeight, product of:
               3.436761 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024022952 = queryNorm
             0.62994826 = fieldWeight in 3019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
       0.44 = coord(11/25)
   

2. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.22

   0.21592727 = sum of:
     0.21592727 = product of:
       0.59979796 = sum of:
         0.07032065 = weight(abstract_txt:testing in 4700) [ClassicSimilarity], result of:
           0.07032065 = score(doc=4700,freq=1.0), product of:
             0.18000852 = queryWeight, product of:
               1.1988279 = boost
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.024022952 = queryNorm
             0.39065182 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.02209762 = weight(abstract_txt:system in 4700) [ClassicSimilarity], result of:
           0.02209762 = score(doc=4700,freq=1.0), product of:
             0.104828194 = queryWeight, product of:
               1.2937917 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024022952 = queryNorm
             0.21079844 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.024244538 = weight(abstract_txt:results in 4700) [ClassicSimilarity], result of:
           0.024244538 = score(doc=4700,freq=1.0), product of:
             0.11151254 = queryWeight, product of:
               1.3344035 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024022952 = queryNorm
             0.21741535 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.034646366 = weight(abstract_txt:design in 4700) [ClassicSimilarity], result of:
           0.034646366 = score(doc=4700,freq=1.0), product of:
             0.14147712 = queryWeight, product of:
               1.5030327 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.024022952 = queryNorm
             0.24489023 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.027862195 = weight(abstract_txt:based in 4700) [ClassicSimilarity], result of:
           0.027862195 = score(doc=4700,freq=1.0), product of:
             0.14005171 = queryWeight, product of:
               1.8315347 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024022952 = queryNorm
             0.1989422 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.059394646 = weight(abstract_txt:systems in 4700) [ClassicSimilarity], result of:
           0.059394646 = score(doc=4700,freq=3.0), product of:
             0.16084318 = queryWeight, product of:
               1.9627829 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024022952 = queryNorm
             0.36927053 = fieldWeight in 4700, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.038533203 = weight(abstract_txt:knowledge in 4700) [ClassicSimilarity], result of:
           0.038533203 = score(doc=4700,freq=1.0), product of:
             0.17384742 = queryWeight, product of:
               2.0405867 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.024022952 = queryNorm
             0.22164954 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.115603365 = weight(abstract_txt:procedures in 4700) [ClassicSimilarity], result of:
           0.115603365 = score(doc=4700,freq=1.0), product of:
             0.31590858 = queryWeight, product of:
               2.2459807 = boost
               5.8550286 = idf(docFreq=345, maxDocs=44421)
               0.024022952 = queryNorm
             0.3659393 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8550286 = idf(docFreq=345, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.20709535 = weight(abstract_txt:evaluation in 4700) [ClassicSimilarity], result of:
           0.20709535 = score(doc=4700,freq=4.0), product of:
             0.3698435 = queryWeight, product of:
               3.436761 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024022952 = queryNorm
             0.559954 = fieldWeight in 4700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
       0.36 = coord(9/25)
   

3. Oliver, R.: ¬An investigation of skills transfer between hypermedia systems (1995) 0.18

   0.18414995 = sum of:
     0.18414995 = product of:
       0.5754686 = sum of:
         0.08658022 = weight(abstract_txt:levels in 4786) [ClassicSimilarity], result of:
           0.08658022 = score(doc=4786,freq=2.0), product of:
             0.12525047 = queryWeight, product of:
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.024022952 = queryNorm
             0.6912566 = fieldWeight in 4786, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.09335139 = weight(abstract_txt:achieved in 4786) [ClassicSimilarity], result of:
           0.09335139 = score(doc=4786,freq=1.0), product of:
             0.16592969 = queryWeight, product of:
               1.1509922 = boost
               6.0010242 = idf(docFreq=298, maxDocs=44421)
               0.024022952 = queryNorm
             0.562596 = fieldWeight in 4786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0010242 = idf(docFreq=298, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.105480984 = weight(abstract_txt:testing in 4786) [ClassicSimilarity], result of:
           0.105480984 = score(doc=4786,freq=1.0), product of:
             0.18000852 = queryWeight, product of:
               1.1988279 = boost
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.024022952 = queryNorm
             0.58597773 = fieldWeight in 4786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.057411302 = weight(abstract_txt:system in 4786) [ClassicSimilarity], result of:
           0.057411302 = score(doc=4786,freq=3.0), product of:
             0.104828194 = queryWeight, product of:
               1.2937917 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024022952 = queryNorm
             0.5476704 = fieldWeight in 4786, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.03636681 = weight(abstract_txt:results in 4786) [ClassicSimilarity], result of:
           0.03636681 = score(doc=4786,freq=1.0), product of:
             0.11151254 = queryWeight, product of:
               1.3344035 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024022952 = queryNorm
             0.32612303 = fieldWeight in 4786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.041793294 = weight(abstract_txt:based in 4786) [ClassicSimilarity], result of:
           0.041793294 = score(doc=4786,freq=1.0), product of:
             0.14005171 = queryWeight, product of:
               1.8315347 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024022952 = queryNorm
             0.2984133 = fieldWeight in 4786, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.07274329 = weight(abstract_txt:systems in 4786) [ClassicSimilarity], result of:
           0.07274329 = score(doc=4786,freq=2.0), product of:
             0.16084318 = queryWeight, product of:
               1.9627829 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024022952 = queryNorm
             0.4522622 = fieldWeight in 4786, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
         0.081741266 = weight(abstract_txt:knowledge in 4786) [ClassicSimilarity], result of:
           0.081741266 = score(doc=4786,freq=2.0), product of:
             0.17384742 = queryWeight, product of:
               2.0405867 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.024022952 = queryNorm
             0.4701897 = fieldWeight in 4786, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.09375 = fieldNorm(doc=4786)
       0.32 = coord(8/25)
   

4. Zhang, X.; Han, H.: ¬An empirical testing of user stereotypes of information retrieval systems (2005) 0.18

   0.1789953 = sum of:
     0.1789953 = product of:
       0.49720913 = sum of:
         0.07032065 = weight(abstract_txt:testing in 2031) [ClassicSimilarity], result of:
           0.07032065 = score(doc=2031,freq=1.0), product of:
             0.18000852 = queryWeight, product of:
               1.1988279 = boost
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.024022952 = queryNorm
             0.39065182 = fieldWeight in 2031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.02209762 = weight(abstract_txt:system in 2031) [ClassicSimilarity], result of:
           0.02209762 = score(doc=2031,freq=1.0), product of:
             0.104828194 = queryWeight, product of:
               1.2937917 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024022952 = queryNorm
             0.21079844 = fieldWeight in 2031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.034286954 = weight(abstract_txt:results in 2031) [ClassicSimilarity], result of:
           0.034286954 = score(doc=2031,freq=2.0), product of:
             0.11151254 = queryWeight, product of:
               1.3344035 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024022952 = queryNorm
             0.30747172 = fieldWeight in 2031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.034646366 = weight(abstract_txt:design in 2031) [ClassicSimilarity], result of:
           0.034646366 = score(doc=2031,freq=1.0), product of:
             0.14147712 = queryWeight, product of:
               1.5030327 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.024022952 = queryNorm
             0.24489023 = fieldWeight in 2031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.048258737 = weight(abstract_txt:based in 2031) [ClassicSimilarity], result of:
           0.048258737 = score(doc=2031,freq=3.0), product of:
             0.14005171 = queryWeight, product of:
               1.8315347 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024022952 = queryNorm
             0.344578 = fieldWeight in 2031, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.048495527 = weight(abstract_txt:systems in 2031) [ClassicSimilarity], result of:
           0.048495527 = score(doc=2031,freq=2.0), product of:
             0.16084318 = queryWeight, product of:
               1.9627829 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024022952 = queryNorm
             0.30150813 = fieldWeight in 2031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.08106146 = weight(abstract_txt:empirical in 2031) [ClassicSimilarity], result of:
           0.08106146 = score(doc=2031,freq=1.0), product of:
             0.2493393 = queryWeight, product of:
               1.9953573 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.024022952 = queryNorm
             0.32510504 = fieldWeight in 2031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.054494176 = weight(abstract_txt:knowledge in 2031) [ClassicSimilarity], result of:
           0.054494176 = score(doc=2031,freq=2.0), product of:
             0.17384742 = queryWeight, product of:
               2.0405867 = boost
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.024022952 = queryNorm
             0.31345978 = fieldWeight in 2031, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5463927 = idf(docFreq=3480, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
         0.10354768 = weight(abstract_txt:evaluation in 2031) [ClassicSimilarity], result of:
           0.10354768 = score(doc=2031,freq=1.0), product of:
             0.3698435 = queryWeight, product of:
               3.436761 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024022952 = queryNorm
             0.279977 = fieldWeight in 2031, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=2031)
       0.36 = coord(9/25)
   

5. Bosch, V.M.; Hancock-Beaulieu, M.: CD-ROM user interface evaluation : the appropriateness of GUIs (1995) 0.18

   0.17846131 = sum of:
     0.17846131 = product of:
       0.55769163 = sum of:
         0.05101788 = weight(abstract_txt:levels in 3734) [ClassicSimilarity], result of:
           0.05101788 = score(doc=3734,freq=1.0), product of:
             0.12525047 = queryWeight, product of:
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.024022952 = queryNorm
             0.40732685 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.05429289 = weight(abstract_txt:appropriate in 3734) [ClassicSimilarity], result of:
           0.05429289 = score(doc=3734,freq=1.0), product of:
             0.13055487 = queryWeight, product of:
               1.0209556 = boost
               5.3230414 = idf(docFreq=588, maxDocs=44421)
               0.024022952 = queryNorm
             0.41586262 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3230414 = idf(docFreq=588, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.061996046 = weight(abstract_txt:criteria in 3734) [ClassicSimilarity], result of:
           0.061996046 = score(doc=3734,freq=1.0), product of:
             0.14262876 = queryWeight, product of:
               1.0671215 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.024022952 = queryNorm
             0.43466723 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.0671917 = weight(abstract_txt:expert in 3734) [ClassicSimilarity], result of:
           0.0671917 = score(doc=3734,freq=1.0), product of:
             0.15049018 = queryWeight, product of:
               1.0961359 = boost
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.024022952 = queryNorm
             0.44648558 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7150154 = idf(docFreq=397, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.030305674 = weight(abstract_txt:results in 3734) [ClassicSimilarity], result of:
           0.030305674 = score(doc=3734,freq=1.0), product of:
             0.11151254 = queryWeight, product of:
               1.3344035 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024022952 = queryNorm
             0.2717692 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.075011574 = weight(abstract_txt:design in 3734) [ClassicSimilarity], result of:
           0.075011574 = score(doc=3734,freq=3.0), product of:
             0.14147712 = queryWeight, product of:
               1.5030327 = boost
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.024022952 = queryNorm
             0.53020287 = fieldWeight in 3734, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9182436 = idf(docFreq=2399, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.034827743 = weight(abstract_txt:based in 3734) [ClassicSimilarity], result of:
           0.034827743 = score(doc=3734,freq=1.0), product of:
             0.14005171 = queryWeight, product of:
               1.8315347 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024022952 = queryNorm
             0.24867775 = fieldWeight in 3734, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
         0.18304814 = weight(abstract_txt:evaluation in 3734) [ClassicSimilarity], result of:
           0.18304814 = score(doc=3734,freq=2.0), product of:
             0.3698435 = queryWeight, product of:
               3.436761 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024022952 = queryNorm
             0.49493405 = fieldWeight in 3734, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3734)
       0.32 = coord(8/25)