Document (#37047)

Author

Vakkari, P.
Huuskonen, S.

Title

Search effort degrades search output but improves task outcome

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.4, S.657-670

Year

2012

Abstract

We analyzed how effort in searching is associated with search output and task outcome. In a field study, we examined how students' search effort for an assigned learning task was associated with precision and relative recall, and how this was associated to the quality of learning outcome. The study subjects were 41 medical students writing essays for a class in medicine. Searching in Medline was part of their assignment. The data comprised students' search logs in Medline, their assessment of the usefulness of references retrieved, a questionnaire concerning the search process, and evaluation scores of the essays given by the teachers. Pearson correlation was calculated for answering the research questions. Finally, a path model for predicting task outcome was built. We found that effort in the search process degraded precision but improved task outcome. There were two major mechanisms reducing precision while enhancing task outcome. Effort in expanding Medical Subject Heading (MeSH) terms within search sessions and effort in assessing and exploring documents in the result list between the sessions degraded precision, but led to better task outcome. Thus, human effort compensated bad retrieval results on the way to good task outcome. Findings suggest that traditional effectiveness measures in information retrieval should be complemented with evaluation measures for search process and outcome.

Theme

Retrievalstudien
Suchtaktik

Similar documents (author)

1. Vakkari, P.: Information seeking in context : a challenging metatheory (1997) 5.17

   5.167175 = sum of:
     5.167175 = weight(author_txt:vakkari in 1302) [ClassicSimilarity], result of:
       5.167175 = score(doc=1302,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.120955825 = queryNorm
         5.1671753 = fieldWeight in 1302, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.625 = fieldNorm(doc=1302)
   

2. Vakkari, P.: Task complexity, information types, search strategies and relevance : integrating studies on information retrieval and seeking (1999) 5.17

   5.167175 = sum of:
     5.167175 = weight(author_txt:vakkari in 1299) [ClassicSimilarity], result of:
       5.167175 = score(doc=1299,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.120955825 = queryNorm
         5.1671753 = fieldWeight in 1299, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.625 = fieldNorm(doc=1299)
   

3. Vakkari, P.: Task-based information searching (2002) 5.17

   5.167175 = sum of:
     5.167175 = weight(author_txt:vakkari in 5288) [ClassicSimilarity], result of:
       5.167175 = score(doc=5288,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.120955825 = queryNorm
         5.1671753 = fieldWeight in 5288, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.625 = fieldNorm(doc=5288)
   

4. Vakkari, P.: ¬A theory of the task-based information retrieval process : a summary and generalisation of a longitudinal study (2001) 5.17

   5.167175 = sum of:
     5.167175 = weight(author_txt:vakkari in 5493) [ClassicSimilarity], result of:
       5.167175 = score(doc=5493,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.120955825 = queryNorm
         5.1671753 = fieldWeight in 5493, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.625 = fieldNorm(doc=5493)
   

5. Vakkari, P.: Perceived influence of the use of electronic information resources on scholarly work and publication productivity (2008) 5.17

   5.167175 = sum of:
     5.167175 = weight(author_txt:vakkari in 2380) [ClassicSimilarity], result of:
       5.167175 = score(doc=2380,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.120955825 = queryNorm
         5.1671753 = fieldWeight in 2380, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.267481 = idf(docFreq=30, maxDocs=44421)
           0.625 = fieldNorm(doc=2380)
   

Similar documents (content)

1. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.76

   0.75668484 = sum of:
     0.75668484 = product of:
       1.1823201 = sum of:
         0.016797947 = weight(abstract_txt:were in 2891) [ClassicSimilarity], result of:
           0.016797947 = score(doc=2891,freq=4.0), product of:
             0.041876446 = queryWeight, product of:
               1.0055137 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01135569 = queryNorm
             0.40113115 = fieldWeight in 2891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.007944183 = weight(abstract_txt:with in 2891) [ClassicSimilarity], result of:
           0.007944183 = score(doc=2891,freq=4.0), product of:
             0.029097943 = queryWeight, product of:
               1.0265495 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01135569 = queryNorm
             0.2730153 = fieldWeight in 2891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.018961892 = weight(abstract_txt:searching in 2891) [ClassicSimilarity], result of:
           0.018961892 = score(doc=2891,freq=2.0), product of:
             0.057200104 = queryWeight, product of:
               1.1751722 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.01135569 = queryNorm
             0.331501 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.05617042 = weight(abstract_txt:pearson in 2891) [ClassicSimilarity], result of:
           0.05617042 = score(doc=2891,freq=1.0), product of:
             0.11798156 = queryWeight, product of:
               1.193425 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.01135569 = queryNorm
             0.4760949 = fieldWeight in 2891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.021645281 = weight(abstract_txt:evaluation in 2891) [ClassicSimilarity], result of:
           0.021645281 = score(doc=2891,freq=2.0), product of:
             0.062476665 = queryWeight, product of:
               1.2281799 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01135569 = queryNorm
             0.34645385 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.038440876 = weight(abstract_txt:measures in 2891) [ClassicSimilarity], result of:
           0.038440876 = score(doc=2891,freq=2.0), product of:
             0.09162301 = queryWeight, product of:
               1.4873232 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.01135569 = queryNorm
             0.41955483 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.047219906 = weight(abstract_txt:medical in 2891) [ClassicSimilarity], result of:
           0.047219906 = score(doc=2891,freq=2.0), product of:
             0.10508945 = queryWeight, product of:
               1.5928785 = boost
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.01135569 = queryNorm
             0.44933063 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.03390477 = weight(abstract_txt:process in 2891) [ClassicSimilarity], result of:
           0.03390477 = score(doc=2891,freq=4.0), product of:
             0.076560244 = queryWeight, product of:
               1.6651386 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01135569 = queryNorm
             0.44285086 = fieldWeight in 2891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.09287602 = weight(abstract_txt:medline in 2891) [ClassicSimilarity], result of:
           0.09287602 = score(doc=2891,freq=3.0), product of:
             0.1441167 = queryWeight, product of:
               1.8653497 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.01135569 = queryNorm
             0.64445007 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.07535917 = weight(abstract_txt:students in 2891) [ClassicSimilarity], result of:
           0.07535917 = score(doc=2891,freq=6.0), product of:
             0.11390858 = queryWeight, product of:
               2.0310795 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.01135569 = queryNorm
             0.6615759 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.07498742 = weight(abstract_txt:associated in 2891) [ClassicSimilarity], result of:
           0.07498742 = score(doc=2891,freq=5.0), product of:
             0.12064751 = queryWeight, product of:
               2.0902965 = boost
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.01135569 = queryNorm
             0.6215414 = fieldWeight in 2891, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.08308321 = weight(abstract_txt:essays in 2891) [ClassicSimilarity], result of:
           0.08308321 = score(doc=2891,freq=1.0), product of:
             0.19297211 = queryWeight, product of:
               2.1584916 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.01135569 = queryNorm
             0.43054518 = fieldWeight in 2891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.14056444 = weight(abstract_txt:precision in 2891) [ClassicSimilarity], result of:
           0.14056444 = score(doc=2891,freq=6.0), product of:
             0.18997462 = queryWeight, product of:
               3.028767 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.01135569 = queryNorm
             0.7399117 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.06477587 = weight(abstract_txt:search in 2891) [ClassicSimilarity], result of:
           0.06477587 = score(doc=2891,freq=3.0), product of:
             0.18712203 = queryWeight, product of:
               4.508912 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01135569 = queryNorm
             0.3461691 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.16081649 = weight(abstract_txt:task in 2891) [ClassicSimilarity], result of:
           0.16081649 = score(doc=2891,freq=4.0), product of:
             0.29971334 = queryWeight, product of:
               5.380048 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.01135569 = queryNorm
             0.5365677 = fieldWeight in 2891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.24877226 = weight(abstract_txt:outcome in 2891) [ClassicSimilarity], result of:
           0.24877226 = score(doc=2891,freq=1.0), product of:
             0.66184735 = queryWeight, product of:
               8.479852 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.01135569 = queryNorm
             0.3758756 = fieldWeight in 2891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
       0.64 = coord(16/25)
   

2. Vanopstal, K.; Stichele, R.Vander; Laureys, G.; Buysschaert, J.: PubMed searches by Dutch-speaking nursing students : the impact of language and system experience (2012) 0.22

   0.22030364 = sum of:
     0.22030364 = product of:
       0.5507591 = sum of:
         0.037767146 = weight(abstract_txt:mesh in 1369) [ClassicSimilarity], result of:
           0.037767146 = score(doc=1369,freq=1.0), product of:
             0.082836896 = queryWeight, product of:
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.01135569 = queryNorm
             0.45592177 = fieldWeight in 1369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.01357479 = weight(abstract_txt:were in 1369) [ClassicSimilarity], result of:
           0.01357479 = score(doc=1369,freq=2.0), product of:
             0.041876446 = queryWeight, product of:
               1.0055137 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01135569 = queryNorm
             0.3241629 = fieldWeight in 1369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.006419869 = weight(abstract_txt:with in 1369) [ClassicSimilarity], result of:
           0.006419869 = score(doc=1369,freq=2.0), product of:
             0.029097943 = queryWeight, product of:
               1.0265495 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01135569 = queryNorm
             0.22062966 = fieldWeight in 1369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.038159445 = weight(abstract_txt:medical in 1369) [ClassicSimilarity], result of:
           0.038159445 = score(doc=1369,freq=1.0), product of:
             0.10508945 = queryWeight, product of:
               1.5928785 = boost
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.01135569 = queryNorm
             0.36311397 = fieldWeight in 1369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8098235 = idf(docFreq=361, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.02739919 = weight(abstract_txt:process in 1369) [ClassicSimilarity], result of:
           0.02739919 = score(doc=1369,freq=2.0), product of:
             0.076560244 = queryWeight, product of:
               1.6651386 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01135569 = queryNorm
             0.35787752 = fieldWeight in 1369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.061282277 = weight(abstract_txt:medline in 1369) [ClassicSimilarity], result of:
           0.061282277 = score(doc=1369,freq=1.0), product of:
             0.1441167 = queryWeight, product of:
               1.8653497 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.01135569 = queryNorm
             0.42522675 = fieldWeight in 1369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.049724154 = weight(abstract_txt:students in 1369) [ClassicSimilarity], result of:
           0.049724154 = score(doc=1369,freq=2.0), product of:
             0.11390858 = queryWeight, product of:
               2.0310795 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.01135569 = queryNorm
             0.43652686 = fieldWeight in 1369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.06558308 = weight(abstract_txt:precision in 1369) [ClassicSimilarity], result of:
           0.06558308 = score(doc=1369,freq=1.0), product of:
             0.18997462 = queryWeight, product of:
               3.028767 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.01135569 = queryNorm
             0.3452202 = fieldWeight in 1369, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.12088977 = weight(abstract_txt:search in 1369) [ClassicSimilarity], result of:
           0.12088977 = score(doc=1369,freq=8.0), product of:
             0.18712203 = queryWeight, product of:
               4.508912 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01135569 = queryNorm
             0.6460478 = fieldWeight in 1369, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
         0.12995936 = weight(abstract_txt:task in 1369) [ClassicSimilarity], result of:
           0.12995936 = score(doc=1369,freq=2.0), product of:
             0.29971334 = queryWeight, product of:
               5.380048 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.01135569 = queryNorm
             0.43361217 = fieldWeight in 1369, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=1369)
       0.4 = coord(10/25)
   

3. Barsky, E.; Bar-Ilan, J.: ¬The impact of task phrasing on the choice of search keywords and on the search process and success (2012) 0.20

   0.20376866 = sum of:
     0.20376866 = product of:
       0.7277452 = sum of:
         0.01357479 = weight(abstract_txt:were in 1455) [ClassicSimilarity], result of:
           0.01357479 = score(doc=1455,freq=2.0), product of:
             0.041876446 = queryWeight, product of:
               1.0055137 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01135569 = queryNorm
             0.3241629 = fieldWeight in 1455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.0101507045 = weight(abstract_txt:with in 1455) [ClassicSimilarity], result of:
           0.0101507045 = score(doc=1455,freq=5.0), product of:
             0.029097943 = queryWeight, product of:
               1.0265495 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01135569 = queryNorm
             0.34884614 = fieldWeight in 1455, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.033557016 = weight(abstract_txt:process in 1455) [ClassicSimilarity], result of:
           0.033557016 = score(doc=1455,freq=3.0), product of:
             0.076560244 = queryWeight, product of:
               1.6651386 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01135569 = queryNorm
             0.43830866 = fieldWeight in 1455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.038326163 = weight(abstract_txt:associated in 1455) [ClassicSimilarity], result of:
           0.038326163 = score(doc=1455,freq=1.0), product of:
             0.12064751 = queryWeight, product of:
               2.0902965 = boost
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.01135569 = queryNorm
             0.31767055 = fieldWeight in 1455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.104693614 = weight(abstract_txt:search in 1455) [ClassicSimilarity], result of:
           0.104693614 = score(doc=1455,freq=6.0), product of:
             0.18712203 = queryWeight, product of:
               4.508912 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01135569 = queryNorm
             0.5594938 = fieldWeight in 1455, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.24313168 = weight(abstract_txt:task in 1455) [ClassicSimilarity], result of:
           0.24313168 = score(doc=1455,freq=7.0), product of:
             0.29971334 = queryWeight, product of:
               5.380048 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.01135569 = queryNorm
             0.8112141 = fieldWeight in 1455, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
         0.28431118 = weight(abstract_txt:outcome in 1455) [ClassicSimilarity], result of:
           0.28431118 = score(doc=1455,freq=1.0), product of:
             0.66184735 = queryWeight, product of:
               8.479852 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.01135569 = queryNorm
             0.4295721 = fieldWeight in 1455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1455)
       0.28 = coord(7/25)
   

4. Pennanen, M.; Vakkari, P.: Students' conceptual structure, search process, and outcome while preparing a research proposal : a longitudinal case study (2003) 0.19

   0.19094206 = sum of:
     0.19094206 = product of:
       0.68193597 = sum of:
         0.02146363 = weight(abstract_txt:were in 2682) [ClassicSimilarity], result of:
           0.02146363 = score(doc=2682,freq=5.0), product of:
             0.041876446 = queryWeight, product of:
               1.0055137 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01135569 = queryNorm
             0.5125466 = fieldWeight in 2682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.02739919 = weight(abstract_txt:process in 2682) [ClassicSimilarity], result of:
           0.02739919 = score(doc=2682,freq=2.0), product of:
             0.076560244 = queryWeight, product of:
               1.6651386 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01135569 = queryNorm
             0.35787752 = fieldWeight in 2682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.082674295 = weight(abstract_txt:sessions in 2682) [ClassicSimilarity], result of:
           0.082674295 = score(doc=2682,freq=2.0), product of:
             0.13965657 = queryWeight, product of:
               1.8362583 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.01135569 = queryNorm
             0.59198284 = fieldWeight in 2682, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.0786208 = weight(abstract_txt:students in 2682) [ClassicSimilarity], result of:
           0.0786208 = score(doc=2682,freq=5.0), product of:
             0.11390858 = queryWeight, product of:
               2.0310795 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.01135569 = queryNorm
             0.6902096 = fieldWeight in 2682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.09557175 = weight(abstract_txt:search in 2682) [ClassicSimilarity], result of:
           0.09557175 = score(doc=2682,freq=5.0), product of:
             0.18712203 = queryWeight, product of:
               4.508912 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01135569 = queryNorm
             0.5107456 = fieldWeight in 2682, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.09189514 = weight(abstract_txt:task in 2682) [ClassicSimilarity], result of:
           0.09189514 = score(doc=2682,freq=1.0), product of:
             0.29971334 = queryWeight, product of:
               5.380048 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.01135569 = queryNorm
             0.3066101 = fieldWeight in 2682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
         0.28431118 = weight(abstract_txt:outcome in 2682) [ClassicSimilarity], result of:
           0.28431118 = score(doc=2682,freq=1.0), product of:
             0.66184735 = queryWeight, product of:
               8.479852 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.01135569 = queryNorm
             0.4295721 = fieldWeight in 2682, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2682)
       0.28 = coord(7/25)
   

5. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.19

   0.18956916 = sum of:
     0.18956916 = product of:
       0.59240365 = sum of:
         0.016797947 = weight(abstract_txt:were in 6932) [ClassicSimilarity], result of:
           0.016797947 = score(doc=6932,freq=4.0), product of:
             0.041876446 = queryWeight, product of:
               1.0055137 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01135569 = queryNorm
             0.40113115 = fieldWeight in 6932, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.011916275 = weight(abstract_txt:with in 6932) [ClassicSimilarity], result of:
           0.011916275 = score(doc=6932,freq=9.0), product of:
             0.029097943 = queryWeight, product of:
               1.0265495 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.01135569 = queryNorm
             0.40952295 = fieldWeight in 6932, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.0134080835 = weight(abstract_txt:searching in 6932) [ClassicSimilarity], result of:
           0.0134080835 = score(doc=6932,freq=1.0), product of:
             0.057200104 = queryWeight, product of:
               1.1751722 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.01135569 = queryNorm
             0.23440662 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.026509946 = weight(abstract_txt:evaluation in 6932) [ClassicSimilarity], result of:
           0.026509946 = score(doc=6932,freq=3.0), product of:
             0.062476665 = queryWeight, product of:
               1.2281799 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01135569 = queryNorm
             0.42431757 = fieldWeight in 6932, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.08154541 = weight(abstract_txt:measures in 6932) [ClassicSimilarity], result of:
           0.08154541 = score(doc=6932,freq=9.0), product of:
             0.09162301 = queryWeight, product of:
               1.4873232 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.01135569 = queryNorm
             0.89001024 = fieldWeight in 6932, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.14056444 = weight(abstract_txt:precision in 6932) [ClassicSimilarity], result of:
           0.14056444 = score(doc=6932,freq=6.0), product of:
             0.18997462 = queryWeight, product of:
               3.028767 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.01135569 = queryNorm
             0.7399117 = fieldWeight in 6932, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.052889276 = weight(abstract_txt:search in 6932) [ClassicSimilarity], result of:
           0.052889276 = score(doc=6932,freq=2.0), product of:
             0.18712203 = queryWeight, product of:
               4.508912 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01135569 = queryNorm
             0.2826459 = fieldWeight in 6932, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
         0.24877226 = weight(abstract_txt:outcome in 6932) [ClassicSimilarity], result of:
           0.24877226 = score(doc=6932,freq=1.0), product of:
             0.66184735 = queryWeight, product of:
               8.479852 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.01135569 = queryNorm
             0.3758756 = fieldWeight in 6932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6932)
       0.32 = coord(8/25)