Document (#27535)

Author

Toms, E.G.
Freund, L.
Li, C.

Title

WilRE: the Web Interactive information retrieval experimentation system prototype

Source

Information processing and management. 40(2004) no.4, S.655-676

Year

2004

Abstract

We introduce WiIRE, a prototype system for conducting interactive information retrieval (IIR) experiments via the Internet. We conceived Wi IRE to increase validity while streamlining procedures and adding efficiencies to the conduct of IIR experiments. The system incorporates password-controlled access, online questionnaires, study instructions and tutorials, conditional interface assignment, and conditional query assignment as well as provision for data collection. As an initial evaluation, we used WiIRE inhouse to conduct a Web-based IIR experiment using an external search engine with customized search interfaces and the TREC 11 Interactive Track search queries. Our evaluation of the prototype indicated significant cost efficiencies in the conduct of IIR studies, and additionally had some novel findings about the human perspective: about half participants would have preferred some personal contact with the researcher, and participants spent a significantly decreasing amount of time on tasks over the course of a session.

Similar documents (author)

1. Freund, L.; Toms, E.G.: Interacting with archival finding aids (2016) 6.48

   6.480002 = sum of:
     6.480002 = sum of:
       2.757267 = weight(author_txt:toms in 3851) [ClassicSimilarity], result of:
         2.757267 = score(doc=3851,freq=1.0), product of:
           0.6334369 = queryWeight, product of:
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.07276087 = queryNorm
           4.3528676 = fieldWeight in 3851, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.5 = fieldNorm(doc=3851)
       3.722735 = weight(author_txt:freund in 3851) [ClassicSimilarity], result of:
         3.722735 = score(doc=3851,freq=1.0), product of:
           0.77379435 = queryWeight, product of:
             1.1052514 = boost
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.07276087 = queryNorm
           4.811013 = fieldWeight in 3851, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.5 = fieldNorm(doc=3851)
   

2. Wildemuth, B.; Freund, L.; Toms, E.G.: Untangling search task complexity and difficulty in the context of interactive information retrieval studies (2014) 4.86

   4.8600016 = sum of:
     4.8600016 = sum of:
       2.0679502 = weight(author_txt:toms in 2786) [ClassicSimilarity], result of:
         2.0679502 = score(doc=2786,freq=1.0), product of:
           0.6334369 = queryWeight, product of:
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.07276087 = queryNorm
           3.2646508 = fieldWeight in 2786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.375 = fieldNorm(doc=2786)
       2.792051 = weight(author_txt:freund in 2786) [ClassicSimilarity], result of:
         2.792051 = score(doc=2786,freq=1.0), product of:
           0.77379435 = queryWeight, product of:
             1.1052514 = boost
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.07276087 = queryNorm
           3.60826 = fieldWeight in 2786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.622026 = idf(docFreq=7, maxDocs=44421)
             0.375 = fieldNorm(doc=2786)
   

3. Freund, L.: Contextualizing the information-seeking behavior of software engineers (2015) 2.33

   2.3267093 = sum of:
     2.3267093 = product of:
       4.6534185 = sum of:
         4.6534185 = weight(author_txt:freund in 3120) [ClassicSimilarity], result of:
           4.6534185 = score(doc=3120,freq=1.0), product of:
             0.77379435 = queryWeight, product of:
               1.1052514 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07276087 = queryNorm
             6.0137663 = fieldWeight in 3120, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.625 = fieldNorm(doc=3120)
       0.5 = coord(1/2)
   

4. Parra Freund, G. => Freund, G.P.: 2.30

   2.3033247 = sum of:
     2.3033247 = product of:
       4.6066494 = sum of:
         4.6066494 = weight(author_txt:freund in 822) [ClassicSimilarity], result of:
           4.6066494 = score(doc=822,freq=2.0), product of:
             0.77379435 = queryWeight, product of:
               1.1052514 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07276087 = queryNorm
             5.9533253 = fieldWeight in 822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.4375 = fieldNorm(doc=822)
       0.5 = coord(1/2)
   

5. Toms, E.G.: Free-Neets : delivering information to the community (1994) 1.72

   1.7232919 = sum of:
     1.7232919 = product of:
       3.4465837 = sum of:
         3.4465837 = weight(author_txt:toms in 647) [ClassicSimilarity], result of:
           3.4465837 = score(doc=647,freq=1.0), product of:
             0.6334369 = queryWeight, product of:
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.07276087 = queryNorm
             5.4410844 = fieldWeight in 647, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.625 = fieldNorm(doc=647)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Morgan, E.L.: Creating user-friendly electronic information systems (1997) 0.13

   0.13223481 = sum of:
     0.13223481 = product of:
       0.66117406 = sum of:
         0.14721316 = weight(abstract_txt:customized in 2829) [ClassicSimilarity], result of:
           0.14721316 = score(doc=2829,freq=1.0), product of:
             0.15233198 = queryWeight, product of:
               1.0816479 = boost
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.018216278 = queryNorm
             0.966397 = fieldWeight in 2829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.125 = fieldNorm(doc=2829)
         0.03666852 = weight(abstract_txt:system in 2829) [ClassicSimilarity], result of:
           0.03666852 = score(doc=2829,freq=1.0), product of:
             0.08697531 = queryWeight, product of:
               1.4156274 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018216278 = queryNorm
             0.42159688 = fieldWeight in 2829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.125 = fieldNorm(doc=2829)
         0.04664983 = weight(abstract_txt:search in 2829) [ClassicSimilarity], result of:
           0.04664983 = score(doc=2829,freq=1.0), product of:
             0.10211756 = queryWeight, product of:
               1.5339146 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.018216278 = queryNorm
             0.45682475 = fieldWeight in 2829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.125 = fieldNorm(doc=2829)
         0.23197094 = weight(abstract_txt:interactive in 2829) [ClassicSimilarity], result of:
           0.23197094 = score(doc=2829,freq=2.0), product of:
             0.23612727 = queryWeight, product of:
               2.3325129 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.018216278 = queryNorm
             0.9823979 = fieldWeight in 2829, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.125 = fieldNorm(doc=2829)
         0.19867158 = weight(abstract_txt:prototype in 2829) [ClassicSimilarity], result of:
           0.19867158 = score(doc=2829,freq=1.0), product of:
             0.2683022 = queryWeight, product of:
               2.4863548 = boost
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.018216278 = queryNorm
             0.7404769 = fieldWeight in 2829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.125 = fieldNorm(doc=2829)
       0.2 = coord(5/25)
   

2. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.11

   0.11040172 = sum of:
     0.11040172 = product of:
       0.46000716 = sum of:
         0.019822452 = weight(abstract_txt:some in 3021) [ClassicSimilarity], result of:
           0.019822452 = score(doc=3021,freq=1.0), product of:
             0.06897445 = queryWeight, product of:
               1.0293177 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.018216278 = queryNorm
             0.28738832 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.023909131 = weight(abstract_txt:about in 3021) [ClassicSimilarity], result of:
           0.023909131 = score(doc=3021,freq=1.0), product of:
             0.078155436 = queryWeight, product of:
               1.095683 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.018216278 = queryNorm
             0.3059177 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.101249285 = weight(abstract_txt:evaluation in 3021) [ClassicSimilarity], result of:
           0.101249285 = score(doc=3021,freq=8.0), product of:
             0.10228563 = queryWeight, product of:
               1.2534662 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018216278 = queryNorm
             0.9898681 = fieldWeight in 3021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.03969484 = weight(abstract_txt:system in 3021) [ClassicSimilarity], result of:
           0.03969484 = score(doc=3021,freq=3.0), product of:
             0.08697531 = queryWeight, product of:
               1.4156274 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018216278 = queryNorm
             0.45639202 = fieldWeight in 3021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.10251764 = weight(abstract_txt:interactive in 3021) [ClassicSimilarity], result of:
           0.10251764 = score(doc=3021,freq=1.0), product of:
             0.23612727 = queryWeight, product of:
               2.3325129 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.018216278 = queryNorm
             0.43416265 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.1728138 = weight(abstract_txt:conduct in 3021) [ClassicSimilarity], result of:
           0.1728138 = score(doc=3021,freq=1.0), product of:
             0.33445114 = queryWeight, product of:
               2.7759862 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.018216278 = queryNorm
             0.5167087 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
       0.24 = coord(6/25)
   

3. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 0.08

   0.08415443 = sum of:
     0.08415443 = product of:
       0.35064346 = sum of:
         0.015857963 = weight(abstract_txt:some in 406) [ClassicSimilarity], result of:
           0.015857963 = score(doc=406,freq=1.0), product of:
             0.06897445 = queryWeight, product of:
               1.0293177 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.018216278 = queryNorm
             0.22991067 = fieldWeight in 406, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
         0.019127306 = weight(abstract_txt:about in 406) [ClassicSimilarity], result of:
           0.019127306 = score(doc=406,freq=1.0), product of:
             0.078155436 = queryWeight, product of:
               1.095683 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.018216278 = queryNorm
             0.24473417 = fieldWeight in 406, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
         0.025928559 = weight(abstract_txt:system in 406) [ClassicSimilarity], result of:
           0.025928559 = score(doc=406,freq=2.0), product of:
             0.08697531 = queryWeight, product of:
               1.4156274 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018216278 = queryNorm
             0.298114 = fieldWeight in 406, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
         0.08468857 = weight(abstract_txt:participants in 406) [ClassicSimilarity], result of:
           0.08468857 = score(doc=406,freq=3.0), product of:
             0.14611655 = queryWeight, product of:
               1.4981492 = boost
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.018216278 = queryNorm
             0.579596 = fieldWeight in 406, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
         0.03298641 = weight(abstract_txt:search in 406) [ClassicSimilarity], result of:
           0.03298641 = score(doc=406,freq=2.0), product of:
             0.10211756 = queryWeight, product of:
               1.5339146 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.018216278 = queryNorm
             0.3230239 = fieldWeight in 406, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
         0.17205465 = weight(abstract_txt:prototype in 406) [ClassicSimilarity], result of:
           0.17205465 = score(doc=406,freq=3.0), product of:
             0.2683022 = queryWeight, product of:
               2.4863548 = boost
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.018216278 = queryNorm
             0.6412718 = fieldWeight in 406, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.0625 = fieldNorm(doc=406)
       0.24 = coord(6/25)
   

4. Wong, S.K.M.; Butz, C.J.; Xiang, X.: Automated database schema design using mined data dependencies (1998) 0.08

   0.08201663 = sum of:
     0.08201663 = product of:
       0.51260394 = sum of:
         0.027501391 = weight(abstract_txt:system in 3897) [ClassicSimilarity], result of:
           0.027501391 = score(doc=3897,freq=1.0), product of:
             0.08697531 = queryWeight, product of:
               1.4156274 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018216278 = queryNorm
             0.31619766 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=3897)
         0.07214341 = weight(abstract_txt:experiments in 3897) [ClassicSimilarity], result of:
           0.07214341 = score(doc=3897,freq=1.0), product of:
             0.14451966 = queryWeight, product of:
               1.48994 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.018216278 = queryNorm
             0.49919444 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.09375 = fieldNorm(doc=3897)
         0.2639554 = weight(abstract_txt:conditional in 3897) [ClassicSimilarity], result of:
           0.2639554 = score(doc=3897,freq=1.0), product of:
             0.3431491 = queryWeight, product of:
               2.2958672 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.018216278 = queryNorm
             0.769215 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.09375 = fieldNorm(doc=3897)
         0.1490037 = weight(abstract_txt:prototype in 3897) [ClassicSimilarity], result of:
           0.1490037 = score(doc=3897,freq=1.0), product of:
             0.2683022 = queryWeight, product of:
               2.4863548 = boost
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.018216278 = queryNorm
             0.5553577 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9238153 = idf(docFreq=322, maxDocs=44421)
               0.09375 = fieldNorm(doc=3897)
       0.16 = coord(4/25)
   

5. Hancock-Beaulieu, M.; Robertson, S.; Neilson, C.: Evaluation of online catalogues : eliciting information from the user (1991) 0.08

   0.08201521 = sum of:
     0.08201521 = product of:
       0.41007602 = sum of:
         0.087246954 = weight(abstract_txt:questionnaires in 3766) [ClassicSimilarity], result of:
           0.087246954 = score(doc=3766,freq=1.0), product of:
             0.1302025 = queryWeight, product of:
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.018216278 = queryNorm
             0.6700866 = fieldWeight in 3766, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1475906 = idf(docFreq=94, maxDocs=44421)
               0.09375 = fieldNorm(doc=3766)
         0.06074957 = weight(abstract_txt:evaluation in 3766) [ClassicSimilarity], result of:
           0.06074957 = score(doc=3766,freq=2.0), product of:
             0.10228563 = queryWeight, product of:
               1.2534662 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.018216278 = queryNorm
             0.5939209 = fieldWeight in 3766, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=3766)
         0.027501391 = weight(abstract_txt:system in 3766) [ClassicSimilarity], result of:
           0.027501391 = score(doc=3766,freq=1.0), product of:
             0.08697531 = queryWeight, product of:
               1.4156274 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.018216278 = queryNorm
             0.31619766 = fieldWeight in 3766, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=3766)
         0.06059991 = weight(abstract_txt:search in 3766) [ClassicSimilarity], result of:
           0.06059991 = score(doc=3766,freq=3.0), product of:
             0.10211756 = queryWeight, product of:
               1.5339146 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.018216278 = queryNorm
             0.5934328 = fieldWeight in 3766, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.09375 = fieldNorm(doc=3766)
         0.1739782 = weight(abstract_txt:interactive in 3766) [ClassicSimilarity], result of:
           0.1739782 = score(doc=3766,freq=2.0), product of:
             0.23612727 = queryWeight, product of:
               2.3325129 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.018216278 = queryNorm
             0.7367984 = fieldWeight in 3766, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.09375 = fieldNorm(doc=3766)
       0.2 = coord(5/25)