Document (#34023)

Author

Göker, A.
Myrhaug, H.

Title

Evaluation of a mobile information system in context

Source

Information processing and management. 44(2008) no.1, S.39-65

Year

2008

Abstract

The motivation for this work has been to provide relevant information to the right situation for mobile phone users. We have iteratively developed applications for travellers and tourists to provide a general travel guide with local tourist information. This used a combination of wireless tag technology and information from content service providers. The paper presents our evaluation methodology and how we used it to develop the applications. The methodology is user centred, iterative, and progressive. It combines information retrieval (IR) evaluation methods with human-computer interaction (HCI) development techniques. Two groups of three user studies and a large survey were conducted in context with the studies scaling up to 238 participants and 438 user survey responses. The participants tested the applications in context, including the IR functions. They also filled in a pre and post questionnaire immediately before and after the system use. Some participants were additionally interviewed.

Footnote

Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems

Similar documents (content)

1. Sachse, J.: ¬The influence of snippet length on user behavior in mobile web search (2019) 0.17

   0.16717114 = sum of:
     0.16717114 = product of:
       0.59703976 = sum of:
         0.009083894 = weight(abstract_txt:with in 493) [ClassicSimilarity], result of:
           0.009083894 = score(doc=493,freq=1.0), product of:
             0.058226828 = queryWeight, product of:
               1.0159665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.022960154 = queryNorm
             0.15600874 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.025181586 = weight(abstract_txt:provide in 493) [ClassicSimilarity], result of:
           0.025181586 = score(doc=493,freq=1.0), product of:
             0.10037681 = queryWeight, product of:
               1.089153 = boost
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.022960154 = queryNorm
             0.25087056 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.03731511 = weight(abstract_txt:methodology in 493) [ClassicSimilarity], result of:
           0.03731511 = score(doc=493,freq=1.0), product of:
             0.13046715 = queryWeight, product of:
               1.2417175 = boost
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.022960154 = queryNorm
             0.28601155 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.02912837 = weight(abstract_txt:user in 493) [ClassicSimilarity], result of:
           0.02912837 = score(doc=493,freq=1.0), product of:
             0.12661521 = queryWeight, product of:
               1.498169 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.022960154 = queryNorm
             0.23005427 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.01377741 = weight(abstract_txt:information in 493) [ClassicSimilarity], result of:
           0.01377741 = score(doc=493,freq=1.0), product of:
             0.091131754 = queryWeight, product of:
               1.640881 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.022960154 = queryNorm
             0.15118122 = fieldWeight in 493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.32728606 = weight(abstract_txt:mobile in 493) [ClassicSimilarity], result of:
           0.32728606 = score(doc=493,freq=6.0), product of:
             0.30536032 = queryWeight, product of:
               1.8996716 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.022960154 = queryNorm
             1.0718029 = fieldWeight in 493, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
         0.15526734 = weight(abstract_txt:participants in 493) [ClassicSimilarity], result of:
           0.15526734 = score(doc=493,freq=3.0), product of:
             0.26788893 = queryWeight, product of:
               2.1791906 = boost
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.022960154 = queryNorm
             0.579596 = fieldWeight in 493, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.0625 = fieldNorm(doc=493)
       0.28 = coord(7/25)
   

2. Arif, A.S.M.; Du, J.T.; Lee, I.: Understanding tourists' collaborative information retrieval behavior to inform design (2015) 0.16

   0.15884858 = sum of:
     0.15884858 = product of:
       0.7942429 = sum of:
         0.009083894 = weight(abstract_txt:with in 3327) [ClassicSimilarity], result of:
           0.009083894 = score(doc=3327,freq=1.0), product of:
             0.058226828 = queryWeight, product of:
               1.0159665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.022960154 = queryNorm
             0.15600874 = fieldWeight in 3327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=3327)
         0.19283302 = weight(abstract_txt:travel in 3327) [ClassicSimilarity], result of:
           0.19283302 = score(doc=3327,freq=3.0), product of:
             0.2146093 = queryWeight, product of:
               1.1261117 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.022960154 = queryNorm
             0.8985306 = fieldWeight in 3327, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.0625 = fieldNorm(doc=3327)
         0.15678097 = weight(abstract_txt:tourist in 3327) [ClassicSimilarity], result of:
           0.15678097 = score(doc=3327,freq=1.0), product of:
             0.26962712 = queryWeight, product of:
               1.2622315 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.022960154 = queryNorm
             0.5814733 = fieldWeight in 3327, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=3327)
         0.38781866 = weight(abstract_txt:tourists in 3327) [ClassicSimilarity], result of:
           0.38781866 = score(doc=3327,freq=5.0), product of:
             0.28840125 = queryWeight, product of:
               1.3054366 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.022960154 = queryNorm
             1.344719 = fieldWeight in 3327, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=3327)
         0.047726344 = weight(abstract_txt:information in 3327) [ClassicSimilarity], result of:
           0.047726344 = score(doc=3327,freq=12.0), product of:
             0.091131754 = queryWeight, product of:
               1.640881 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.022960154 = queryNorm
             0.5237071 = fieldWeight in 3327, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3327)
       0.2 = coord(5/25)
   

3. Berri, J.; Benlamri, R.: Context-aware mobile search engine (2012) 0.15

   0.1541078 = sum of:
     0.1541078 = product of:
       0.64211583 = sum of:
         0.022709735 = weight(abstract_txt:with in 1104) [ClassicSimilarity], result of:
           0.022709735 = score(doc=1104,freq=4.0), product of:
             0.058226828 = queryWeight, product of:
               1.0159665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.022960154 = queryNorm
             0.39002183 = fieldWeight in 1104, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
         0.036410466 = weight(abstract_txt:user in 1104) [ClassicSimilarity], result of:
           0.036410466 = score(doc=1104,freq=1.0), product of:
             0.12661521 = queryWeight, product of:
               1.498169 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.022960154 = queryNorm
             0.28756785 = fieldWeight in 1104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
         0.038509034 = weight(abstract_txt:information in 1104) [ClassicSimilarity], result of:
           0.038509034 = score(doc=1104,freq=5.0), product of:
             0.091131754 = queryWeight, product of:
               1.640881 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.022960154 = queryNorm
             0.4225644 = fieldWeight in 1104, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
         0.14549749 = weight(abstract_txt:context in 1104) [ClassicSimilarity], result of:
           0.14549749 = score(doc=1104,freq=6.0), product of:
             0.17546412 = queryWeight, product of:
               1.7636484 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.022960154 = queryNorm
             0.82921505 = fieldWeight in 1104, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
         0.28928274 = weight(abstract_txt:mobile in 1104) [ClassicSimilarity], result of:
           0.28928274 = score(doc=1104,freq=3.0), product of:
             0.30536032 = queryWeight, product of:
               1.8996716 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.022960154 = queryNorm
             0.94734883 = fieldWeight in 1104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
         0.10970641 = weight(abstract_txt:applications in 1104) [ClassicSimilarity], result of:
           0.10970641 = score(doc=1104,freq=2.0), product of:
             0.2096427 = queryWeight, product of:
               1.9277811 = boost
               4.7363873 = idf(docFreq=1058, maxDocs=44421)
               0.022960154 = queryNorm
             0.52330184 = fieldWeight in 1104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7363873 = idf(docFreq=1058, maxDocs=44421)
               0.078125 = fieldNorm(doc=1104)
       0.24 = coord(6/25)
   

4. Becker, C.; Bizer, C.: DBpedia Mobile : a location-aware Semantic Web client 0.15

   0.15074447 = sum of:
     0.15074447 = product of:
       0.62810194 = sum of:
         0.012846565 = weight(abstract_txt:with in 3478) [ClassicSimilarity], result of:
           0.012846565 = score(doc=3478,freq=2.0), product of:
             0.058226828 = queryWeight, product of:
               1.0159665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.022960154 = queryNorm
             0.22062966 = fieldWeight in 3478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.15678097 = weight(abstract_txt:tourist in 3478) [ClassicSimilarity], result of:
           0.15678097 = score(doc=3478,freq=1.0), product of:
             0.26962712 = queryWeight, product of:
               1.2622315 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.022960154 = queryNorm
             0.5814733 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.02912837 = weight(abstract_txt:user in 3478) [ClassicSimilarity], result of:
           0.02912837 = score(doc=3478,freq=1.0), product of:
             0.12661521 = queryWeight, product of:
               1.498169 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.022960154 = queryNorm
             0.23005427 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.01377741 = weight(abstract_txt:information in 3478) [ClassicSimilarity], result of:
           0.01377741 = score(doc=3478,freq=1.0), product of:
             0.091131754 = queryWeight, product of:
               1.640881 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.022960154 = queryNorm
             0.15118122 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.35350937 = weight(abstract_txt:mobile in 3478) [ClassicSimilarity], result of:
           0.35350937 = score(doc=3478,freq=7.0), product of:
             0.30536032 = queryWeight, product of:
               1.8996716 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.022960154 = queryNorm
             1.1576794 = fieldWeight in 3478, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.062059313 = weight(abstract_txt:applications in 3478) [ClassicSimilarity], result of:
           0.062059313 = score(doc=3478,freq=1.0), product of:
             0.2096427 = queryWeight, product of:
               1.9277811 = boost
               4.7363873 = idf(docFreq=1058, maxDocs=44421)
               0.022960154 = queryNorm
             0.2960242 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7363873 = idf(docFreq=1058, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
       0.24 = coord(6/25)
   

5. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.15

   0.14666805 = sum of:
     0.14666805 = product of:
       0.52381444 = sum of:
         0.019667206 = weight(abstract_txt:with in 3021) [ClassicSimilarity], result of:
           0.019667206 = score(doc=3021,freq=3.0), product of:
             0.058226828 = queryWeight, product of:
               1.0159665 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.022960154 = queryNorm
             0.33776882 = fieldWeight in 3021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.10378481 = weight(abstract_txt:centred in 3021) [ClassicSimilarity], result of:
           0.10378481 = score(doc=3021,freq=1.0), product of:
             0.17648882 = queryWeight, product of:
               1.0212117 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.022960154 = queryNorm
             0.58805317 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.07504716 = weight(abstract_txt:studies in 3021) [ClassicSimilarity], result of:
           0.07504716 = score(doc=3021,freq=4.0), product of:
             0.112851545 = queryWeight, product of:
               1.1548511 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.022960154 = queryNorm
             0.6650078 = fieldWeight in 3021, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.06306477 = weight(abstract_txt:user in 3021) [ClassicSimilarity], result of:
           0.06306477 = score(doc=3021,freq=3.0), product of:
             0.12661521 = queryWeight, product of:
               1.498169 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.022960154 = queryNorm
             0.4980821 = fieldWeight in 3021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.017221762 = weight(abstract_txt:information in 3021) [ClassicSimilarity], result of:
           0.017221762 = score(doc=3021,freq=1.0), product of:
             0.091131754 = queryWeight, product of:
               1.640881 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.022960154 = queryNorm
             0.18897653 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.059399102 = weight(abstract_txt:context in 3021) [ClassicSimilarity], result of:
           0.059399102 = score(doc=3021,freq=1.0), product of:
             0.17546412 = queryWeight, product of:
               1.7636484 = boost
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.022960154 = queryNorm
             0.33852562 = fieldWeight in 3021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.333128 = idf(docFreq=1584, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
         0.18562965 = weight(abstract_txt:evaluation in 3021) [ClassicSimilarity], result of:
           0.18562965 = score(doc=3021,freq=8.0), product of:
             0.18752968 = queryWeight, product of:
               1.8232778 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.022960154 = queryNorm
             0.9898681 = fieldWeight in 3021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3021)
       0.28 = coord(7/25)