Document (#38137)

Author

Shani, G.
Rokach, L.
Shapira, B.
Hadash, S.
Tangi, M.

Title

Investigating confidence displays for top-N recommendations

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.12, S.2548-2563

Year

2013

Abstract

Recommendation systems often compute fixed-length lists of recommended items to users. Forcing the system to predict a fixed-length list for each user may result in different confidence levels for the computed recommendations. Reporting the system's confidence in its predictions (the recommendation strength) can provide valuable information to users in making their decisions. In this article, we investigate several different displays of a system's confidence to users and conclude that some displays are easier to understand and are favored by most users. We continue to investigate the effect confidence has on users in terms of their perception of the recommendation quality and the user experience with the system. Our studies show that it is not easier for users to identify relevant items when confidence is displayed. Still, users appreciate the displays and trust them when the relevance of items is difficult to establish.

Similar documents (author)

1. Shapira, B.: Hypertext browsing : a new model for information filtering based on user profiles and data clustering (1996) 1.85

   1.84902 = sum of:
     1.84902 = product of:
       3.69804 = sum of:
         3.69804 = weight(author_txt:shapira in 4779) [ClassicSimilarity], result of:
           3.69804 = score(doc=4779,freq=1.0), product of:
             0.6579105 = queryWeight, product of:
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.07315467 = queryNorm
             5.620886 = fieldWeight in 4779, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.625 = fieldNorm(doc=4779)
       0.5 = coord(1/2)
   

2. Rokach, L.; Mitra, P.: Parsimonious citer-based measures : the artificial intelligence domain as a case study (2013) 1.81

   1.8115777 = sum of:
     1.8115777 = product of:
       3.6231554 = sum of:
         3.6231554 = weight(author_txt:rokach in 1212) [ClassicSimilarity], result of:
           3.6231554 = score(doc=1212,freq=1.0), product of:
             0.7530961 = queryWeight, product of:
               1.0698966 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07315467 = queryNorm
             4.811013 = fieldWeight in 1212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.5 = fieldNorm(doc=1212)
       0.5 = coord(1/2)
   

3. Ofek, N.; Rokach, L.: ¬A classifier to determine which Wikipedia biographies will be accepted (2015) 1.81

   1.8115777 = sum of:
     1.8115777 = product of:
       3.6231554 = sum of:
         3.6231554 = weight(author_txt:rokach in 2610) [ClassicSimilarity], result of:
           3.6231554 = score(doc=2610,freq=1.0), product of:
             0.7530961 = queryWeight, product of:
               1.0698966 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07315467 = queryNorm
             4.811013 = fieldWeight in 2610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.5 = fieldNorm(doc=2610)
       0.5 = coord(1/2)
   

4. Shapira, B.; Zabar, B.: Personalized search : integrating collaboration and social networks (2011) 1.48

   1.4792161 = sum of:
     1.4792161 = product of:
       2.9584322 = sum of:
         2.9584322 = weight(author_txt:shapira in 140) [ClassicSimilarity], result of:
           2.9584322 = score(doc=140,freq=1.0), product of:
             0.6579105 = queryWeight, product of:
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.07315467 = queryNorm
             4.496709 = fieldWeight in 140, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.5 = fieldNorm(doc=140)
       0.5 = coord(1/2)
   

5. Blank, I.; Rokach, L.; Shani, G.: Leveraging metadata to recommend keywords for academic papers (2016) 1.36

   1.3586832 = sum of:
     1.3586832 = product of:
       2.7173665 = sum of:
         2.7173665 = weight(author_txt:rokach in 4232) [ClassicSimilarity], result of:
           2.7173665 = score(doc=4232,freq=1.0), product of:
             0.7530961 = queryWeight, product of:
               1.0698966 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.07315467 = queryNorm
             3.60826 = fieldWeight in 4232, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.375 = fieldNorm(doc=4232)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Bessa, A.; Santos, R.L.T.; Veloso, A.; Ziviani, N.: Exploiting item co-utility to improve collaborative filtering recommendations (2017) 0.12

   0.11719327 = sum of:
     0.11719327 = product of:
       0.4883053 = sum of:
         0.02071024 = weight(abstract_txt:different in 4824) [ClassicSimilarity], result of:
           0.02071024 = score(doc=4824,freq=3.0), product of:
             0.05227513 = queryWeight, product of:
               1.0816422 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.013205721 = queryNorm
             0.39617768 = fieldWeight in 4824, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
         0.012165423 = weight(abstract_txt:user in 4824) [ClassicSimilarity], result of:
           0.012165423 = score(doc=4824,freq=1.0), product of:
             0.052880663 = queryWeight, product of:
               1.0878888 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.013205721 = queryNorm
             0.23005427 = fieldWeight in 4824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
         0.09241289 = weight(abstract_txt:recommendations in 4824) [ClassicSimilarity], result of:
           0.09241289 = score(doc=4824,freq=4.0), product of:
             0.12873021 = queryWeight, product of:
               1.6973691 = boost
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.013205721 = queryNorm
             0.71788037 = fieldWeight in 4824, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
         0.1270752 = weight(abstract_txt:items in 4824) [ClassicSimilarity], result of:
           0.1270752 = score(doc=4824,freq=4.0), product of:
             0.18222013 = queryWeight, product of:
               2.4733174 = boost
               5.5789747 = idf(docFreq=455, maxDocs=44421)
               0.013205721 = queryNorm
             0.69737184 = fieldWeight in 4824, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5789747 = idf(docFreq=455, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
         0.18112952 = weight(abstract_txt:recommendation in 4824) [ClassicSimilarity], result of:
           0.18112952 = score(doc=4824,freq=2.0), product of:
             0.29077607 = queryWeight, product of:
               3.1243596 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.013205721 = queryNorm
             0.62291753 = fieldWeight in 4824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
         0.054812033 = weight(abstract_txt:users in 4824) [ClassicSimilarity], result of:
           0.054812033 = score(doc=4824,freq=2.0), product of:
             0.17383693 = queryWeight, product of:
               3.6901252 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.013205721 = queryNorm
             0.31530717 = fieldWeight in 4824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=4824)
       0.24 = coord(6/25)
   

2. Bartolo, L.M.; Smith, T.D.: Interdisciplinary work and the information search process : a comparison of manual and online searching (1993) 0.11

   0.1105786 = sum of:
     0.1105786 = product of:
       0.552893 = sum of:
         0.026338913 = weight(abstract_txt:user in 5248) [ClassicSimilarity], result of:
           0.026338913 = score(doc=5248,freq=3.0), product of:
             0.052880663 = queryWeight, product of:
               1.0878888 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.013205721 = queryNorm
             0.4980821 = fieldWeight in 5248, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=5248)
         0.021732077 = weight(abstract_txt:when in 5248) [ClassicSimilarity], result of:
           0.021732077 = score(doc=5248,freq=1.0), product of:
             0.06709234 = queryWeight, product of:
               1.2253848 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.013205721 = queryNorm
             0.32391295 = fieldWeight in 5248, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.078125 = fieldNorm(doc=5248)
         0.079422 = weight(abstract_txt:items in 5248) [ClassicSimilarity], result of:
           0.079422 = score(doc=5248,freq=1.0), product of:
             0.18222013 = queryWeight, product of:
               2.4733174 = boost
               5.5789747 = idf(docFreq=455, maxDocs=44421)
               0.013205721 = queryNorm
             0.43585742 = fieldWeight in 5248, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5789747 = idf(docFreq=455, maxDocs=44421)
               0.078125 = fieldNorm(doc=5248)
         0.06851504 = weight(abstract_txt:users in 5248) [ClassicSimilarity], result of:
           0.06851504 = score(doc=5248,freq=2.0), product of:
             0.17383693 = queryWeight, product of:
               3.6901252 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.013205721 = queryNorm
             0.39413396 = fieldWeight in 5248, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=5248)
         0.35688496 = weight(abstract_txt:confidence in 5248) [ClassicSimilarity], result of:
           0.35688496 = score(doc=5248,freq=1.0), product of:
             0.6251698 = queryWeight, product of:
               6.4788165 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.013205721 = queryNorm
             0.5708608 = fieldWeight in 5248, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.078125 = fieldNorm(doc=5248)
       0.2 = coord(5/25)
   

3. Duncan, E.B.: Structuring knowledge bases for designers of learning materials (1989) 0.11

   0.10846624 = sum of:
     0.10846624 = product of:
       0.45194268 = sum of:
         0.016909841 = weight(abstract_txt:different in 3478) [ClassicSimilarity], result of:
           0.016909841 = score(doc=3478,freq=2.0), product of:
             0.05227513 = queryWeight, product of:
               1.0816422 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.013205721 = queryNorm
             0.32347775 = fieldWeight in 3478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.017385662 = weight(abstract_txt:when in 3478) [ClassicSimilarity], result of:
           0.017385662 = score(doc=3478,freq=1.0), product of:
             0.06709234 = queryWeight, product of:
               1.2253848 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.013205721 = queryNorm
             0.25913036 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.069042 = weight(abstract_txt:easier in 3478) [ClassicSimilarity], result of:
           0.069042 = score(doc=3478,freq=1.0), product of:
             0.16824971 = queryWeight, product of:
               1.9404981 = boost
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.013205721 = queryNorm
             0.41035432 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.09111162 = weight(abstract_txt:fixed in 3478) [ClassicSimilarity], result of:
           0.09111162 = score(doc=3478,freq=1.0), product of:
             0.20242366 = queryWeight, product of:
               2.128466 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.013205721 = queryNorm
             0.4501036 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.038757958 = weight(abstract_txt:users in 3478) [ClassicSimilarity], result of:
           0.038757958 = score(doc=3478,freq=1.0), product of:
             0.17383693 = queryWeight, product of:
               3.6901252 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.013205721 = queryNorm
             0.22295584 = fieldWeight in 3478, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
         0.21873562 = weight(abstract_txt:displays in 3478) [ClassicSimilarity], result of:
           0.21873562 = score(doc=3478,freq=2.0), product of:
             0.36293188 = queryWeight, product of:
               4.0305433 = boost
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.013205721 = queryNorm
             0.6026906 = fieldWeight in 3478, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.0625 = fieldNorm(doc=3478)
       0.24 = coord(6/25)
   

4. Duncan, E.B.: ¬A faceted approach to hypertext (1989) 0.11

   0.10846624 = sum of:
     0.10846624 = product of:
       0.45194268 = sum of:
         0.016909841 = weight(abstract_txt:different in 3480) [ClassicSimilarity], result of:
           0.016909841 = score(doc=3480,freq=2.0), product of:
             0.05227513 = queryWeight, product of:
               1.0816422 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.013205721 = queryNorm
             0.32347775 = fieldWeight in 3480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
         0.017385662 = weight(abstract_txt:when in 3480) [ClassicSimilarity], result of:
           0.017385662 = score(doc=3480,freq=1.0), product of:
             0.06709234 = queryWeight, product of:
               1.2253848 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.013205721 = queryNorm
             0.25913036 = fieldWeight in 3480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
         0.069042 = weight(abstract_txt:easier in 3480) [ClassicSimilarity], result of:
           0.069042 = score(doc=3480,freq=1.0), product of:
             0.16824971 = queryWeight, product of:
               1.9404981 = boost
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.013205721 = queryNorm
             0.41035432 = fieldWeight in 3480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
         0.09111162 = weight(abstract_txt:fixed in 3480) [ClassicSimilarity], result of:
           0.09111162 = score(doc=3480,freq=1.0), product of:
             0.20242366 = queryWeight, product of:
               2.128466 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.013205721 = queryNorm
             0.4501036 = fieldWeight in 3480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
         0.038757958 = weight(abstract_txt:users in 3480) [ClassicSimilarity], result of:
           0.038757958 = score(doc=3480,freq=1.0), product of:
             0.17383693 = queryWeight, product of:
               3.6901252 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.013205721 = queryNorm
             0.22295584 = fieldWeight in 3480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
         0.21873562 = weight(abstract_txt:displays in 3480) [ClassicSimilarity], result of:
           0.21873562 = score(doc=3480,freq=2.0), product of:
             0.36293188 = queryWeight, product of:
               4.0305433 = boost
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.013205721 = queryNorm
             0.6026906 = fieldWeight in 3480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.0625 = fieldNorm(doc=3480)
       0.24 = coord(6/25)
   

5. Duncan, E.B.: ¬A concept-map thesaurus as a knowledge-based hypertext interface to a bibliographic database (1990) 0.11

   0.10846624 = sum of:
     0.10846624 = product of:
       0.45194268 = sum of:
         0.016909841 = weight(abstract_txt:different in 3481) [ClassicSimilarity], result of:
           0.016909841 = score(doc=3481,freq=2.0), product of:
             0.05227513 = queryWeight, product of:
               1.0816422 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.013205721 = queryNorm
             0.32347775 = fieldWeight in 3481, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
         0.017385662 = weight(abstract_txt:when in 3481) [ClassicSimilarity], result of:
           0.017385662 = score(doc=3481,freq=1.0), product of:
             0.06709234 = queryWeight, product of:
               1.2253848 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.013205721 = queryNorm
             0.25913036 = fieldWeight in 3481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
         0.069042 = weight(abstract_txt:easier in 3481) [ClassicSimilarity], result of:
           0.069042 = score(doc=3481,freq=1.0), product of:
             0.16824971 = queryWeight, product of:
               1.9404981 = boost
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.013205721 = queryNorm
             0.41035432 = fieldWeight in 3481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.565669 = idf(docFreq=169, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
         0.09111162 = weight(abstract_txt:fixed in 3481) [ClassicSimilarity], result of:
           0.09111162 = score(doc=3481,freq=1.0), product of:
             0.20242366 = queryWeight, product of:
               2.128466 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.013205721 = queryNorm
             0.4501036 = fieldWeight in 3481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
         0.038757958 = weight(abstract_txt:users in 3481) [ClassicSimilarity], result of:
           0.038757958 = score(doc=3481,freq=1.0), product of:
             0.17383693 = queryWeight, product of:
               3.6901252 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.013205721 = queryNorm
             0.22295584 = fieldWeight in 3481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
         0.21873562 = weight(abstract_txt:displays in 3481) [ClassicSimilarity], result of:
           0.21873562 = score(doc=3481,freq=2.0), product of:
             0.36293188 = queryWeight, product of:
               4.0305433 = boost
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.013205721 = queryNorm
             0.6026906 = fieldWeight in 3481, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.0625 = fieldNorm(doc=3481)
       0.24 = coord(6/25)