Document (#18279)

Author

Narasimhamurthi, N.

Title

¬A primer on information theory

Source

Information studies. 2(1996) no.3, S.187-202

Year

1996

Abstract

Presents, at an elementary level, the central ideas of information theory in terms of naive probability theory. Information theory rests on the 2 pillars of quantifying uncertainty and coding and deals with how best to code information so that its uncertainty can be reduced most efficiently. Develops the quantification of uncertainty in 2 steps: first, the special case when all possible outcomes have the same probability; and second, the general case when all possibilities need not be equally probable. Examines 2 forms of coding: proactive and reactive. Coding is essentially an artificial classification or indexing of data and this aspect of information theory is of interest to anyone classifying, storing, and disseminating information

Theme

Information

Similar documents (content)

1. Klir, G.I.; Wierman, M.J.: Uncertainty-based information : Elements of generalized information theory (1998) 0.14

   0.14482568 = sum of:
     0.14482568 = product of:
       0.9051605 = sum of:
         0.21259539 = weight(abstract_txt:probability in 969) [ClassicSimilarity], result of:
           0.21259539 = score(doc=969,freq=1.0), product of:
             0.24716133 = queryWeight, product of:
               2.0710177 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.017343367 = queryNorm
             0.86014825 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.125 = fieldNorm(doc=969)
         0.027703758 = weight(abstract_txt:information in 969) [ClassicSimilarity], result of:
           0.027703758 = score(doc=969,freq=1.0), product of:
             0.091624334 = queryWeight, product of:
               2.184035 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017343367 = queryNorm
             0.30236244 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.125 = fieldNorm(doc=969)
         0.32583827 = weight(abstract_txt:uncertainty in 969) [ClassicSimilarity], result of:
           0.32583827 = score(doc=969,freq=1.0), product of:
             0.37610558 = queryWeight, product of:
               3.1289172 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017343367 = queryNorm
             0.86634785 = fieldWeight in 969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.125 = fieldNorm(doc=969)
         0.33902305 = weight(abstract_txt:theory in 969) [ClassicSimilarity], result of:
           0.33902305 = score(doc=969,freq=5.0), product of:
             0.2677652 = queryWeight, product of:
               3.408322 = boost
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.017343367 = queryNorm
             1.2661207 = fieldWeight in 969, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.125 = fieldNorm(doc=969)
       0.16 = coord(4/25)
   

2. Leydesdorff, L.; Ivanova, I.A.: Mutual redundancies in interhuman communication systems : steps toward a calculus of processing meaning (2014) 0.12

   0.12288344 = sum of:
     0.12288344 = product of:
       0.5120143 = sum of:
         0.02034496 = weight(abstract_txt:when in 2211) [ClassicSimilarity], result of:
           0.02034496 = score(doc=2211,freq=1.0), product of:
             0.08972851 = queryWeight, product of:
               1.2478397 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.017343367 = queryNorm
             0.22673906 = fieldWeight in 2211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
         0.054499242 = weight(abstract_txt:case in 2211) [ClassicSimilarity], result of:
           0.054499242 = score(doc=2211,freq=3.0), product of:
             0.11999942 = queryWeight, product of:
               1.4430559 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.017343367 = queryNorm
             0.45416254 = fieldWeight in 2211, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
         0.029688781 = weight(abstract_txt:information in 2211) [ClassicSimilarity], result of:
           0.029688781 = score(doc=2211,freq=6.0), product of:
             0.091624334 = queryWeight, product of:
               2.184035 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017343367 = queryNorm
             0.32402724 = fieldWeight in 2211, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
         0.13226338 = weight(abstract_txt:coding in 2211) [ClassicSimilarity], result of:
           0.13226338 = score(doc=2211,freq=1.0), product of:
             0.35778004 = queryWeight, product of:
               3.051738 = boost
               6.759825 = idf(docFreq=139, maxDocs=44421)
               0.017343367 = queryNorm
             0.36967793 = fieldWeight in 2211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.759825 = idf(docFreq=139, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
         0.14255424 = weight(abstract_txt:uncertainty in 2211) [ClassicSimilarity], result of:
           0.14255424 = score(doc=2211,freq=1.0), product of:
             0.37610558 = queryWeight, product of:
               3.1289172 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017343367 = queryNorm
             0.3790272 = fieldWeight in 2211, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
         0.13266374 = weight(abstract_txt:theory in 2211) [ClassicSimilarity], result of:
           0.13266374 = score(doc=2211,freq=4.0), product of:
             0.2677652 = queryWeight, product of:
               3.408322 = boost
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.017343367 = queryNorm
             0.49544805 = fieldWeight in 2211, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2211)
       0.24 = coord(6/25)
   

3. Fry, J.: Scholarly research and information practices : a domain analytic approach (2006) 0.11

   0.10624881 = sum of:
     0.10624881 = product of:
       0.53124404 = sum of:
         0.047866575 = weight(abstract_txt:deals in 1969) [ClassicSimilarity], result of:
           0.047866575 = score(doc=1969,freq=1.0), product of:
             0.11525051 = queryWeight, product of:
               6.6452217 = idf(docFreq=156, maxDocs=44421)
               0.017343367 = queryNorm
             0.41532636 = fieldWeight in 1969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6452217 = idf(docFreq=156, maxDocs=44421)
               0.0625 = fieldNorm(doc=1969)
         0.035960175 = weight(abstract_txt:case in 1969) [ClassicSimilarity], result of:
           0.035960175 = score(doc=1969,freq=1.0), product of:
             0.11999942 = queryWeight, product of:
               1.4430559 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.017343367 = queryNorm
             0.29966956 = fieldWeight in 1969, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=1969)
         0.033930037 = weight(abstract_txt:information in 1969) [ClassicSimilarity], result of:
           0.033930037 = score(doc=1969,freq=6.0), product of:
             0.091624334 = queryWeight, product of:
               2.184035 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017343367 = queryNorm
             0.37031686 = fieldWeight in 1969, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1969)
         0.2821842 = weight(abstract_txt:uncertainty in 1969) [ClassicSimilarity], result of:
           0.2821842 = score(doc=1969,freq=3.0), product of:
             0.37610558 = queryWeight, product of:
               3.1289172 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017343367 = queryNorm
             0.75027925 = fieldWeight in 1969, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=1969)
         0.13130306 = weight(abstract_txt:theory in 1969) [ClassicSimilarity], result of:
           0.13130306 = score(doc=1969,freq=3.0), product of:
             0.2677652 = queryWeight, product of:
               3.408322 = boost
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.017343367 = queryNorm
             0.4903664 = fieldWeight in 1969, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.0625 = fieldNorm(doc=1969)
       0.2 = coord(5/25)
   

4. Brashers, D.E.; Hogan, T.P.: ¬The appraisal and management of uncertainty : implications for information-retrieval systems (2013) 0.10

   0.0996332 = sum of:
     0.0996332 = product of:
       0.62270755 = sum of:
         0.055121064 = weight(abstract_txt:reduced in 3708) [ClassicSimilarity], result of:
           0.055121064 = score(doc=3708,freq=1.0), product of:
             0.12661923 = queryWeight, product of:
               1.048162 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.017343367 = queryNorm
             0.43532932 = fieldWeight in 3708, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.0625 = fieldNorm(doc=3708)
         0.030973744 = weight(abstract_txt:information in 3708) [ClassicSimilarity], result of:
           0.030973744 = score(doc=3708,freq=5.0), product of:
             0.091624334 = queryWeight, product of:
               2.184035 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017343367 = queryNorm
             0.3380515 = fieldWeight in 3708, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3708)
         0.46080488 = weight(abstract_txt:uncertainty in 3708) [ClassicSimilarity], result of:
           0.46080488 = score(doc=3708,freq=8.0), product of:
             0.37610558 = queryWeight, product of:
               3.1289172 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017343367 = queryNorm
             1.2252009 = fieldWeight in 3708, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=3708)
         0.075807855 = weight(abstract_txt:theory in 3708) [ClassicSimilarity], result of:
           0.075807855 = score(doc=3708,freq=1.0), product of:
             0.2677652 = queryWeight, product of:
               3.408322 = boost
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.017343367 = queryNorm
             0.28311318 = fieldWeight in 3708, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.0625 = fieldNorm(doc=3708)
       0.16 = coord(4/25)
   

5. Ingwersen, P.; Wormell, I.: Ranganathan in the perspective of advanced information retrieval (1992) 0.09

   0.0923325 = sum of:
     0.0923325 = product of:
       0.5770781 = sum of:
         0.07192035 = weight(abstract_txt:case in 764) [ClassicSimilarity], result of:
           0.07192035 = score(doc=764,freq=1.0), product of:
             0.11999942 = queryWeight, product of:
               1.4430559 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.017343367 = queryNorm
             0.5993391 = fieldWeight in 764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.125 = fieldNorm(doc=764)
         0.027703758 = weight(abstract_txt:information in 764) [ClassicSimilarity], result of:
           0.027703758 = score(doc=764,freq=1.0), product of:
             0.091624334 = queryWeight, product of:
               2.184035 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.017343367 = queryNorm
             0.30236244 = fieldWeight in 764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.125 = fieldNorm(doc=764)
         0.32583827 = weight(abstract_txt:uncertainty in 764) [ClassicSimilarity], result of:
           0.32583827 = score(doc=764,freq=1.0), product of:
             0.37610558 = queryWeight, product of:
               3.1289172 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017343367 = queryNorm
             0.86634785 = fieldWeight in 764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.125 = fieldNorm(doc=764)
         0.15161571 = weight(abstract_txt:theory in 764) [ClassicSimilarity], result of:
           0.15161571 = score(doc=764,freq=1.0), product of:
             0.2677652 = queryWeight, product of:
               3.408322 = boost
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.017343367 = queryNorm
             0.56622636 = fieldWeight in 764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.529811 = idf(docFreq=1301, maxDocs=44421)
               0.125 = fieldNorm(doc=764)
       0.16 = coord(4/25)