Document (#43772)

Author

Labib, A.
Chakhar, S.
Hope, L.
Shimell, J.
Malinowski, M.

Title

Analysis of noise and bias errors in intelligence information systems

Source

Journal of the Association for Information Science and Technology. 73(2022) no.12, S.1755-1775

Year

2022

Abstract

An intelligence information system (IIS) is a particular kind of information systems (IS) devoted to the analysis of intelligence relevant to national security. Professional and military intelligence analysts play a key role in this, but their judgments can be inconsistent, mainly due to noise and bias. The team-oriented aspects of the intelligence analysis process complicates the situation further. To enable analysts to achieve better judgments, the authors designed, implemented, and validated an innovative IIS for analyzing UK Military Signals Intelligence (SIGINT) data. The developed tool, the Team Information Decision Engine (TIDE), relies on an innovative preference learning method along with an aggregation procedure that permits combining scores by individual analysts into aggregated scores. This paper reports on a series of validation trials in which the performance of individual and team-oriented analysts was accessed with respect to their effectiveness and efficiency. Results show that the use of the developed tool enhanced the effectiveness and efficiency of intelligence analysis process at both individual and team levels.

Content

https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24707. Vgl.: https://doi.org/10.1002/asi.24707.

Similar documents (content)

1. Chau, M.; Shiu, B.; Chan, M.; Chen, H.: Redips: backlink search and analysis on the Web for business intelligence analysis (2007) 0.32

   0.31861636 = sum of:
     0.31861636 = product of:
       0.8850454 = sum of:
         0.015800223 = weight(abstract_txt:process in 142) [ClassicSimilarity], result of:
           0.015800223 = score(doc=142,freq=1.0), product of:
             0.062405046 = queryWeight, product of:
               1.10571 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.013932048 = queryNorm
             0.25318822 = fieldWeight in 142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.06553066 = weight(abstract_txt:signals in 142) [ClassicSimilarity], result of:
           0.06553066 = score(doc=142,freq=1.0), product of:
             0.12785879 = queryWeight, product of:
               1.119133 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.013932048 = queryNorm
             0.5125237 = fieldWeight in 142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.009538349 = weight(abstract_txt:information in 142) [ClassicSimilarity], result of:
           0.009538349 = score(doc=142,freq=2.0), product of:
             0.044575173 = queryWeight, product of:
               1.3215784 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.013932048 = queryNorm
             0.21398345 = fieldWeight in 142, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.04997853 = weight(abstract_txt:tool in 142) [ClassicSimilarity], result of:
           0.04997853 = score(doc=142,freq=3.0), product of:
             0.09323797 = queryWeight, product of:
               1.3515365 = boost
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.013932048 = queryNorm
             0.53603196 = fieldWeight in 142, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.03149698 = weight(abstract_txt:effectiveness in 142) [ClassicSimilarity], result of:
           0.03149698 = score(doc=142,freq=1.0), product of:
             0.09884548 = queryWeight, product of:
               1.3915852 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.013932048 = queryNorm
             0.31864864 = fieldWeight in 142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.053613175 = weight(abstract_txt:efficiency in 142) [ClassicSimilarity], result of:
           0.053613175 = score(doc=142,freq=1.0), product of:
             0.14091544 = queryWeight, product of:
               1.6615396 = boost
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.013932048 = queryNorm
             0.38046345 = fieldWeight in 142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.05678346 = weight(abstract_txt:analysis in 142) [ClassicSimilarity], result of:
           0.05678346 = score(doc=142,freq=6.0), product of:
             0.101520024 = queryWeight, product of:
               1.9944458 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.013932048 = queryNorm
             0.5593326 = fieldWeight in 142, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.26816392 = weight(abstract_txt:analysts in 142) [ClassicSimilarity], result of:
           0.26816392 = score(doc=142,freq=1.0), product of:
             0.5192635 = queryWeight, product of:
               4.510662 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.013932048 = queryNorm
             0.5164313 = fieldWeight in 142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
         0.3341401 = weight(abstract_txt:intelligence in 142) [ClassicSimilarity], result of:
           0.3341401 = score(doc=142,freq=4.0), product of:
             0.4564564 = queryWeight, product of:
               5.5945487 = boost
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.013932048 = queryNorm
             0.7320307 = fieldWeight in 142, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.0625 = fieldNorm(doc=142)
       0.36 = coord(9/25)
   

2. Marshall, B.; McDonald, D.; Chen, H.; Chung, W.: EBizPort: collecting and analyzing business intelligence information (2004) 0.16

   0.15609816 = sum of:
     0.15609816 = product of:
       0.48780674 = sum of:
         0.02234489 = weight(abstract_txt:process in 2505) [ClassicSimilarity], result of:
           0.02234489 = score(doc=2505,freq=2.0), product of:
             0.062405046 = queryWeight, product of:
               1.10571 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.013932048 = queryNorm
             0.3580622 = fieldWeight in 2505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.020233896 = weight(abstract_txt:information in 2505) [ClassicSimilarity], result of:
           0.020233896 = score(doc=2505,freq=9.0), product of:
             0.044575173 = queryWeight, product of:
               1.3215784 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.013932048 = queryNorm
             0.45392746 = fieldWeight in 2505, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.028855117 = weight(abstract_txt:tool in 2505) [ClassicSimilarity], result of:
           0.028855117 = score(doc=2505,freq=1.0), product of:
             0.09323797 = queryWeight, product of:
               1.3515365 = boost
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.013932048 = queryNorm
             0.3094782 = fieldWeight in 2505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.044543453 = weight(abstract_txt:effectiveness in 2505) [ClassicSimilarity], result of:
           0.044543453 = score(doc=2505,freq=2.0), product of:
             0.09884548 = queryWeight, product of:
               1.3915852 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.013932048 = queryNorm
             0.45063722 = fieldWeight in 2505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.053613175 = weight(abstract_txt:efficiency in 2505) [ClassicSimilarity], result of:
           0.053613175 = score(doc=2505,freq=1.0), product of:
             0.14091544 = queryWeight, product of:
               1.6615396 = boost
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.013932048 = queryNorm
             0.38046345 = fieldWeight in 2505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.087415 = idf(docFreq=272, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.05876175 = weight(abstract_txt:innovative in 2505) [ClassicSimilarity], result of:
           0.05876175 = score(doc=2505,freq=1.0), product of:
             0.14979847 = queryWeight, product of:
               1.7131094 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.013932048 = queryNorm
             0.39227203 = fieldWeight in 2505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.02318175 = weight(abstract_txt:analysis in 2505) [ClassicSimilarity], result of:
           0.02318175 = score(doc=2505,freq=1.0), product of:
             0.101520024 = queryWeight, product of:
               1.9944458 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.013932048 = queryNorm
             0.22834657 = fieldWeight in 2505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
         0.23627271 = weight(abstract_txt:intelligence in 2505) [ClassicSimilarity], result of:
           0.23627271 = score(doc=2505,freq=2.0), product of:
             0.4564564 = queryWeight, product of:
               5.5945487 = boost
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.013932048 = queryNorm
             0.51762384 = fieldWeight in 2505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.0625 = fieldNorm(doc=2505)
       0.32 = coord(8/25)
   

3. Chung, W.; Chen, H.; Reid, E.: Business stakeholder analyzer : an experiment of classifying stakeholders on the Web (2009) 0.14

   0.13871305 = sum of:
     0.13871305 = product of:
       0.69356525 = sum of:
         0.01755572 = weight(abstract_txt:developed in 2699) [ClassicSimilarity], result of:
           0.01755572 = score(doc=2699,freq=1.0), product of:
             0.0669458 = queryWeight, product of:
               1.1452309 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.013932048 = queryNorm
             0.26223782 = fieldWeight in 2699, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.0625 = fieldNorm(doc=2699)
         0.011682044 = weight(abstract_txt:information in 2699) [ClassicSimilarity], result of:
           0.011682044 = score(doc=2699,freq=3.0), product of:
             0.044575173 = queryWeight, product of:
               1.3215784 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.013932048 = queryNorm
             0.26207513 = fieldWeight in 2699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2699)
         0.032783944 = weight(abstract_txt:analysis in 2699) [ClassicSimilarity], result of:
           0.032783944 = score(doc=2699,freq=2.0), product of:
             0.101520024 = queryWeight, product of:
               1.9944458 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.013932048 = queryNorm
             0.3229308 = fieldWeight in 2699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=2699)
         0.46447352 = weight(abstract_txt:analysts in 2699) [ClassicSimilarity], result of:
           0.46447352 = score(doc=2699,freq=3.0), product of:
             0.5192635 = queryWeight, product of:
               4.510662 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.013932048 = queryNorm
             0.8944852 = fieldWeight in 2699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.0625 = fieldNorm(doc=2699)
         0.16707005 = weight(abstract_txt:intelligence in 2699) [ClassicSimilarity], result of:
           0.16707005 = score(doc=2699,freq=1.0), product of:
             0.4564564 = queryWeight, product of:
               5.5945487 = boost
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.013932048 = queryNorm
             0.36601534 = fieldWeight in 2699, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.0625 = fieldNorm(doc=2699)
       0.2 = coord(5/25)
   

4. He, D.; Brusilovsky, P.; Ahn, J.; Grady, J.; Farzan, R.; Peng, Y.; Yang, Y.; Rogati, M.: ¬An evaluation of adaptive filtering in the context of realistic task-based information exploration (2008) 0.13

   0.13342999 = sum of:
     0.13342999 = product of:
       0.8339374 = sum of:
         0.021328397 = weight(abstract_txt:information in 2048) [ClassicSimilarity], result of:
           0.021328397 = score(doc=2048,freq=10.0), product of:
             0.044575173 = queryWeight, product of:
               1.3215784 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.013932048 = queryNorm
             0.47848153 = fieldWeight in 2048, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2048)
         0.05876175 = weight(abstract_txt:innovative in 2048) [ClassicSimilarity], result of:
           0.05876175 = score(doc=2048,freq=1.0), product of:
             0.14979847 = queryWeight, product of:
               1.7131094 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.013932048 = queryNorm
             0.39227203 = fieldWeight in 2048, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.0625 = fieldNorm(doc=2048)
         0.46447352 = weight(abstract_txt:analysts in 2048) [ClassicSimilarity], result of:
           0.46447352 = score(doc=2048,freq=3.0), product of:
             0.5192635 = queryWeight, product of:
               4.510662 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.013932048 = queryNorm
             0.8944852 = fieldWeight in 2048, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.0625 = fieldNorm(doc=2048)
         0.2893738 = weight(abstract_txt:intelligence in 2048) [ClassicSimilarity], result of:
           0.2893738 = score(doc=2048,freq=3.0), product of:
             0.4564564 = queryWeight, product of:
               5.5945487 = boost
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.013932048 = queryNorm
             0.63395715 = fieldWeight in 2048, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8562455 = idf(docFreq=343, maxDocs=44218)
               0.0625 = fieldNorm(doc=2048)
       0.16 = coord(4/25)
   

5. Bartlett, J.C.; Toms, E.G.: Developing a protocol for bioinformatics analysis : an integrated information behavior and task analysis approach (2005) 0.11

   0.105516255 = sum of:
     0.105516255 = product of:
       0.43965107 = sum of:
         0.035330374 = weight(abstract_txt:process in 5256) [ClassicSimilarity], result of:
           0.035330374 = score(doc=5256,freq=5.0), product of:
             0.062405046 = queryWeight, product of:
               1.10571 = boost
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.013932048 = queryNorm
             0.5661461 = fieldWeight in 5256, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.0510116 = idf(docFreq=2091, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
         0.01755572 = weight(abstract_txt:developed in 5256) [ClassicSimilarity], result of:
           0.01755572 = score(doc=5256,freq=1.0), product of:
             0.0669458 = queryWeight, product of:
               1.1452309 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.013932048 = queryNorm
             0.26223782 = fieldWeight in 5256, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
         0.011682044 = weight(abstract_txt:information in 5256) [ClassicSimilarity], result of:
           0.011682044 = score(doc=5256,freq=3.0), product of:
             0.044575173 = queryWeight, product of:
               1.3215784 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.013932048 = queryNorm
             0.26207513 = fieldWeight in 5256, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
         0.06556789 = weight(abstract_txt:analysis in 5256) [ClassicSimilarity], result of:
           0.06556789 = score(doc=5256,freq=8.0), product of:
             0.101520024 = queryWeight, product of:
               1.9944458 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.013932048 = queryNorm
             0.6458616 = fieldWeight in 5256, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
         0.04135116 = weight(abstract_txt:individual in 5256) [ClassicSimilarity], result of:
           0.04135116 = score(doc=5256,freq=1.0), product of:
             0.13566457 = queryWeight, product of:
               1.9966881 = boost
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.013932048 = queryNorm
             0.3048044 = fieldWeight in 5256, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
         0.26816392 = weight(abstract_txt:analysts in 5256) [ClassicSimilarity], result of:
           0.26816392 = score(doc=5256,freq=1.0), product of:
             0.5192635 = queryWeight, product of:
               4.510662 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.013932048 = queryNorm
             0.5164313 = fieldWeight in 5256, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.0625 = fieldNorm(doc=5256)
       0.24 = coord(6/25)