Document (#43772)

Author

Labib, A.
Chakhar, S.
Hope, L.
Shimell, J.
Malinowski, M.

Title

Analysis of noise and bias errors in intelligence information systems

Source

Journal of the Association for Information Science and Technology. 73(2022) no.12, S.1755-1775

Year

2022

Abstract

An intelligence information system (IIS) is a particular kind of information systems (IS) devoted to the analysis of intelligence relevant to national security. Professional and military intelligence analysts play a key role in this, but their judgments can be inconsistent, mainly due to noise and bias. The team-oriented aspects of the intelligence analysis process complicates the situation further. To enable analysts to achieve better judgments, the authors designed, implemented, and validated an innovative IIS for analyzing UK Military Signals Intelligence (SIGINT) data. The developed tool, the Team Information Decision Engine (TIDE), relies on an innovative preference learning method along with an aggregation procedure that permits combining scores by individual analysts into aggregated scores. This paper reports on a series of validation trials in which the performance of individual and team-oriented analysts was accessed with respect to their effectiveness and efficiency. Results show that the use of the developed tool enhanced the effectiveness and efficiency of intelligence analysis process at both individual and team levels.

Content

https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24707. Vgl.: https://doi.org/10.1002/asi.24707.

Similar documents (content)

1. Chau, M.; Shiu, B.; Chan, M.; Chen, H.: Redips: backlink search and analysis on the Web for business intelligence analysis (2007) 0.32

   0.31763342 = sum of:
     0.31763342 = product of:
       0.88231504 = sum of:
         0.01581574 = weight(abstract_txt:process in 1142) [ClassicSimilarity], result of:
           0.01581574 = score(doc=1142,freq=1.0), product of:
             0.062498573 = queryWeight, product of:
               1.1100923 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0139050195 = queryNorm
             0.25305763 = fieldWeight in 1142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.0650911 = weight(abstract_txt:signals in 1142) [ClassicSimilarity], result of:
           0.0650911 = score(doc=1142,freq=1.0), product of:
             0.12739377 = queryWeight, product of:
               1.1206839 = boost
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.0139050195 = queryNorm
             0.5109442 = fieldWeight in 1142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.009538273 = weight(abstract_txt:information in 1142) [ClassicSimilarity], result of:
           0.009538273 = score(doc=1142,freq=2.0), product of:
             0.044612538 = queryWeight, product of:
               1.3263786 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0139050195 = queryNorm
             0.21380253 = fieldWeight in 1142, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.050030656 = weight(abstract_txt:tool in 1142) [ClassicSimilarity], result of:
           0.050030656 = score(doc=1142,freq=3.0), product of:
             0.093381494 = queryWeight, product of:
               1.3569206 = boost
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0139050195 = queryNorm
             0.5357663 = fieldWeight in 1142, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.03153573 = weight(abstract_txt:effectiveness in 1142) [ClassicSimilarity], result of:
           0.03153573 = score(doc=1142,freq=1.0), product of:
             0.09900999 = queryWeight, product of:
               1.397216 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0139050195 = queryNorm
             0.3185106 = fieldWeight in 1142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.053580966 = weight(abstract_txt:efficiency in 1142) [ClassicSimilarity], result of:
           0.053580966 = score(doc=1142,freq=1.0), product of:
             0.14097781 = queryWeight, product of:
               1.667245 = boost
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.0139050195 = queryNorm
             0.38006666 = fieldWeight in 1142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.05656019 = weight(abstract_txt:analysis in 1142) [ClassicSimilarity], result of:
           0.05656019 = score(doc=1142,freq=6.0), product of:
             0.10133914 = queryWeight, product of:
               1.9990684 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0139050195 = queryNorm
             0.55812776 = fieldWeight in 1142, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.2692904 = weight(abstract_txt:analysts in 1142) [ClassicSimilarity], result of:
           0.2692904 = score(doc=1142,freq=1.0), product of:
             0.5211559 = queryWeight, product of:
               4.5333877 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0139050195 = queryNorm
             0.51671755 = fieldWeight in 1142, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
         0.33087197 = weight(abstract_txt:intelligence in 1142) [ClassicSimilarity], result of:
           0.33087197 = score(doc=1142,freq=4.0), product of:
             0.45385775 = queryWeight, product of:
               5.5965185 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0139050195 = queryNorm
             0.7290213 = fieldWeight in 1142, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0625 = fieldNorm(doc=1142)
       0.36 = coord(9/25)
   

2. Marshall, B.; McDonald, D.; Chen, H.; Chung, W.: EBizPort: collecting and analyzing business intelligence information (2004) 0.16

   0.15528437 = sum of:
     0.15528437 = product of:
       0.4852637 = sum of:
         0.022366835 = weight(abstract_txt:process in 3505) [ClassicSimilarity], result of:
           0.022366835 = score(doc=3505,freq=2.0), product of:
             0.062498573 = queryWeight, product of:
               1.1100923 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0139050195 = queryNorm
             0.35787752 = fieldWeight in 3505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.020233734 = weight(abstract_txt:information in 3505) [ClassicSimilarity], result of:
           0.020233734 = score(doc=3505,freq=9.0), product of:
             0.044612538 = queryWeight, product of:
               1.3263786 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0139050195 = queryNorm
             0.45354366 = fieldWeight in 3505, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.028885216 = weight(abstract_txt:tool in 3505) [ClassicSimilarity], result of:
           0.028885216 = score(doc=3505,freq=1.0), product of:
             0.093381494 = queryWeight, product of:
               1.3569206 = boost
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0139050195 = queryNorm
             0.30932483 = fieldWeight in 3505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.044598255 = weight(abstract_txt:effectiveness in 3505) [ClassicSimilarity], result of:
           0.044598255 = score(doc=3505,freq=2.0), product of:
             0.09900999 = queryWeight, product of:
               1.397216 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0139050195 = queryNorm
             0.450442 = fieldWeight in 3505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.053580966 = weight(abstract_txt:efficiency in 3505) [ClassicSimilarity], result of:
           0.053580966 = score(doc=3505,freq=1.0), product of:
             0.14097781 = queryWeight, product of:
               1.667245 = boost
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.0139050195 = queryNorm
             0.38006666 = fieldWeight in 3505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.058546275 = weight(abstract_txt:innovative in 3505) [ClassicSimilarity], result of:
           0.058546275 = score(doc=3505,freq=1.0), product of:
             0.1495581 = queryWeight, product of:
               1.7172321 = boost
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0139050195 = queryNorm
             0.39146176 = fieldWeight in 3505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.0230906 = weight(abstract_txt:analysis in 3505) [ClassicSimilarity], result of:
           0.0230906 = score(doc=3505,freq=1.0), product of:
             0.10133914 = queryWeight, product of:
               1.9990684 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0139050195 = queryNorm
             0.2278547 = fieldWeight in 3505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
         0.2339618 = weight(abstract_txt:intelligence in 3505) [ClassicSimilarity], result of:
           0.2339618 = score(doc=3505,freq=2.0), product of:
             0.45385775 = queryWeight, product of:
               5.5965185 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0139050195 = queryNorm
             0.5154959 = fieldWeight in 3505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0625 = fieldNorm(doc=3505)
       0.32 = coord(8/25)
   

3. Chung, W.; Chen, H.; Reid, E.: Business stakeholder analyzer : an experiment of classifying stakeholders on the Web (2009) 0.14

   0.13875999 = sum of:
     0.13875999 = product of:
       0.6937999 = sum of:
         0.017602328 = weight(abstract_txt:developed in 3699) [ClassicSimilarity], result of:
           0.017602328 = score(doc=3699,freq=1.0), product of:
             0.067120805 = queryWeight, product of:
               1.1504099 = boost
               4.1959753 = idf(docFreq=1817, maxDocs=44421)
               0.0139050195 = queryNorm
             0.26224846 = fieldWeight in 3699, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1959753 = idf(docFreq=1817, maxDocs=44421)
               0.0625 = fieldNorm(doc=3699)
         0.011681952 = weight(abstract_txt:information in 3699) [ClassicSimilarity], result of:
           0.011681952 = score(doc=3699,freq=3.0), product of:
             0.044612538 = queryWeight, product of:
               1.3263786 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0139050195 = queryNorm
             0.26185355 = fieldWeight in 3699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3699)
         0.032655038 = weight(abstract_txt:analysis in 3699) [ClassicSimilarity], result of:
           0.032655038 = score(doc=3699,freq=2.0), product of:
             0.10133914 = queryWeight, product of:
               1.9990684 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0139050195 = queryNorm
             0.3222352 = fieldWeight in 3699, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=3699)
         0.46642464 = weight(abstract_txt:analysts in 3699) [ClassicSimilarity], result of:
           0.46642464 = score(doc=3699,freq=3.0), product of:
             0.5211559 = queryWeight, product of:
               4.5333877 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0139050195 = queryNorm
             0.894981 = fieldWeight in 3699, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0625 = fieldNorm(doc=3699)
         0.16543598 = weight(abstract_txt:intelligence in 3699) [ClassicSimilarity], result of:
           0.16543598 = score(doc=3699,freq=1.0), product of:
             0.45385775 = queryWeight, product of:
               5.5965185 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0139050195 = queryNorm
             0.36451066 = fieldWeight in 3699, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0625 = fieldNorm(doc=3699)
       0.2 = coord(5/25)
   

4. He, D.; Brusilovsky, P.; Ahn, J.; Grady, J.; Farzan, R.; Peng, Y.; Yang, Y.; Rogati, M.: ¬An evaluation of adaptive filtering in the context of realistic task-based information exploration (2008) 0.13

   0.13325483 = sum of:
     0.13325483 = product of:
       0.8328427 = sum of:
         0.021328228 = weight(abstract_txt:information in 3048) [ClassicSimilarity], result of:
           0.021328228 = score(doc=3048,freq=10.0), product of:
             0.044612538 = queryWeight, product of:
               1.3263786 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0139050195 = queryNorm
             0.478077 = fieldWeight in 3048, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3048)
         0.058546275 = weight(abstract_txt:innovative in 3048) [ClassicSimilarity], result of:
           0.058546275 = score(doc=3048,freq=1.0), product of:
             0.1495581 = queryWeight, product of:
               1.7172321 = boost
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0139050195 = queryNorm
             0.39146176 = fieldWeight in 3048, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.263388 = idf(docFreq=229, maxDocs=44421)
               0.0625 = fieldNorm(doc=3048)
         0.46642464 = weight(abstract_txt:analysts in 3048) [ClassicSimilarity], result of:
           0.46642464 = score(doc=3048,freq=3.0), product of:
             0.5211559 = queryWeight, product of:
               4.5333877 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0139050195 = queryNorm
             0.894981 = fieldWeight in 3048, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0625 = fieldNorm(doc=3048)
         0.28654352 = weight(abstract_txt:intelligence in 3048) [ClassicSimilarity], result of:
           0.28654352 = score(doc=3048,freq=3.0), product of:
             0.45385775 = queryWeight, product of:
               5.5965185 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0139050195 = queryNorm
             0.63135093 = fieldWeight in 3048, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0625 = fieldNorm(doc=3048)
       0.16 = coord(4/25)
   

5. Rotolo, D.; Rafols, I.; Hopkins, M.M.; Leydesdorff, L.: Strategic intelligence on emerging technologies : scientometric overlay mapping (2017) 0.12

   0.11567663 = sum of:
     0.11567663 = product of:
       0.72297895 = sum of:
         0.05780724 = weight(abstract_txt:aggregation in 4322) [ClassicSimilarity], result of:
           0.05780724 = score(doc=4322,freq=1.0), product of:
             0.10143362 = queryWeight, product of:
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0139050195 = queryNorm
             0.5699022 = fieldWeight in 4322, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.078125 = fieldNorm(doc=4322)
         0.03610652 = weight(abstract_txt:tool in 4322) [ClassicSimilarity], result of:
           0.03610652 = score(doc=4322,freq=1.0), product of:
             0.093381494 = queryWeight, product of:
               1.3569206 = boost
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0139050195 = queryNorm
             0.38665605 = fieldWeight in 4322, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.078125 = fieldNorm(doc=4322)
         0.33661297 = weight(abstract_txt:analysts in 4322) [ClassicSimilarity], result of:
           0.33661297 = score(doc=4322,freq=1.0), product of:
             0.5211559 = queryWeight, product of:
               4.5333877 = boost
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0139050195 = queryNorm
             0.6458969 = fieldWeight in 4322, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.078125 = fieldNorm(doc=4322)
         0.29245225 = weight(abstract_txt:intelligence in 4322) [ClassicSimilarity], result of:
           0.29245225 = score(doc=4322,freq=2.0), product of:
             0.45385775 = queryWeight, product of:
               5.5965185 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0139050195 = queryNorm
             0.64436984 = fieldWeight in 4322, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.078125 = fieldNorm(doc=4322)
       0.16 = coord(4/25)