Document (#36200)

Author

Devaul, H.
Diekema, A.R.
Ostwald, J.

Title

Computer-assisted assignment of educational standards using natural language processing

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.2, S.395-405

Year

2011

Abstract

Educational standards are a central focus of the current educational system in the United States, underpinning educational practice, curriculum design, teacher professional development, and high-stakes testing and assessment. Digital library users have requested that this information be accessible in association with digital learning resources to support teaching and learning as well as accountability requirements. Providing this information is complex because of the variability and number of standards documents in use at the national, state, and local level. This article describes a cataloging tool that aids catalogers in the assignment of standards metadata to digital library resources, using natural language processing techniques. The research explores whether the standards suggestor service would suggest the same standards as a human, whether relevant standards are ranked appropriately in the result set, and whether the relevance of the suggested assignments improve when, in addition to resource content, metadata is included in the query to the cataloging tool. The article also discusses how this service might streamline the cataloging workflow.

Theme

Computer Based Training
Formalerschließung

Location

USA

Similar documents (content)

1. Sutton, S.A.; Golder, D.: Achievement Standards Network (ASN) : an application profile for mapping K-12 educational resources to achievement (2008) 0.25

   0.25221094 = sum of:
     0.25221094 = product of:
       0.9007534 = sum of:
         0.038572382 = weight(abstract_txt:resources in 3636) [ClassicSimilarity], result of:
           0.038572382 = score(doc=3636,freq=1.0), product of:
             0.09740815 = queryWeight, product of:
               1.1117332 = boost
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.020743635 = queryNorm
             0.3959872 = fieldWeight in 3636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.05458213 = weight(abstract_txt:learning in 3636) [ClassicSimilarity], result of:
           0.05458213 = score(doc=3636,freq=1.0), product of:
             0.12277538 = queryWeight, product of:
               1.2481264 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.020743635 = queryNorm
             0.444569 = fieldWeight in 3636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.01426234 = weight(abstract_txt:this in 3636) [ClassicSimilarity], result of:
           0.01426234 = score(doc=3636,freq=1.0), product of:
             0.063223936 = queryWeight, product of:
               1.266656 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020743635 = queryNorm
             0.2255845 = fieldWeight in 3636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.10298454 = weight(abstract_txt:metadata in 3636) [ClassicSimilarity], result of:
           0.10298454 = score(doc=3636,freq=3.0), product of:
             0.12998262 = queryWeight, product of:
               1.2842381 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020743635 = queryNorm
             0.7922947 = fieldWeight in 3636, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.062221285 = weight(abstract_txt:digital in 3636) [ClassicSimilarity], result of:
           0.062221285 = score(doc=3636,freq=1.0), product of:
             0.15336776 = queryWeight, product of:
               1.7085024 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.020743635 = queryNorm
             0.4056999 = fieldWeight in 3636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.23144916 = weight(abstract_txt:educational in 3636) [ClassicSimilarity], result of:
           0.23144916 = score(doc=3636,freq=1.0), product of:
             0.4052516 = queryWeight, product of:
               3.206862 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.020743635 = queryNorm
             0.5711246 = fieldWeight in 3636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
         0.39668158 = weight(abstract_txt:standards in 3636) [ClassicSimilarity], result of:
           0.39668158 = score(doc=3636,freq=4.0), product of:
             0.44059718 = queryWeight, product of:
               4.423416 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.020743635 = queryNorm
             0.9003271 = fieldWeight in 3636, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.09375 = fieldNorm(doc=3636)
       0.28 = coord(7/25)
   

2. Alcaraz-García, I.; Bueno-de-la-Fuente, G.: Best practices for current learning repositories : the case of agrega (2014) 0.21

   0.20738448 = sum of:
     0.20738448 = product of:
       0.7406589 = sum of:
         0.032143652 = weight(abstract_txt:resources in 2585) [ClassicSimilarity], result of:
           0.032143652 = score(doc=2585,freq=1.0), product of:
             0.09740815 = queryWeight, product of:
               1.1117332 = boost
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.020743635 = queryNorm
             0.32998934 = fieldWeight in 2585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.040898293 = weight(abstract_txt:service in 2585) [ClassicSimilarity], result of:
           0.040898293 = score(doc=2585,freq=1.0), product of:
             0.114376105 = queryWeight, product of:
               1.2046769 = boost
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.020743635 = queryNorm
             0.35757726 = fieldWeight in 2585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.576989 = idf(docFreq=1241, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.09097021 = weight(abstract_txt:learning in 2585) [ClassicSimilarity], result of:
           0.09097021 = score(doc=2585,freq=4.0), product of:
             0.12277538 = queryWeight, product of:
               1.2481264 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.020743635 = queryNorm
             0.7409483 = fieldWeight in 2585, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.020585915 = weight(abstract_txt:this in 2585) [ClassicSimilarity], result of:
           0.020585915 = score(doc=2585,freq=3.0), product of:
             0.063223936 = queryWeight, product of:
               1.266656 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020743635 = queryNorm
             0.3256032 = fieldWeight in 2585, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.049548462 = weight(abstract_txt:metadata in 2585) [ClassicSimilarity], result of:
           0.049548462 = score(doc=2585,freq=1.0), product of:
             0.12998262 = queryWeight, product of:
               1.2842381 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020743635 = queryNorm
             0.38119298 = fieldWeight in 2585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.27276546 = weight(abstract_txt:educational in 2585) [ClassicSimilarity], result of:
           0.27276546 = score(doc=2585,freq=2.0), product of:
             0.4052516 = queryWeight, product of:
               3.206862 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.020743635 = queryNorm
             0.6730768 = fieldWeight in 2585, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
         0.23374686 = weight(abstract_txt:standards in 2585) [ClassicSimilarity], result of:
           0.23374686 = score(doc=2585,freq=2.0), product of:
             0.44059718 = queryWeight, product of:
               4.423416 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.020743635 = queryNorm
             0.5305228 = fieldWeight in 2585, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.078125 = fieldNorm(doc=2585)
       0.28 = coord(7/25)
   

3. Sutton, S.A.: Metadata quality, utility and the Semantic Web : the case of learning resources and achievement standards (2008) 0.19

   0.19236825 = sum of:
     0.19236825 = product of:
       0.8015344 = sum of:
         0.02807209 = weight(abstract_txt:article in 1801) [ClassicSimilarity], result of:
           0.02807209 = score(doc=1801,freq=1.0), product of:
             0.07881233 = queryWeight, product of:
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.020743635 = queryNorm
             0.35618907 = fieldWeight in 1801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
         0.038572382 = weight(abstract_txt:resources in 1801) [ClassicSimilarity], result of:
           0.038572382 = score(doc=1801,freq=1.0), product of:
             0.09740815 = queryWeight, product of:
               1.1117332 = boost
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.020743635 = queryNorm
             0.3959872 = fieldWeight in 1801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
         0.01426234 = weight(abstract_txt:this in 1801) [ClassicSimilarity], result of:
           0.01426234 = score(doc=1801,freq=1.0), product of:
             0.063223936 = queryWeight, product of:
               1.266656 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020743635 = queryNorm
             0.2255845 = fieldWeight in 1801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
         0.14564215 = weight(abstract_txt:metadata in 1801) [ClassicSimilarity], result of:
           0.14564215 = score(doc=1801,freq=6.0), product of:
             0.12998262 = queryWeight, product of:
               1.2842381 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020743635 = queryNorm
             1.120474 = fieldWeight in 1801, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
         0.23144916 = weight(abstract_txt:educational in 1801) [ClassicSimilarity], result of:
           0.23144916 = score(doc=1801,freq=1.0), product of:
             0.4052516 = queryWeight, product of:
               3.206862 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.020743635 = queryNorm
             0.5711246 = fieldWeight in 1801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
         0.34353632 = weight(abstract_txt:standards in 1801) [ClassicSimilarity], result of:
           0.34353632 = score(doc=1801,freq=3.0), product of:
             0.44059718 = queryWeight, product of:
               4.423416 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.020743635 = queryNorm
             0.7797061 = fieldWeight in 1801, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.09375 = fieldNorm(doc=1801)
       0.24 = coord(6/25)
   

4. Bartolo, L.M.; Lowe, C.S.; Sadoway, D.R.; Powell, A.C.; Glotzer, S.C.: NSDL MatDL : exploring digital library roles (2005) 0.19

   0.18821044 = sum of:
     0.18821044 = product of:
       0.58815765 = sum of:
         0.035017673 = weight(abstract_txt:language in 2181) [ClassicSimilarity], result of:
           0.035017673 = score(doc=2181,freq=2.0), product of:
             0.094984636 = queryWeight, product of:
               1.0978161 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.020743635 = queryNorm
             0.3686667 = fieldWeight in 2181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.036388084 = weight(abstract_txt:learning in 2181) [ClassicSimilarity], result of:
           0.036388084 = score(doc=2181,freq=1.0), product of:
             0.12277538 = queryWeight, product of:
               1.2481264 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.020743635 = queryNorm
             0.29637933 = fieldWeight in 2181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.009508227 = weight(abstract_txt:this in 2181) [ClassicSimilarity], result of:
           0.009508227 = score(doc=2181,freq=1.0), product of:
             0.063223936 = queryWeight, product of:
               1.266656 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020743635 = queryNorm
             0.15038967 = fieldWeight in 2181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.03963877 = weight(abstract_txt:metadata in 2181) [ClassicSimilarity], result of:
           0.03963877 = score(doc=2181,freq=1.0), product of:
             0.12998262 = queryWeight, product of:
               1.2842381 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020743635 = queryNorm
             0.30495438 = fieldWeight in 2181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.05850256 = weight(abstract_txt:tool in 2181) [ClassicSimilarity], result of:
           0.05850256 = score(doc=2181,freq=2.0), product of:
             0.133735 = queryWeight, product of:
               1.3026432 = boost
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.020743635 = queryNorm
             0.43745136 = fieldWeight in 2181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9491973 = idf(docFreq=855, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.058662787 = weight(abstract_txt:digital in 2181) [ClassicSimilarity], result of:
           0.058662787 = score(doc=2181,freq=2.0), product of:
             0.15336776 = queryWeight, product of:
               1.7085024 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.020743635 = queryNorm
             0.38249752 = fieldWeight in 2181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.21821237 = weight(abstract_txt:educational in 2181) [ClassicSimilarity], result of:
           0.21821237 = score(doc=2181,freq=2.0), product of:
             0.4052516 = queryWeight, product of:
               3.206862 = boost
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.020743635 = queryNorm
             0.53846145 = fieldWeight in 2181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0919957 = idf(docFreq=272, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
         0.1322272 = weight(abstract_txt:standards in 2181) [ClassicSimilarity], result of:
           0.1322272 = score(doc=2181,freq=1.0), product of:
             0.44059718 = queryWeight, product of:
               4.423416 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.020743635 = queryNorm
             0.30010903 = fieldWeight in 2181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.0625 = fieldNorm(doc=2181)
       0.32 = coord(8/25)
   

5. Christel, M.G.: Automated metadata in multimedia information systems : creation, refinement, use in surrogates, and evaluation (2009) 0.17

   0.17277914 = sum of:
     0.17277914 = product of:
       0.47994202 = sum of:
         0.024761233 = weight(abstract_txt:language in 73) [ClassicSimilarity], result of:
           0.024761233 = score(doc=73,freq=1.0), product of:
             0.094984636 = queryWeight, product of:
               1.0978161 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.020743635 = queryNorm
             0.26068673 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.04453955 = weight(abstract_txt:resources in 73) [ClassicSimilarity], result of:
           0.04453955 = score(doc=73,freq=3.0), product of:
             0.09740815 = queryWeight, product of:
               1.1117332 = boost
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.020743635 = queryNorm
             0.45724663 = fieldWeight in 73, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2238636 = idf(docFreq=1767, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.036388084 = weight(abstract_txt:learning in 73) [ClassicSimilarity], result of:
           0.036388084 = score(doc=73,freq=1.0), product of:
             0.12277538 = queryWeight, product of:
               1.2481264 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.020743635 = queryNorm
             0.29637933 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.009508227 = weight(abstract_txt:this in 73) [ClassicSimilarity], result of:
           0.009508227 = score(doc=73,freq=1.0), product of:
             0.063223936 = queryWeight, product of:
               1.266656 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.020743635 = queryNorm
             0.15038967 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.08863498 = weight(abstract_txt:metadata in 73) [ClassicSimilarity], result of:
           0.08863498 = score(doc=73,freq=5.0), product of:
             0.12998262 = queryWeight, product of:
               1.2842381 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020743635 = queryNorm
             0.6818987 = fieldWeight in 73, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.040762786 = weight(abstract_txt:processing in 73) [ClassicSimilarity], result of:
           0.040762786 = score(doc=73,freq=1.0), product of:
             0.13242838 = queryWeight, product of:
               1.2962639 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.020743635 = queryNorm
             0.30781004 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.044457205 = weight(abstract_txt:natural in 73) [ClassicSimilarity], result of:
           0.044457205 = score(doc=73,freq=1.0), product of:
             0.14031366 = queryWeight, product of:
               1.3342981 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.020743635 = queryNorm
             0.3168416 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.058662787 = weight(abstract_txt:digital in 73) [ClassicSimilarity], result of:
           0.058662787 = score(doc=73,freq=2.0), product of:
             0.15336776 = queryWeight, product of:
               1.7085024 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.020743635 = queryNorm
             0.38249752 = fieldWeight in 73, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
         0.1322272 = weight(abstract_txt:standards in 73) [ClassicSimilarity], result of:
           0.1322272 = score(doc=73,freq=1.0), product of:
             0.44059718 = queryWeight, product of:
               4.423416 = boost
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.020743635 = queryNorm
             0.30010903 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8017445 = idf(docFreq=991, maxDocs=44421)
               0.0625 = fieldNorm(doc=73)
       0.36 = coord(9/25)