Document (#43378)

Author
Wartena, C.
Golub, K.
Title
Evaluierung von Verschlagwortung im Kontext des Information Retrievals
Source
Qualität in der Inhaltserschließung. Hrsg.: M. Franke-Maier, u.a
Imprint
München : DeGruyter-Saur
Year
2021
Pages
S.325-348
Series
Bibliotheks- und Informationspraxis; 70
Abstract
Dieser Beitrag möchte einen Überblick über die in der Literatur diskutierten Möglichkeiten, Herausforderungen und Grenzen geben, Retrieval als eine extrinsische Evaluierungsmethode für die Ergebnisse verbaler Sacherschließung zu nutzen. Die inhaltliche Erschließung im Allgemeinen und die Verschlagwortung im Besonderen können intrinsisch oder extrinsisch evaluiert werden. Die intrinsische Evaluierung bezieht sich auf Eigenschaften der Erschließung, von denen vermutet wird, dass sie geeignete Indikatoren für die Qualität der Erschließung sind, wie formale Einheitlichkeit (im Hinblick auf die Anzahl zugewiesener Deskriptoren pro Dokument, auf die Granularität usw.), Konsistenz oder Übereinstimmung der Ergebnisse verschiedener Erschließer:innen. Bei einer extrinsischen Evaluierung geht es darum, die Qualität der gewählten Deskriptoren daran zu messen, wie gut sie sich tatsächlich bei der Suche bewähren. Obwohl die extrinsische Evaluierung direktere Auskunft darüber gibt, ob die Erschließung ihren Zweck erfüllt, und daher den Vorzug verdienen sollte, ist sie kompliziert und oft problematisch. In einem Retrievalsystem greifen verschiedene Algorithmen und Datenquellen in vielschichtiger Weise ineinander und interagieren bei der Evaluierung darüber hinaus noch mit Nutzer:innen und Rechercheaufgaben. Die Evaluierung einer Komponente im System kann nicht einfach dadurch vorgenommen werden, dass man sie austauscht und mit einer anderen Komponente vergleicht, da die gleiche Ressource oder der gleiche Algorithmus sich in unterschiedlichen Umgebungen unterschiedlich verhalten kann. Wir werden relevante Evaluierungsansätze vorstellen und diskutieren, und zum Abschluss einige Empfehlungen für die Evaluierung von Verschlagwortung im Kontext von Retrieval geben.
Theme
Retrievalstudien

Similar documents (author)

  1. Golub, K.: Automated subject classification of textual web documents (2006) 5.30 
    5.298757 = sum of:
  5.298757 = weight(author_txt:golub in 5600) [ClassicSimilarity], result of:
    5.298757 = fieldWeight in 5600, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.478011 = idf(docFreq=24, maxDocs=44218)
      0.625 = fieldNorm(doc=5600)
  2. Golub, K.: Automated subject classification of textual Web pages, based on a controlled vocabulary : challenges and recommendations (2006) 5.30 
    5.298757 = sum of:
  5.298757 = weight(author_txt:golub in 5897) [ClassicSimilarity], result of:
    5.298757 = fieldWeight in 5897, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.478011 = idf(docFreq=24, maxDocs=44218)
      0.625 = fieldNorm(doc=5897)
  3. Golub, K.: Subject access to information : an interdisciplinary approach (2015) 5.30 
    5.298757 = sum of:
  5.298757 = weight(author_txt:golub in 134) [ClassicSimilarity], result of:
    5.298757 = fieldWeight in 134, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.478011 = idf(docFreq=24, maxDocs=44218)
      0.625 = fieldNorm(doc=134)
  4. Golub, K.: Automated subject classification of textual documents in the context of Web-based hierarchical browsing (2011) 5.30 
    5.298757 = sum of:
  5.298757 = weight(author_txt:golub in 4558) [ClassicSimilarity], result of:
    5.298757 = fieldWeight in 4558, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.478011 = idf(docFreq=24, maxDocs=44218)
      0.625 = fieldNorm(doc=4558)
  5. Golub, K.: Subject access in Swedish discovery services (2018) 5.30 
    5.298757 = sum of:
  5.298757 = weight(author_txt:golub in 4379) [ClassicSimilarity], result of:
    5.298757 = fieldWeight in 4379, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.478011 = idf(docFreq=24, maxDocs=44218)
      0.625 = fieldNorm(doc=4379)

Similar documents (content)

  1. Herb, U.: Relevanz von Impact-Maßen für Open Access (2013) 0.20 
    0.20037292 = sum of:
  0.20037292 = product of:
    1.0018646 = sum of:
      0.026909707 = weight(abstract_txt:dass in 926) [ClassicSimilarity], result of:
        0.026909707 = score(doc=926,freq=1.0), product of:
          0.0634841 = queryWeight, product of:
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.014040814 = queryNorm
          0.42388102 = fieldWeight in 926, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.09375 = fieldNorm(doc=926)
      0.018824037 = weight(abstract_txt:werden in 926) [ClassicSimilarity], result of:
        0.018824037 = score(doc=926,freq=1.0), product of:
          0.057266146 = queryWeight, product of:
            1.1632206 = boost
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.014040814 = queryNorm
          0.32871145 = fieldWeight in 926, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.09375 = fieldNorm(doc=926)
      0.019679993 = weight(abstract_txt:sich in 926) [ClassicSimilarity], result of:
        0.019679993 = score(doc=926,freq=1.0), product of:
          0.05898923 = queryWeight, product of:
            1.1805911 = boost
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.014040814 = queryNorm
          0.3336201 = fieldWeight in 926, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.09375 = fieldNorm(doc=926)
      0.069513574 = weight(abstract_txt:qualität in 926) [ClassicSimilarity], result of:
        0.069513574 = score(doc=926,freq=1.0), product of:
          0.1195195 = queryWeight, product of:
            1.3721036 = boost
            6.203826 = idf(docFreq=242, maxDocs=44218)
            0.014040814 = queryNorm
          0.58160865 = fieldWeight in 926, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.203826 = idf(docFreq=242, maxDocs=44218)
            0.09375 = fieldNorm(doc=926)
      0.8669373 = weight(abstract_txt:evaluierung in 926) [ClassicSimilarity], result of:
        0.8669373 = score(doc=926,freq=3.0), product of:
          0.6766536 = queryWeight, product of:
            6.107799 = boost
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.014040814 = queryNorm
          1.2812128 = fieldWeight in 926, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.09375 = fieldNorm(doc=926)
    0.2 = coord(5/25)
  2. Nitzsche, J.: Inhaltserschließung von medizinischen Internetquellen und Multimediaprodukten (2001) 0.18 
    0.18240622 = sum of:
  0.18240622 = product of:
    0.65145075 = sum of:
      0.021736128 = weight(abstract_txt:werden in 5674) [ClassicSimilarity], result of:
        0.021736128 = score(doc=5674,freq=3.0), product of:
          0.057266146 = queryWeight, product of:
            1.1632206 = boost
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.014040814 = queryNorm
          0.3795633 = fieldWeight in 5674, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.018554475 = weight(abstract_txt:sich in 5674) [ClassicSimilarity], result of:
        0.018554475 = score(doc=5674,freq=2.0), product of:
          0.05898923 = queryWeight, product of:
            1.1805911 = boost
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.014040814 = queryNorm
          0.31454006 = fieldWeight in 5674, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.029538503 = weight(abstract_txt:einer in 5674) [ClassicSimilarity], result of:
        0.029538503 = score(doc=5674,freq=3.0), product of:
          0.070259035 = queryWeight, product of:
            1.2884401 = boost
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.014040814 = queryNorm
          0.42042285 = fieldWeight in 5674, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.045977466 = weight(abstract_txt:kontext in 5674) [ClassicSimilarity], result of:
        0.045977466 = score(doc=5674,freq=1.0), product of:
          0.11889125 = queryWeight, product of:
            1.3684926 = boost
            6.187499 = idf(docFreq=246, maxDocs=44218)
            0.014040814 = queryNorm
          0.3867187 = fieldWeight in 5674, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.187499 = idf(docFreq=246, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.02222564 = weight(abstract_txt:oder in 5674) [ClassicSimilarity], result of:
        0.02222564 = score(doc=5674,freq=1.0), product of:
          0.08382749 = queryWeight, product of:
            1.4073638 = boost
            4.2421675 = idf(docFreq=1727, maxDocs=44218)
            0.014040814 = queryNorm
          0.26513547 = fieldWeight in 5674, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.2421675 = idf(docFreq=1727, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.17973423 = weight(abstract_txt:erschließung in 5674) [ClassicSimilarity], result of:
        0.17973423 = score(doc=5674,freq=5.0), product of:
          0.21738373 = queryWeight, product of:
            2.6169536 = boost
            5.916144 = idf(docFreq=323, maxDocs=44218)
            0.014040814 = queryNorm
          0.82680625 = fieldWeight in 5674, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            5.916144 = idf(docFreq=323, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
      0.33368433 = weight(abstract_txt:evaluierung in 5674) [ClassicSimilarity], result of:
        0.33368433 = score(doc=5674,freq=1.0), product of:
          0.6766536 = queryWeight, product of:
            6.107799 = boost
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.014040814 = queryNorm
          0.49313906 = fieldWeight in 5674, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.0625 = fieldNorm(doc=5674)
    0.28 = coord(7/25)
  3. Wolff, C.: Effektivität von Recherchen im WWW : Vergleichende Evaluierung von such- und Metasuchmaschinen (2000) 0.17 
    0.17161922 = sum of:
  0.17161922 = product of:
    0.85809606 = sum of:
      0.026621211 = weight(abstract_txt:werden in 5463) [ClassicSimilarity], result of:
        0.026621211 = score(doc=5463,freq=2.0), product of:
          0.057266146 = queryWeight, product of:
            1.1632206 = boost
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.014040814 = queryNorm
          0.46486822 = fieldWeight in 5463, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.09375 = fieldNorm(doc=5463)
      0.019679993 = weight(abstract_txt:sich in 5463) [ClassicSimilarity], result of:
        0.019679993 = score(doc=5463,freq=1.0), product of:
          0.05898923 = queryWeight, product of:
            1.1805911 = boost
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.014040814 = queryNorm
          0.3336201 = fieldWeight in 5463, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.09375 = fieldNorm(doc=5463)
      0.0677664 = weight(abstract_txt:ergebnisse in 5463) [ClassicSimilarity], result of:
        0.0677664 = score(doc=5463,freq=2.0), product of:
          0.09326642 = queryWeight, product of:
            1.2120769 = boost
            5.4802814 = idf(docFreq=500, maxDocs=44218)
            0.014040814 = queryNorm
          0.7265895 = fieldWeight in 5463, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.4802814 = idf(docFreq=500, maxDocs=44218)
            0.09375 = fieldNorm(doc=5463)
      0.03617713 = weight(abstract_txt:einer in 5463) [ClassicSimilarity], result of:
        0.03617713 = score(doc=5463,freq=2.0), product of:
          0.070259035 = queryWeight, product of:
            1.2884401 = boost
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.014040814 = queryNorm
          0.5149107 = fieldWeight in 5463, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.09375 = fieldNorm(doc=5463)
      0.70785135 = weight(abstract_txt:evaluierung in 5463) [ClassicSimilarity], result of:
        0.70785135 = score(doc=5463,freq=2.0), product of:
          0.6766536 = queryWeight, product of:
            6.107799 = boost
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.014040814 = queryNorm
          1.0461059 = fieldWeight in 5463, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.09375 = fieldNorm(doc=5463)
    0.2 = coord(5/25)
  4. Behnert, C.; Plassmeier, K.; Borst, T.; Lewandowski, D.: Evaluierung von Rankingverfahren für bibliothekarische Informationssysteme (2019) 0.17 
    0.16753606 = sum of:
  0.16753606 = product of:
    0.83768034 = sum of:
      0.026909707 = weight(abstract_txt:dass in 5023) [ClassicSimilarity], result of:
        0.026909707 = score(doc=5023,freq=1.0), product of:
          0.0634841 = queryWeight, product of:
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.014040814 = queryNorm
          0.42388102 = fieldWeight in 5023, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.09375 = fieldNorm(doc=5023)
      0.018824037 = weight(abstract_txt:werden in 5023) [ClassicSimilarity], result of:
        0.018824037 = score(doc=5023,freq=1.0), product of:
          0.057266146 = queryWeight, product of:
            1.1632206 = boost
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.014040814 = queryNorm
          0.32871145 = fieldWeight in 5023, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5062556 = idf(docFreq=3606, maxDocs=44218)
            0.09375 = fieldNorm(doc=5023)
      0.04791808 = weight(abstract_txt:ergebnisse in 5023) [ClassicSimilarity], result of:
        0.04791808 = score(doc=5023,freq=1.0), product of:
          0.09326642 = queryWeight, product of:
            1.2120769 = boost
            5.4802814 = idf(docFreq=500, maxDocs=44218)
            0.014040814 = queryNorm
          0.51377636 = fieldWeight in 5023, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4802814 = idf(docFreq=500, maxDocs=44218)
            0.09375 = fieldNorm(doc=5023)
      0.03617713 = weight(abstract_txt:einer in 5023) [ClassicSimilarity], result of:
        0.03617713 = score(doc=5023,freq=2.0), product of:
          0.070259035 = queryWeight, product of:
            1.2884401 = boost
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.014040814 = queryNorm
          0.5149107 = fieldWeight in 5023, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.8837 = idf(docFreq=2472, maxDocs=44218)
            0.09375 = fieldNorm(doc=5023)
      0.70785135 = weight(abstract_txt:evaluierung in 5023) [ClassicSimilarity], result of:
        0.70785135 = score(doc=5023,freq=2.0), product of:
          0.6766536 = queryWeight, product of:
            6.107799 = boost
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.014040814 = queryNorm
          1.0461059 = fieldWeight in 5023, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.890225 = idf(docFreq=44, maxDocs=44218)
            0.09375 = fieldNorm(doc=5023)
    0.2 = coord(5/25)
  5. Sack, H.: Hybride Künstliche Intelligenz in der automatisierten Inhaltserschließung (2021) 0.15 
    0.15498956 = sum of:
  0.15498956 = product of:
    0.55353415 = sum of:
      0.022424754 = weight(abstract_txt:dass in 372) [ClassicSimilarity], result of:
        0.022424754 = score(doc=372,freq=1.0), product of:
          0.0634841 = queryWeight, product of:
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.014040814 = queryNorm
          0.35323417 = fieldWeight in 372, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.5213976 = idf(docFreq=1306, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.016399994 = weight(abstract_txt:sich in 372) [ClassicSimilarity], result of:
        0.016399994 = score(doc=372,freq=1.0), product of:
          0.05898923 = queryWeight, product of:
            1.1805911 = boost
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.014040814 = queryNorm
          0.27801675 = fieldWeight in 372, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.5586145 = idf(docFreq=3422, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.050876833 = weight(abstract_txt:darüber in 372) [ClassicSimilarity], result of:
        0.050876833 = score(doc=372,freq=1.0), product of:
          0.10961245 = queryWeight, product of:
            1.3140063 = boost
            5.941145 = idf(docFreq=315, maxDocs=44218)
            0.014040814 = queryNorm
          0.46415195 = fieldWeight in 372, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.941145 = idf(docFreq=315, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.057471834 = weight(abstract_txt:kontext in 372) [ClassicSimilarity], result of:
        0.057471834 = score(doc=372,freq=1.0), product of:
          0.11889125 = queryWeight, product of:
            1.3684926 = boost
            6.187499 = idf(docFreq=246, maxDocs=44218)
            0.014040814 = queryNorm
          0.48339838 = fieldWeight in 372, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.187499 = idf(docFreq=246, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.03928975 = weight(abstract_txt:oder in 372) [ClassicSimilarity], result of:
        0.03928975 = score(doc=372,freq=2.0), product of:
          0.08382749 = queryWeight, product of:
            1.4073638 = boost
            4.2421675 = idf(docFreq=1727, maxDocs=44218)
            0.014040814 = queryNorm
          0.4686977 = fieldWeight in 372, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.2421675 = idf(docFreq=1727, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.14209238 = weight(abstract_txt:erschließung in 372) [ClassicSimilarity], result of:
        0.14209238 = score(doc=372,freq=2.0), product of:
          0.21738373 = queryWeight, product of:
            2.6169536 = boost
            5.916144 = idf(docFreq=323, maxDocs=44218)
            0.014040814 = queryNorm
          0.6536477 = fieldWeight in 372, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.916144 = idf(docFreq=323, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
      0.2249786 = weight(abstract_txt:verschlagwortung in 372) [ClassicSimilarity], result of:
        0.2249786 = score(doc=372,freq=1.0), product of:
          0.33804232 = queryWeight, product of:
            2.8261726 = boost
            8.518833 = idf(docFreq=23, maxDocs=44218)
            0.014040814 = queryNorm
          0.66553384 = fieldWeight in 372, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.518833 = idf(docFreq=23, maxDocs=44218)
            0.078125 = fieldNorm(doc=372)
    0.28 = coord(7/25)