Document (#43447)

Author

Ikae, C.
Savoy, J.

Title

Gender identification on Twitter

Source

Journal of the Association for Information Science and Technology. 73(2022) no.1, S.58-69

Year

2022

Abstract

To determine the author of a text's gender, various feature types have been suggested (e.g., function words, n-gram of letters, etc.) leading to a huge number of stylistic markers. To determine the target category, different machine learning models have been suggested (e.g., logistic regression, decision tree, k nearest-neighbors, support vector machine, naïve Bayes, neural networks, and random forest). In this study, our first objective is to know whether or not the same model always proposes the best effectiveness when considering similar corpora under the same conditions. Thus, based on 7 CLEF-PAN collections, this study analyzes the effectiveness of 10 different classifiers. Our second aim is to propose a 2-stage feature selection to reduce the feature size to a few hundred terms without any significant change in the performance level compared to approaches using all the attributes (increase of around 5% after applying the proposed feature selection). Based on our experiments, neural network or random forest tend, on average, to produce the highest effectiveness. Moreover, empirical evidence indicates that reducing the feature set size to around 300 without penalizing the effectiveness is possible. Finally, based on such reduced feature sizes, an analysis reveals some of the specific terms that clearly discriminate between the 2 genders.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24541.

Theme

Informetrie

Field

Kommunikationswissenschaften

Object

Twitter

Similar documents (author)

1. Savoy, J.: Stemming of French words based on grammatical categories (1993) 5.21

   5.2088575 = sum of:
     5.2088575 = weight(author_txt:savoy in 4649) [ClassicSimilarity], result of:
       5.2088575 = fieldWeight in 4649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.334172 = idf(docFreq=28, maxDocs=44421)
         0.625 = fieldNorm(doc=4649)
   

2. Savoy, J.: Effectiveness of information retrieval systems used in a hypertext environment (1993) 5.21

   5.2088575 = sum of:
     5.2088575 = weight(author_txt:savoy in 6510) [ClassicSimilarity], result of:
       5.2088575 = fieldWeight in 6510, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.334172 = idf(docFreq=28, maxDocs=44421)
         0.625 = fieldNorm(doc=6510)
   

3. Savoy, J.: ¬A learning scheme for information retrieval in hypertext (1994) 5.21

   5.2088575 = sum of:
     5.2088575 = weight(author_txt:savoy in 7291) [ClassicSimilarity], result of:
       5.2088575 = fieldWeight in 7291, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.334172 = idf(docFreq=28, maxDocs=44421)
         0.625 = fieldNorm(doc=7291)
   

4. Savoy, J.: Bayesian inference networks and spreading activation in hypertext systems (1992) 5.21

   5.2088575 = sum of:
     5.2088575 = weight(author_txt:savoy in 260) [ClassicSimilarity], result of:
       5.2088575 = fieldWeight in 260, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.334172 = idf(docFreq=28, maxDocs=44421)
         0.625 = fieldNorm(doc=260)
   

5. Savoy, J.: Searching information in legal hypertext systems (1993/94) 5.21

   5.2088575 = sum of:
     5.2088575 = weight(author_txt:savoy in 825) [ClassicSimilarity], result of:
       5.2088575 = fieldWeight in 825, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.334172 = idf(docFreq=28, maxDocs=44421)
         0.625 = fieldNorm(doc=825)
   

Similar documents (content)

1. Mengle, S.S.R.; Goharian, N.: Ambiguity measure feature-selection algorithm (2009) 0.23

   0.22942808 = sum of:
     0.22942808 = product of:
       0.9559504 = sum of:
         0.11688511 = weight(abstract_txt:naïve in 3804) [ClassicSimilarity], result of:
           0.11688511 = score(doc=3804,freq=2.0), product of:
             0.15867253 = queryWeight, product of:
               1.023085 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.018609194 = queryNorm
             0.7366437 = fieldWeight in 3804, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
         0.12502952 = weight(abstract_txt:bayes in 3804) [ClassicSimilarity], result of:
           0.12502952 = score(doc=3804,freq=2.0), product of:
             0.16596021 = queryWeight, product of:
               1.0463159 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.018609194 = queryNorm
             0.75337046 = fieldWeight in 3804, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
         0.041913025 = weight(abstract_txt:machine in 3804) [ClassicSimilarity], result of:
           0.041913025 = score(doc=3804,freq=1.0), product of:
             0.12713006 = queryWeight, product of:
               1.2950901 = boost
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.018609194 = queryNorm
             0.3296862 = fieldWeight in 3804, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
         0.09917092 = weight(abstract_txt:selection in 3804) [ClassicSimilarity], result of:
           0.09917092 = score(doc=3804,freq=5.0), product of:
             0.13201253 = queryWeight, product of:
               1.3197249 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.018609194 = queryNorm
             0.75122356 = fieldWeight in 3804, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
         0.106896475 = weight(abstract_txt:effectiveness in 3804) [ClassicSimilarity], result of:
           0.106896475 = score(doc=3804,freq=2.0), product of:
             0.23731463 = queryWeight, product of:
               2.502379 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018609194 = queryNorm
             0.450442 = fieldWeight in 3804, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
         0.4660553 = weight(abstract_txt:feature in 3804) [ClassicSimilarity], result of:
           0.4660553 = score(doc=3804,freq=7.0), product of:
             0.47750908 = queryWeight, product of:
               4.347377 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.018609194 = queryNorm
             0.9760135 = fieldWeight in 3804, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=3804)
       0.24 = coord(6/25)
   

2. Wang, P.; Li, X.: Assessing the quality of information on Wikipedia : a deep-learning approach (2020) 0.13

   0.12905252 = sum of:
     0.12905252 = product of:
       0.6452626 = sum of:
         0.04101139 = weight(abstract_txt:determine in 505) [ClassicSimilarity], result of:
           0.04101139 = score(doc=505,freq=1.0), product of:
             0.12530024 = queryWeight, product of:
               1.285736 = boost
               5.2368793 = idf(docFreq=641, maxDocs=44421)
               0.018609194 = queryNorm
             0.32730496 = fieldWeight in 505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2368793 = idf(docFreq=641, maxDocs=44421)
               0.0625 = fieldNorm(doc=505)
         0.041913025 = weight(abstract_txt:machine in 505) [ClassicSimilarity], result of:
           0.041913025 = score(doc=505,freq=1.0), product of:
             0.12713006 = queryWeight, product of:
               1.2950901 = boost
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.018609194 = queryNorm
             0.3296862 = fieldWeight in 505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.0625 = fieldNorm(doc=505)
         0.13444626 = weight(abstract_txt:neural in 505) [ClassicSimilarity], result of:
           0.13444626 = score(doc=505,freq=2.0), product of:
             0.2194681 = queryWeight, product of:
               1.7016159 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.018609194 = queryNorm
             0.61260045 = fieldWeight in 505, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=505)
         0.07558722 = weight(abstract_txt:effectiveness in 505) [ClassicSimilarity], result of:
           0.07558722 = score(doc=505,freq=1.0), product of:
             0.23731463 = queryWeight, product of:
               2.502379 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018609194 = queryNorm
             0.3185106 = fieldWeight in 505, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=505)
         0.3523047 = weight(abstract_txt:feature in 505) [ClassicSimilarity], result of:
           0.3523047 = score(doc=505,freq=4.0), product of:
             0.47750908 = queryWeight, product of:
               4.347377 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.018609194 = queryNorm
             0.73779684 = fieldWeight in 505, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=505)
       0.2 = coord(5/25)
   

3. Ma, Z.; Sun, A.; Cong, G.: On predicting the popularity of newly emerging hashtags in Twitter (2013) 0.12

   0.120186634 = sum of:
     0.120186634 = product of:
       0.50077766 = sum of:
         0.07718077 = weight(abstract_txt:nearest in 1967) [ClassicSimilarity], result of:
           0.07718077 = score(doc=1967,freq=1.0), product of:
             0.15159272 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.018609194 = queryNorm
             0.50913244 = fieldWeight in 1967, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
         0.11153243 = weight(abstract_txt:logistic in 1967) [ClassicSimilarity], result of:
           0.11153243 = score(doc=1967,freq=2.0), product of:
             0.15379056 = queryWeight, product of:
               1.0072231 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.018609194 = queryNorm
             0.7252228 = fieldWeight in 1967, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
         0.08265026 = weight(abstract_txt:naïve in 1967) [ClassicSimilarity], result of:
           0.08265026 = score(doc=1967,freq=1.0), product of:
             0.15867253 = queryWeight, product of:
               1.023085 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.018609194 = queryNorm
             0.52088577 = fieldWeight in 1967, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
         0.088409215 = weight(abstract_txt:bayes in 1967) [ClassicSimilarity], result of:
           0.088409215 = score(doc=1967,freq=1.0), product of:
             0.16596021 = queryWeight, product of:
               1.0463159 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.018609194 = queryNorm
             0.53271335 = fieldWeight in 1967, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
         0.013813979 = weight(abstract_txt:based in 1967) [ClassicSimilarity], result of:
           0.013813979 = score(doc=1967,freq=1.0), product of:
             0.069437146 = queryWeight, product of:
               1.1722424 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.018609194 = queryNorm
             0.1989422 = fieldWeight in 1967, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
         0.12719102 = weight(abstract_txt:neighbors in 1967) [ClassicSimilarity], result of:
           0.12719102 = score(doc=1967,freq=1.0), product of:
             0.21149977 = queryWeight, product of:
               1.1811792 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.018609194 = queryNorm
             0.60137665 = fieldWeight in 1967, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=1967)
       0.24 = coord(6/25)
   

4. Goller, C.; Löning, J.; Will, T.; Wolff, W.: Automatic document classification : a thourough evaluation of various methods (2000) 0.12

   0.11565828 = sum of:
     0.11565828 = product of:
       0.5782914 = sum of:
         0.017267473 = weight(abstract_txt:based in 6480) [ClassicSimilarity], result of:
           0.017267473 = score(doc=6480,freq=1.0), product of:
             0.069437146 = queryWeight, product of:
               1.1722424 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.018609194 = queryNorm
             0.24867775 = fieldWeight in 6480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.078125 = fieldNorm(doc=6480)
         0.052391283 = weight(abstract_txt:machine in 6480) [ClassicSimilarity], result of:
           0.052391283 = score(doc=6480,freq=1.0), product of:
             0.12713006 = queryWeight, product of:
               1.2950901 = boost
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.018609194 = queryNorm
             0.41210774 = fieldWeight in 6480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.274979 = idf(docFreq=617, maxDocs=44421)
               0.078125 = fieldNorm(doc=6480)
         0.0784015 = weight(abstract_txt:selection in 6480) [ClassicSimilarity], result of:
           0.0784015 = score(doc=6480,freq=2.0), product of:
             0.13201253 = queryWeight, product of:
               1.3197249 = boost
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.018609194 = queryNorm
             0.59389436 = fieldWeight in 6480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.375318 = idf(docFreq=558, maxDocs=44421)
               0.078125 = fieldNorm(doc=6480)
         0.11883483 = weight(abstract_txt:neural in 6480) [ClassicSimilarity], result of:
           0.11883483 = score(doc=6480,freq=1.0), product of:
             0.2194681 = queryWeight, product of:
               1.7016159 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.018609194 = queryNorm
             0.5414674 = fieldWeight in 6480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.078125 = fieldNorm(doc=6480)
         0.3113963 = weight(abstract_txt:feature in 6480) [ClassicSimilarity], result of:
           0.3113963 = score(doc=6480,freq=2.0), product of:
             0.47750908 = queryWeight, product of:
               4.347377 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.018609194 = queryNorm
             0.65212643 = fieldWeight in 6480, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.078125 = fieldNorm(doc=6480)
       0.2 = coord(5/25)
   

5. Cui, C.; Ma, J.; Lian, T.; Chen, Z.; Wang, S.: Improving image annotation via ranking-oriented neighbor search and learning-based keyword propagation (2015) 0.11

   0.11115954 = sum of:
     0.11115954 = product of:
       0.5557977 = sum of:
         0.15436155 = weight(abstract_txt:nearest in 2609) [ClassicSimilarity], result of:
           0.15436155 = score(doc=2609,freq=4.0), product of:
             0.15159272 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.018609194 = queryNorm
             1.0182649 = fieldWeight in 2609, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.0625 = fieldNorm(doc=2609)
         0.030888997 = weight(abstract_txt:based in 2609) [ClassicSimilarity], result of:
           0.030888997 = score(doc=2609,freq=5.0), product of:
             0.069437146 = queryWeight, product of:
               1.1722424 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.018609194 = queryNorm
             0.4448483 = fieldWeight in 2609, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=2609)
         0.25438204 = weight(abstract_txt:neighbors in 2609) [ClassicSimilarity], result of:
           0.25438204 = score(doc=2609,freq=4.0), product of:
             0.21149977 = queryWeight, product of:
               1.1811792 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.018609194 = queryNorm
             1.2027533 = fieldWeight in 2609, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=2609)
         0.04057785 = weight(abstract_txt:without in 2609) [ClassicSimilarity], result of:
           0.04057785 = score(doc=2609,freq=1.0), product of:
             0.12441563 = queryWeight, product of:
               1.2811893 = boost
               5.2183604 = idf(docFreq=653, maxDocs=44421)
               0.018609194 = queryNorm
             0.32614753 = fieldWeight in 2609, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2183604 = idf(docFreq=653, maxDocs=44421)
               0.0625 = fieldNorm(doc=2609)
         0.07558722 = weight(abstract_txt:effectiveness in 2609) [ClassicSimilarity], result of:
           0.07558722 = score(doc=2609,freq=1.0), product of:
             0.23731463 = queryWeight, product of:
               2.502379 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.018609194 = queryNorm
             0.3185106 = fieldWeight in 2609, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=2609)
       0.2 = coord(5/25)