Aggregating twitter text through generalized linear regression models for tweet popularity prediction and automatic topic classification

Research output: Contribution to journalArticlepeer-review

Full text download(s)

Published copy (DOI)



Publication details

JournalEuropean Journal of Investigation in Health, Psychology and Education
DateAccepted/In press - 23 Nov 2021
DatePublished (current) - 26 Dec 2021
Issue number4
Original languageEnglish


Social media platforms have become accessible resources for health data analysis. How-ever, the advanced computational techniques involved in big data text mining and analysis are chal-lenging for public health data analysts to apply. This study proposes and explores the feasibility of a novel yet straightforward method by regressing the outcome of interest on the aggregated influence scores for association and/or classification analyses based on generalized linear models. The method reduces the document term matrix by transforming text data into a continuous summary score, thereby reducing the data dimension substantially and easing the data sparsity issue of the term matrix. To illustrate the proposed method in detailed steps, we used three Twitter datasets on various topics: autism spectrum disorder, influenza, and violence against women. We found that our results were generally consistent with the critical factors associated with the specific public health topic in the existing literature. The proposed method could also classify tweets into different topic groups appropriately with consistent performance compared with existing text mining methods for automatic classification based on tweet contents.

Bibliographical note

Publisher Copyright:
© 2021 by the authors.

    Research areas

  • Document term matrix, Hurdle model, Odds ratio, Regression, Relative risk, Social network, Text data

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations