Background: Twitter journal clubs are a modern way of highlighting articles published in a scientific journal. The Neurocritical Care journal (NCC) initiated a bimonthly, Twitter-based, online journal club in 2015 to increase the outreach of its published articles. We hypothesize that articles included in the Neurocritical Care Society Twitter Journal Club (NCSTJC) had greater engagement than other articles published during the same time period. We also investigated the relationship between number of citations and Altmetric score to assess whether the enhanced online activity resulted in higher citations.
Methods: We gathered data in August 2020 on engagement metrics (number of downloads, Altmetric score, relative citation ratio, and number of citations) of all articles published in NCC between 2015 and 2018. Articles were analyzed into two groups: one featured in NCSTJC and the rest that were not (non-NCSTJC1), and the other comprised those that were not in NCSTJC but published under a similar category of articles as NCSTJC (non-NCSTJC2). Results were analyzed using descriptive statistics, and summary measures were used to report the spread. The groups were compared by using the Wilcoxon rank sum test, given that the data were not normally distributed. Spearman's rank correlation was used to assess correlation between Altmetric score and citations for the articles in the NCSTJC and non-NCSTJC groups. For comparison, the top ten cited articles in NCC were analyzed for similar correlations.
Results: Between 2015 and 2018, NCC published 529 articles, 24 of which were included in the Twitter journal club. A total of 406 articles were published in the same category as the category of articles selected for NCSTJC. The articles discussed as a part of NCSTJC had a statistically significant trend toward a higher number of downloads, Altmetric score, relative citation ratio, and number of citations than rest of the articles published in the journal during the same time period and the rest of the articles published in same categories. Three NCSTJC articles were among the ten most-cited articles published by NCC between 2015 and 2018. We did not find a correlation between Altmetric scores and number of citations in the NCSTJC or non-NCSTJC1 or non-NCSTJC2 group, but there was a strong correlation between these two variables in high performing articles when the top ten cited articles were analyzed.
Conclusions: Scientific journals are evolving their social media strategies in attempt to increase the outreach of their articles to the medical community. Platforms such as Twitter journal clubs can enhance such engagement. The long-term influence of such strategies on the impact factor of a medical journal and traditional engagement metrics, such as citations, calls for further research.
Keywords: Altmetric; Impact factor; Social media; Twitter; Twitter journal club.
© 2022. Springer Science+Business Media, LLC, part of Springer Nature and Neurocritical Care Society.