Journal List > J Korean Med Sci > v.36(48) > 1148726

Saud, Traboco, and Gupta: Harnessing the True Power of Altmetrics to Track Engagement

Abstract

Altmetrics has recently been at the forefront of tracking medical literature propagation on social media in the modern era. With the rapidly evolving landscape of social media for academia, there's room to revise the approach. The authors discuss current limitations and suggest changes to make online attention trackers more robust and wholesome. Medical literature propagated on currently popular social media platforms like Instagram or TikTok are not accounted for by altmetrics. For altmetrics to become a more robust tool it is vital that it keeps up with the times and accounts for representation of data from these platforms as well. Greater inclusivity, dynamic weightage of different social media platforms based on location dependant availability and usage, and period re-evaluation based on prevailing trends may help metrics reflect the true attention garnered by published research. Besides, development of hybrid scores with separate components to reflect online attention and traditional citations may provide readers a more fair and balanced perception of the actual importance of an article. With the changes proposed, altmetrics has the potential to become a much more inclusive and reflective tool in times to come.

Young doctors and researchers are avid users of social media and have a florid online presence, and the ongoing pandemic has increasingly brought them to realize the potential of these platforms in disseminating medical literature and promoting health and safety behaviours.1 Measures of online attention such as altmetrics are the new norm in visibility, although changing times may require such measures to adapt and evolve, in keeping with fast paced developments in science, technology, and its acceptance by the world.
Traditionally, citations are considered to be the prime metric of visibility and utility in science.2 However, recently, with the unescapable reality of social media, the world has adapted to the rapidity and reach of online platforms for dissemination.3 Thus, it is widely acknowledged that online attention garnered by a published article on the different social media platforms combined may be a better indicator of visibility. In such times, it is vital that online metrics of attention keep up with the pace of the current times, which may call for them to continuously adapt and blend with the trends of social media use. Greater inclusivity, dynamic weightage of different social media platforms, and period re-evaluation based on prevailing trends may help metrics such as altmetric attention score (AAS) reflect the true attention garnered by published research.456 In this brief, the authors discuss evolving trends of social media use and propose measures to be adapted for online bibliometrics in keeping with current times.
Altmetrics is a tool that has been gaining popularity in the last decade since its introduction in 2012.7 It is a complementary metric used to measure reader behaviour as well as interactions with content and social media.8 Altmetrics gives an output score based on 3 factors, volume, sources, and authors, which is collectively known as the AAS. Among the three factors, volume—determines the number of mentions an article receives from each author and source, sources—affects the score depending on the type of source (where some sources like newspaper publication translates to a higher score than others such as blogs), and authors—bases the score on the credibility and conflict of interest of the author where a higher score may be received if a personal account cites the article in comparison to journals citing their own articles.
Attention and citability are two different metrics but both equally important. While attention depends on the amount of social media activity an article receives, citability, refers to the number of times the article is shared by someone else. It has been reported extensively that newly published articles have lower citation rates but higher altmetric scores and older articles will likely have higher citation rates but lower altmetric scores.9 This is because newer articles start receiving attention as soon as they are posted in the global sphere that is social media. The views and amount of interaction on social media is much greater than the amount of views on journal websites simply due to the open accessibility and convenience of social media platforms. This leads to altmetric scores that are higher as there is more reach but citations will build up over time once researchers evaluate the research article and incorporate it into their researches if they find it relevant to their work. Furthermore, journals that are more adept at promoting their research papers on social media will consequently have higher altmetric scores than those who are not. It may be of interest to the medical community if altmetrics data was split into two metrics, one AAS metric that is purely for attention and another for citability. Hence, journals may be able to use the latter as it may be a more rigid criterion for measuring the importance of an article than attention alone which is determined and influenced greatly by social media trends and social media personalities of influence. Furthermore, higher initial altmetric scores have shown to correlate with higher citation count, and thus it is paramount that all articles are treated fairly and the credibility of the research itself does not go down simply due to low AASs.1011 Hence, dichotomized ‘altmetric -attention’ and ‘altmetric-citation’ metics should both be reported as separate entities while working hand in hand as two unique altmetric scores so that the readers can judge and gauge the importance of the article based on both attention and citation metrics separately rather than attention alone. Altmetrics when combined with traditional metrics can enhance and supplement the readers perception of the actual importance of an article and can help identify the salient articles from other less relevant research. This combined use can also help to promote educational and research articles.1213
Altmetrics track sites such as Mendeley, CiteULike, Zotero, and Wikipedia.14 Social media sites like Pinterest, Twitter, Facebook, Reddit, and Linkedin are also measured by altmetrics.14 At the moment, altmetrics does not support or obtain data from popular social media platforms such as TikTok and Instagram. A comparison between TikTok and Instagram is shown in Fig. 1. TikTok is a platform used by many to make creative, educational, or comedic short videos with over 1 billion downloads since its global release in September 2017. Sixty-four percent of the users are under 24 years of age.15 This is relevant to medical students as they can see videos from doctors and healthcare professionals.15
Even healthcare professionals utilize TikTok to disseminate information to the general public often creating content that can resonate with the younger generations.16 Accounts like @dermdoctor make videos explaining different skin conditions, recommending skincare products with scientific evidence. Another doctor on TikTok, @brianboxerwachlermd, reacts to videos and educated viewers by critiquing hoax medical videos, exposing myths from facts. These educational videos are beneficial to all users and have gained popularity in the last 4 years. Medically relevant hashtags such as Coronavirus (111.9B views), dermatologist (3.2B views), medical (6.7B views) and rheumatology (395.6K views) have gained a lot of views. Thus, tracking TikTok interactions with medically relevant literature for AAS would be the next relevant step.
TikTok achieves user interaction and participation by employing tools such as duet, stitch, share and an option to like videos. A duet is when a creator replies to a TikTok and both their and the original video shows up side by side. A stitch is when creators can use a clip from a video in conjunction to their own. In both cases the creator of the original video is credited. TikTok can be a powerful platform for researchers to promote and spread awareness of their research and findings while altmetrics can track the duet, stitch, likes, and shares that a video discussing medical literature receives.
Instagram is another popular social media platform that would benefit from tracking by altmetrics. Since its release in October 2010, Instagram has over 1 billion downloads. Studies have shown that 90% of the users are under the age of 35.17 Educational posts are being made daily, many of which are related to medical topics which have been popular among medical students.18
A great number of posts have been made under medical related hashtags such as, Coronavirus (35.8M posts), dermatologist (1M posts), medical (7.5 M posts), and rheumatology (55.9K posts).
Accounts like @the_rheumatologypost post content related to rheumatology, such as ways to complement arthritis treatments. By using social media platforms such as Instagram, rheumatologists can reach a vast audience immediately such as their patients, students, or even researchers.19 Medical journals like @NEJM (The New England Journal of Medicine) have come on board the app and successfully gathered over 461K followers. Posts relating to clinical cases with pictures to guess the diagnosis are popular. This educates the users, while providing them a quick overview of medical research which can be accessed as full-text links in bios as and when required. Instagram has also been used by national public health agencies such as @cdcgov, the official account of the Centers for Disease Control and Prevention is the public health agency of the United States to dispel misinformation, and post credible health and safety updates for the lay public. Such initiatives have become the need of the hour while dealing with a massive infodemic and widespread misinformation in these sensitive times.20 Some fields of medicine such as dermatology, pathology, physical medicine and rehabilitation (PMR), radiology, and rheumatology are heavily reliant on imaging, making Instagram an amazing platform for the creation of such posts.18 The rheumatology community also uses live streams on social media platforms such as Facebook or Twitter to broadcast their events which allows the audience watching to have a live discussion during the event.21 A recent study showed that Instagram offers great opportunity for journals to establish their presence with the use of quality content, videos, and interactive posts. The current landscape of Instagram in academia is rapidly evolving for research and education in rheumatology.22
A newer feature on Instagram, Reels, launched in August 2020 has also been used to make medical related short videos for educational purposes. These are especially beneficial for medical fields like dermatology, pathology and PMR that rely heavily on visual content to teach and educate the public.23 Altmetrics could track the amount of times a post relating to medical literature has been liked, shared, saved, and the amount of reach the post has received. Other considerations in relation to the use of altmetrics are highlighted in Fig. 2.
Other suggestions for enhancing the performance of altmetrics include selective score weightage depending on the distribution of social media use per country. There are countries where Facebook or Twitter is limited or less popular, their medical discourse happens in other social media sites. In some countries, Twitter is a popular platform for medical discussions.24 In these countries, altmetrics can be far more reflective of attention if the weightage of articles posted on Twitter was higher than those posted on Facebook for example which is less popular for medical literature publishing than Twitter. If there are more Facebook users in Eastern Europe, then Facebook could be given higher weightage in that part of the world. Hence, taking into account geographical variables could make altmetrics a much more robust tool.5
University students and the younger generation are avid users of social media with approximately 80% having at least one social media account.2526 As such, much of the information they have been getting regarding coronavirus disease 2019 (COVID-19) during the pandemic has been through social media. Studies on the health beliefs model in university students in China showed that even as COVID-19 infections were on a decline, university students reported a high perceived risk of COVID infection. They also reported high self -efficacy in withholding COVID-19 guidelines and measures, showing that social media had been having a prominent impact in keeping people adherent to social distancing and preventative guidelines even when COVID restrictions had been lifted.
It is also well known that news travels fast on social media. Social media trends may become popular even before local and national news outlets present on such stories. People had already begun talking about an unknown respiratory disease on social media even before the world came to know of COVID-19. Researchers can share their newly published work, societies release their guidelines and recommendations on Twitter before it reaches email subscriptions or even hardcopy printouts by post. Hence, keeping an eye on what is trending can give us a good idea of what is happening around the globe. Altmetrics may benefit from tracking trends and suggesting what relevant literature people should read on so they remain informed. Allocating special subgroup scores, on information which is new, credible, and deserves higher priority for readers may go a long way in tackling misinformation, and easing out a global discussing on health.5 Real time discussion data and feedback can be evaluated as well. It should be noted that, public engagement or trends can be controversial in terms of determining scientific value or deciding changes in practice or policy.26
Deep learning technology or artificial intelligence can help in this detail by improving the way we look at altmetrics. The usual altmetric scores show the amount of attention and influence, but context can be helpful for the discerning researcher. The Brooklyn project called Scite (https://scite.ai) uses AI to display the context of the citation and if there is contrasting or supporting evidence. It's metrics badge can likewise show editorial notices.2728 This feature could be more crucial now in light of certain literature that trend or go viral, and then are eventually retracted. Another interesting resource is Connected Papers which visually presents as nodes, relevant papers according to similarity in subject matter or references. This means that papers which may not directly cite each other can be easily found.2829 It is not unreported that repeat posting and artificial means have been employed just to increase altmetric scores by people and this is something that altmetics must be aware about.30 Artificial intelligence may assist in recognizing if excessive citations are being made thought the same source. In this case it can assure that the altmetric score is not affected when there are repeat posts on the same website or source.
In summary, social media sites are continuously evolving with new platforms emerging every few years. Researchers and medical professionals are increasingly discovering the benefits of promoting their articles and research findings on widely-viewed platforms like TikTok and Instagram as they can receive thousands of views within hours. While promoting is indeed important, communicating it in an easily understandable manner to the general public is also another challenge. Altmetrics has been a powerful tool to gauge user interaction and reach of published medical literature and mentions of the literature on social media, however, it needs to be flexible enough to evolve with the times. Furthermore, creating two separate metric scores for attention and citability can help appease the needs for researchers and publishers. Altmetrics scores must also account for geographic differences in social media platform popularity by means of selective weightage-by-country so the score given is a better indicator of social media attention. These amendments, if employed, could potentially enhance the breadth and scope of altmetrics in the current generation of social media and provide a better indicator of how well an article is being received by people worldwide.

Notes

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

  • Writing - original draft: Saud S.

  • Writing - review & editing: Traboco L, Gupta L.

References

1. Gaur PS, Gupta L. Changing research paradigm in the face of a global pandemic: foreseeable impact and adaptive measures in academic research in the future. Proc Shevchenko Sci Soc: Med Sci. 2020; 62(2):62–68.
crossref
2. Patthi B, Prasad M, Gupta R, Singla A, Kumar JK, Dhama K, et al. Altmetrics - a collated adjunct beyond citations for scholarly impact: a systematic review. J Clin Diagn Res. 2017; 11(6):ZE16–ZE20. PMID: 28764311.
crossref
3. Gupta L, Gadiwala SF. Coping with the coronavirus disease-2019 pandemic: a giant leap towards digital transformation in academic research. Indian J Rheumatol. 2021; 16(2):123–126.
crossref
4. Thelwall M. The pros and cons of the use of altmetrics in research assessment. Sch Assess Rep. 2020; 2(1):2.
crossref
5. Ganatra K, Gasparyan AY, Gupta L. Modern health journalism and the impact of social media. J Korean Med Sci. 2021; 36(22):e162. PMID: 34100565.
crossref
6. García-Villar C. A critical review on altmetrics: can we measure the social impact factor? Insights Imaging. 2021; 12(1):92. PMID: 34215935.
crossref
7. Kavadichanda C. Journal metrics: different from author metrics. Indian J Rheumatol. 2020; 15(3):149–154.
8. Measuring research impact: altmetrics. Updated 2020. Accessed July 11, 2021. https://guides.lib.berkeley.edu/researchimpact/altmetrics .
9. Studenic P, Ospelt C. Do you tweet?: trailing the connection between Altmetric and research impact! RMD Open. 2020; 6(3):e001034. PMID: 32948665.
crossref
10. Kunze KN, Polce EM, Vadhera A, Williams BT, Nwachukwu BU, Nho SJ, et al. What is the predictive ability and academic impact of the altmetrics score and social media attention? Am J Sports Med. 2020; 48(5):1056–1062. PMID: 32109148.
crossref
11. Kocyigit BF, Akyol A. Bibliometric and altmetric analyses of publication activity in the field of Behcet's disease in 2010–2019. J Korean Med Sci. 2021; 36(32):e207. PMID: 34402225.
crossref
12. Gasparyan AY, Yessirkepov M, Voronov AA, Koroleva AM, Kitas GD. Comprehensive approach to open access publishing: platforms and tools. J Korean Med Sci. 2019; 34(27):e184. PMID: 31293109.
crossref
13. Holmberg K, Park HW. An altmetric investigation of the online visibility of South Korea-based scientific journals. Scientometrics. 2018; 117(1):603–613.
crossref
14. Altmetrics. Updated 2021. Accessed July 11, 2021. https://unimelb.libguides.com/altmetrics/socialmedia .
15. Nikookam Y, Guckian J. TikTok™ and dermatology: lessons for medical education. Clin Exp Dermatol. 2021; 46(5):952–953. PMID: 33638998.
crossref
16. Bruno CM. A content analysis of how healthcare workers use TikTok. Elon J Undergrad Res Commun. 2020; 11(2):5–16.
17. Douglas NKM, Scholz M, Myers MA, Rae SM, Elmansouri A, Hall S, et al. Reviewing the role of Instagram in education: can a photo sharing application deliver benefits to medical and dental anatomy education? Med Sci Educ. 2019; 29(4):1117–1128. PMID: 34457591.
crossref
18. Khan H, Gasparyan AY, Gupta L. Lessons learned from publicizing and retracting an erroneous hypothesis on the mumps, measles, rubella (MMR) vaccination with unethical implications. J Korean Med Sci. 2021; 36(19):e126. PMID: 34002546.
crossref
19. Zimba O, Gasparyan AY. Social media platforms: a primer for researchers. Reumatologia. 2021; 59(2):68–72. PMID: 33976459.
20. Gupta L, Gasparyan AY, Misra DP, Agarwal V, Zimba O, Yessirkepov M. Information and Misinformation on COVID-19: a cross-sectional survey study. J Korean Med Sci. 2020; 35(27):e256. PMID: 32657090.
crossref
21. Zimba O, Radchenko O, Strilchuk L. Social media for research, education and practice in rheumatology. Rheumatol Int. 2020; 40(2):183–190. PMID: 31863133.
crossref
22. Bhatia A, Gaur PS, Zimba O, Chatterjee T, Nikiphorou E, Gupta L. The untapped potential of Instagram to facilitate rheumatology academia. Clin Rheumatol. 2021.
crossref
23. Haldule S, Davalbhakta S, Agarwal V, Gupta L, Agarwal V. Post-publication promotion in rheumatology: a survey focusing on social media. Rheumatol Int. 2020; 40(11):1865–1872. PMID: 32920728.
crossref
24. Koçyiğit BF, Akyol A. Altmetrics and citation metrics as complementary indicators for research management. Central Asian J Med Hypotheses Ethics. 2021; 2(2):79–84.
25. Lin Y, Hu Z, Alias H, Wong LP. Influence of mass and social media on psychobehavioral responses among medical students during the downward trend of COVID-19 in Fujian, China: cross-sectional study. J Med Internet Res. 2020; 22(7):e19982. PMID: 32584779.
crossref
26. Kalasi R. The impact of social networking on new age teaching and learning: an overview. J Educ Soc Policy. 2014; 1(1):23–28.
27. Altmetric Youtube Channel. What are ‘altmetrics’? Updated 2021. Accessed August 4, 2021. https://www.youtube.com/watch?v=SkHhKZkbDys .
28. Scite_: about us. Updated 2021. Accessed August 5, 2021. https://help.scite.ai/en-us/ .
29. Connected Papers. About us. Updated 2021. Accessed August 5, 2021. https://www.connectedpapers.com/about .
30. Gasparyan AY, Yessirkepov M, Voronov AA, Maksaev AA, Kitas GD. Article-level metrics. J Korean Med Sci. 2021; 36(11):e74. PMID: 33754507.
crossref
Fig. 1

Comparison and contrast between Instagram and TikTok.

jkms-36-e330-g001
Fig. 2

Infographic summary on harnessing altmetrics.

jkms-36-e330-g002
TOOLS
Similar articles