The evolution and future directions of altmetrics research in computer science: A scoping review and bibliometric analysis

Authors

DOI:

https://doi.org/10.47909/ijsmc.260

Keywords:

altmetrics, alternative metrics, scoping review, bibliometric analysis, research impact

Abstract

Objective. The primary objective of this study was to analyze research performance and identify potential future research related to altmetrics in the last decade.

Methodology. The dataset employed in this study was derived from the Scopus database. The PRISMA flow diagram was utilized during the data collection phase. The results of the bibliometric analysis were used to describe research performance and extract future work and directions. The method known as scoping review and bibliometric analysis (ScoRBA) was used to achieve these goals.

Results. The dataset under consideration encompassed a total of 478 titles, derived from a sample of 93 journals. The Scientometrics journal was the primary source of information disseminating various research results in the field of altmetrics, followed by the Journal of Informetrics. Wang X. was an active and consistent contributor to the field of altmetrics, publishing studies related to the subject between 2015 and 2024. The results of the co-occurrence analysis of author keywords yielded three cluster themes from the altmetrics research. A close examination of the extant literature revealed the emergence of three cluster themes related to altmetrics research: (1) measurement and social impact of research, (2) impact of research through traditional and alternative metrics, and (3) the role of artificial intelligence (AI) and social media in impact analysis and dissemination of research. It was evident that the subjects of social impact and machine learning were intricately intertwined, constituting a multifaceted and evolving research domain characterized by dynamic developments and ongoing advancements.

Conclusion. The study concluded that the altmetrics field had reached a stage of maturity, with a shift in focus from exploratory expansion to more in-depth, high-impact studies. In light of these findings, future research should concentrate on expanding data sources, refining tracking methods, and developing more sophisticated AI-driven models that can integrate both traditional and alternative metrics to achieve a truly holistic understanding of research impact.

Downloads

Download data is not yet available.

References

Ahmed, F., & Hussainey, K. (2023). A bibliometric analysis of political connections literature. Review of Accounting and Finance, 22(2), 206–226. https://doi.org/10.1108/RAF-11-2022-0306 DOI: https://doi.org/10.1108/RAF-11-2022-0306

Alhoori, H., & Furuta, R. (2014). Do altmetrics follow the crowd or does the crowd follow altmetrics? In IEEE/ACM Joint Conference on Digital Libraries (pp. 375–378). IEEE. https://doi.org/10.1109/JCDL.2014.6970193 DOI: https://doi.org/10.1109/JCDL.2014.6970193

Amiri, M. R., Saberi, M. K., Ouchi, A., Mokhtari, H., & Barkhan, S. (2023). Publication performance and trends in altmetrics: A bibliometric analysis and visualization. International Journal of Information Science and Management, 21(1), 95–115. https://doi.org/10.22034/ijism.2022.1977686.0

Aria, M., & Cuccurullo, C. (2017). bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007 DOI: https://doi.org/10.1016/j.joi.2017.08.007

Arroyo-Machado, W., & Torres-Salinas, D. (2024). Stranger things: The vanishing of the Altmetric Attention Score values in information and library science. Scientometrics, 129(10), 6287–6300. https://doi.org/10.1007/s11192-024-05011-5 DOI: https://doi.org/10.1007/s11192-024-05011-5

Biswas, P. (2019). Altmetrics: Its trend and application in knowledge information centres. In A. Kaushik, A. Kumar, & P. Biswas (Eds.), Handbook of research on emerging trends and technologies in library and information science (pp. 119–131). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-5225-9825-1.ch009 DOI: https://doi.org/10.4018/978-1-5225-9825-1.ch009

Borgohain, D. J., Yuvaraj, M., & Verma, M. K. (2024). Analysing the relationship between altmetric attention score (AAS) and citation: A correlational study. Information Discovery and Delivery, 52(1), 11–22. https://doi.org/10.1108/IDD-05-2022-0035 DOI: https://doi.org/10.1108/IDD-05-2022-0035

Bradbury-Jones, C., Aveyard, H., Herber, O. R., Isham, L., Taylor, J., & O’Malley, L. (2022). Scoping reviews: The PAGER framework for improving the quality of reporting. International Journal of Social Research Methodology, 25(4), 457–470. https://doi.org/10.1080/13645579.2021.1899596 DOI: https://doi.org/10.1080/13645579.2021.1899596

Chaubey, A. K. (2017). Bibliometrics to altmetrics: A changing trend. International Journal of Library and Information Studies, 7(4), 193–199.

Cheng, X., Wang, H., Tang, L., Jiang, W., Zhou, M., & Wang, G. (2024). Open peer review correlates with altmetrics but not with citations: Evidence from Nature Communications and PLoS One. Journal of Informetrics, 18(3), Article 101540. https://doi.org/10.1016/j.joi.2024.101540 DOI: https://doi.org/10.1016/j.joi.2024.101540

De Filippo, D., Morillo, F., & González-Albo, B. (2023). Measuring the impact and influence of scientific activity in the humanities and social sciences. Publications, 11(2), 31. https://doi.org/10.3390/publications11020031 DOI: https://doi.org/10.3390/publications11020031

De Filippo, D., & Sastrón-Toledo, P. (2023). Influence of research on open science in the public policy sphere. Scientometrics, 128(3), 1995–2017. https://doi.org/10.1007/s11192-023-04645-1 DOI: https://doi.org/10.1007/s11192-023-04645-1

de Winter, J. (2024). Can ChatGPT be used to predict citation counts, readership, and social media interaction? An exploration among 2222 scientific abstracts. Scientometrics, 129(4), 2469–2487. https://doi.org/10.1007/s11192-024-04939-y DOI: https://doi.org/10.1007/s11192-024-04939-y

Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285–296. https://doi.org/10.1016/j.jbusres.2021.04.070 DOI: https://doi.org/10.1016/j.jbusres.2021.04.070

El Allaoui, H., El Ahmadi, K., El Abdouni, A., Dira, I., El Bastrioui, M., Bouhrim, M., Eto, B., Shahat, A., Herqash, R., & Haboubi, K. (2024). Trends and insights in medicinal plant extract research: A ten-year bibliometric and visualization study. Horticulturae, 10(11), 1163. https://doi.org/10.3390/horticulturae10111163 DOI: https://doi.org/10.3390/horticulturae10111163

Färber, M., & Tampakis, L. (2024). Analyzing the impact of companies on AI research based on publications. Scientometrics, 129(1), 31–63. https://doi.org/10.1007/s11192-023-04867-3 DOI: https://doi.org/10.1007/s11192-023-04867-3

Ghanadinezhad, F., & Ghane, M. R. (2024). Analyzing review studies and bibliometrics of university-industry interaction using scoping review. International Journal of Information Science and Management, 22(3), 85–110. https://doi.org/10.22034/ijism.2024.2022906.1400

Guechairi, S. (2024). Mapping altmetrics: A bibliometric analysis using Scopus (2012-2024). Journal of Science and Knowledge Horizons, 4(01), 172–192. https://doi.org/10.34118/jskp.v4i01.3859 DOI: https://doi.org/10.34118/jskp.v4i01.3859

Gupta, A., Chaudhuri, R., Apoorva, A., Chaudhary, S., Thrassou, A., Sakka, G., & Grandhi, B. (2025). Vicenarian of workplace incivility: A bibliometric analysis and systematic review. EuroMed Journal of Business, 20(1), 52–74. https://doi.org/10.1108/EMJB-08-2022-0143 DOI: https://doi.org/10.1108/EMJB-08-2022-0143

Hook, P. A., & Börner, K. (2005). Educational knowledge domain visualizations: Tools to navigate, understand, and internalize the structure of scholarly knowledge and expertise. In A. Spink & C. Cole (Eds.), New directions in cognitive information retrieval (pp. 187–208). Springer Netherlands. https://doi.org/10.1007/1-4020-4014-8_10 DOI: https://doi.org/10.1007/1-4020-4014-8_10

Jonker, H., Vanlee, F., & Ysebaert, W. (2022). Societal impact of university research in the written press: Media attention in the context of SIUR and the open science agenda among social scientists in Flanders, Belgium. Scientometrics, 127(12), 7289–7306. https://doi.org/10.1007/s11192-022-04374-x DOI: https://doi.org/10.1007/s11192-022-04374-x

Keathley-Herring, H., Van Aken, E., Gonzalez-Aleu, F., Deschamps, F., Letens, G., & Orlandini, P. C. (2016). Assessing the maturity of a research area: Bibliometric review and proposed framework. Scientometrics, 109(2), 927–951. https://doi.org/10.1007/s11192-016-2096-x DOI: https://doi.org/10.1007/s11192-016-2096-x

Khatoon, A., Daud, A., & Amjad, T. (2024). Categorization and correlational analysis of quality factors influencing citation. Artificial Intelligence Review, 57(3). https://doi.org/10.1007/s10462-023-10657-3 DOI: https://doi.org/10.1007/s10462-023-10657-3

Khaw, T. Y., Amran, A., & Teoh, A. P. (2024). Factors influencing ESG performance: A bibliometric analysis, systematic literature review, and future research directions. Journal of Cleaner Production, 448, Article 141430. https://doi.org/10.1016/j.jclepro.2024.141430 DOI: https://doi.org/10.1016/j.jclepro.2024.141430

Koçyiğit, B. F., & Akyol, A. (2021). Altmetrics and citation metrics as complementary indicators for research management. Central Asian Journal of Medical Hypotheses and Ethics, 2(2), 79–84. https://doi.org/10.47316/cajmhe.2021.2.2.01 DOI: https://doi.org/10.47316/cajmhe.2021.2.2.01

Li, H., & Hou, J. (2024). Revalidation of the applicability of Altmetrics indicators in article-level evaluation: An empirical analysis of papers of different types of citation trajectories. Journal of Informetrics, 18(4), Article 101573. https://doi.org/10.1016/j.joi.2024.101573 DOI: https://doi.org/10.1016/j.joi.2024.101573

Liu, Y., & He, H. (2023). Scientometrics of scientometrics based on web of science core collection data between 1992 and 2020. Information, 14(12), 637. https://doi.org/10.3390/info14120637 DOI: https://doi.org/10.3390/info14120637

Liu, Y., Wu, C., Wang, Z., Hu, K., Ding, F., Liu, C., Yi, S., Ruan, J., Luo, Y., Xie, G., & Ma, B. (2024). An introduction of the JBI scoping review execution process. Chinese Journal of Evidence-Based Medicine, 24(8), 986–992. https://doi.org/10.7507/1672-2531.202311060

Maleki, A. (2022a). OCLC library holdings: Assessing availability of academic books in libraries in print and electronic compared to citations and altmetrics. Scientometrics, 127(2), 991–1020. https://doi.org/10.1007/s11192-021-04220-6 DOI: https://doi.org/10.1007/s11192-021-04220-6

Maleki, A. (2022b). Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings. Scientometrics, 127(2), 1129–1160. https://doi.org/10.1007/s11192-021-04239-9 DOI: https://doi.org/10.1007/s11192-021-04239-9

McGillivray, B., Marongiu, P., Pedrazzini, N., Ribary, M., Wigdorowitz, M., & Zordan, E. (2022). Deep impact: A study on the impact of data papers and datasets in the humanities and social sciences. Publications, 10(4), 39. https://doi.org/10.3390/publications10040039 DOI: https://doi.org/10.3390/publications10040039

Melero, R. (2015). Altmetrics—A complement to conventional metrics. Biochemia Medica, 25(2), 152–160. https://doi.org/10.11613/BM.2015.016 DOI: https://doi.org/10.11613/BM.2015.016

Melicherová, M., Ondrišová, M., & Šušol, J. (2021). Bibliometrics versus altmetrics: Researchers’ attitudes in Slovakia. Iberoamerican Journal of Science Measurement and Communication, 1(1), 002. https://doi.org/10.47909/ijsmc.11 DOI: https://doi.org/10.47909/ijsmc.11

Moshtagh, M., Jowkar, T., Yaghtin, M., & Sotudeh, H. (2023). The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: The case of THE and QS vs. Nature Index and Leiden. Scientometrics, 128(1), 761–781. https://doi.org/10.1007/s11192-022-04548-7 DOI: https://doi.org/10.1007/s11192-022-04548-7

Moshtagh, M., & Sotudeh, H. (2023). Correlation between universities’ Altmetric Attention Scores and their performance scores in Nature Index, Leiden, Times Higher Education and Quacquarelli Symonds ranking systems. Journal of Information Science, 49(4), 976–989. https://doi.org/10.1177/01655515211030868 DOI: https://doi.org/10.1177/01655515211030868

Nurliati, G., Romli, M., Cecep Cepi Hikmat, M., Sriwahyuni, H., T.H, N. H., Suryantoro, S., Sulistio Wisnubroto, D., Hario Putero, S., Iskandar, D., Syarbaini, S., Nirwani, L., Sumarbagiono, R., Setiawan, B., Adhi Pratama, H., Efri Ekaningrum, N., Mirawaty, M., Dwi Winarni, I., Muziawati, A., Setiawan, A., … Yusuf, M. (2024). Literature survey and analysis of phytoremediation strategies for Cs-137 decontamination. Nuclear Engineering and Design, 427, Article 113414. https://doi.org/10.1016/j.nucengdes.2024.113414 DOI: https://doi.org/10.1016/j.nucengdes.2024.113414

Olechnicka, A., Ploszaj, A., & Zegler-Poleska, E. (2024). Virtual academic conferencing: A scoping review of 1984–2021 literature. Novel modalities vs. long standing challenges in scholarly communication. Iberoamerican Journal of Science Measurement and Communication, 4(1), 1–31. https://doi.org/10.47909/ijsmc.93 DOI: https://doi.org/10.47909/ijsmc.93

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71 DOI: https://doi.org/10.1136/bmj.n71

Pranckutė, R. (2021). Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications, 9(1), 12. https://doi.org/10.3390/publications9010012 DOI: https://doi.org/10.3390/publications9010012

Priem, J., Groth, P., & Taraborelli, D. (2012). The altmetrics collection. PLOS, 7(11), Article e48753. https://doi.org/10.1371/journal.pone.0048753 DOI: https://doi.org/10.1371/journal.pone.0048753

Rajni, Garg, N., & Jalan, S. (2025). Spiritual leadership research: Past, present and future using bibliometric analysis. Journal of Religion and Health, 64(2), 999–1030. https://doi.org/10.1007/s10943-024-02178-2 DOI: https://doi.org/10.1007/s10943-024-02178-2

Ramezani, A., Ghazimirsaeed, S. J., Ramezani-Pakpour-Langroudi, F., Siamian, H., YektaKooshali, M. H., Papi, A., & Aligolbandi, K. (2023). Ranking of Iranian medical universities based on altmetric indices. Journal of Information Science, 49(6), 1607–1614. https://doi.org/10.1177/01655515211072300 DOI: https://doi.org/10.1177/01655515211072300

Roda-Segarra, J., Mengual-Andrés, S., & Rico, A. P. (2024). Analysis of social metrics on scientific production in the field of emotion-aware education through artificial intelligence. Frontiers in Artificial Intelligence, 7. https://doi.org/10.3389/frai.2024.1401162 DOI: https://doi.org/10.3389/frai.2024.1401162

Sandnes, F. E. (2021). A bibliometric study of human–computer interaction research activity in the nordic-baltic eight countries. Scientometrics, 126(6), 4733–4767. https://doi.org/10.1007/s11192-021-03940-z DOI: https://doi.org/10.1007/s11192-021-03940-z

Sarjidan, M. A., & Kasim, A. (2023). Trends of academic publications: A case study of malaysian research universities. Journal of Research Management & Governance, 5(1), 18–29. https://doi.org/10.22452/jrmg.vol5no1.2 DOI: https://doi.org/10.22452/jrmg.vol5no1.2

Serrano-Vicente, R., Melero, R., & Abadal, E. (2018). Evaluation of Spanish institutional repositories based on criteria related to technology, procedures, content, marketing and personnel. Data Technologies and Applications, 52(3), 384–404. https://doi.org/10.1108/dta-10-2017-0074 DOI: https://doi.org/10.1108/DTA-10-2017-0074

Shafin, N., Ismail, C. A. N., Mustafa, M. Z., Ghani, N., Ahmad, A. H., Othman, Z., Wijaya, A., & Zakaria, R. (2022). Thematic analysis of multiple sclerosis research by enhanced strategic diagram. Multiple Sclerosis Journal, 28(14), 2160–2170. https://doi.org/10.1177/13524585221075542 DOI: https://doi.org/10.1177/13524585221075542

Singh, V. K., Karmakar, M., Kanaujia, A., & Bhattacharya, S. (2024). Social media for science-science and science-society connects: Assessing the readiness in indian context through an analysis of social media visibility of research papers. Journal of Scientometric Research, 13(1), 239–244. https://doi.org/10.5530/jscires.13.1.20 DOI: https://doi.org/10.5530/jscires.13.1.20

Sinha, P. K., Sahoo, S. B., Gajbe, S. B., Chakrabory, K., & Mahato, S. S. (2020). Altmetrics research progress: A bibliometric analysis and visualization. Journal of Scientometric Research, 9(3), 300–309. https://doi.org/10.5530/jscires.9.3.37 DOI: https://doi.org/10.5530/jscires.9.3.37

Taylor, M. (2023). Slow, slow, quick, quick, slow: Five altmetric sources observed over a decade show evolving trends, by research age, attention source maturity and open access status. Scientometrics, 128(4), 2175–2200. https://doi.org/10.1007/s11192-023-04653-1 DOI: https://doi.org/10.1007/s11192-023-04653-1

Thelwall, M., Kousha, K., Abdoli, M., Stuart, E., Makita, M., Wilson, P., & Levitt, J. (2023). Do altmetric scores reflect article quality? Evidence from the UK Research Excellence Framework 2021. Journal of the Association for Information Science and Technology, 74(5), 582–593. https://doi.org/10.1002/asi.24751 DOI: https://doi.org/10.1002/asi.24751

Torres-Salinas, D., Docampo, D., Arroyo-Machado, W., & Robinson-Garcia, N. (2024). The many publics of science: Using altmetrics to identify common communication channels by scientific field. Scientometrics, 129(7), 3705–3723. https://doi.org/10.1007/s11192-024-05077-1 DOI: https://doi.org/10.1007/s11192-024-05077-1

Tsilika, K. (2023). Exploring the contributions to mathematical economics: A bibliometric analysis using bibliometrix and VOSviewer. Mathematics, 11(22), 4703. https://doi.org/10.3390/math11224703 DOI: https://doi.org/10.3390/math11224703

van Eck, N. J., & Waltman, L. (2023). VOSviewer manual: Manual for VOSviewer version 1.6. 20. Centre for Science and Technology Studies (CWTS) of Leiden University.

Verhage, A., & Boels, D. (2017). Critical appraisal of mixed methods research studies in a systematic scoping review on plural policing: Assessing the impact of excluding inadequately reported studies by means of a sensitivity analysis. Quality & Quantity, 51(4), 1449–1468. https://doi.org/10.1007/s11135-016-0345-y DOI: https://doi.org/10.1007/s11135-016-0345-y

Vrettas, G., & Sanderson, M. (2015). Conferences versus journals in computer science. Journal of the Association for Information Science and Technology, 66(12), 2674–2684. https://doi.org/10.1002/asi.23349 DOI: https://doi.org/10.1002/asi.23349

Wiechetek, Ł., & Pastuszak, Z. (2022). Academic social networks metrics: An effective indicator for university performance? Scientometrics, 127(3), 1381–1401. https://doi.org/10.1007/s11192-021-04258-6 DOI: https://doi.org/10.1007/s11192-021-04258-6

Wijaya, A., & Hermawan, B. (2025). BiblioPlot: Enhanced data visualization for bibliometric analysis [Computer software]. https://biblioplot.metlit.net

Wijaya, A., Setiawan, N. A., Ahmad, A. H., Zakaria, R., & Othman, Z. (2023). Electroencephalography and mild cognitive impairment research: A scoping review and bibliometric analysis (ScoRBA). AIMS Neuroscience, 10(2), 154–171. https://doi.org/10.3934/Neuroscience.2023012 DOI: https://doi.org/10.3934/Neuroscience.2023012

Wijaya, A., Setiawan, N. A., & Shapiai, M. I. (2023). Mapping research themes and future directions in learning style detection research: A Bibliometric and content analysis. Electronic Journal of E-Learning, 21(4), 274–285. https://doi.org/10.34190/ejel.21.4.3097 DOI: https://doi.org/10.34190/ejel.21.4.3097

Williams, A. E. (2017). Altmetrics: An overview and evaluation. Online Information Review, 41(3), 311–317. https://doi.org/10.1108/OIR-10-2016-0294 DOI: https://doi.org/10.1108/OIR-10-2016-0294

Xia, W., Li, T., & Li, C. (2023). A review of scientific impact prediction: Tasks, features and methods. Scientometrics, 128(1), 543–585. https://doi.org/10.1007/s11192-022-04547-8 DOI: https://doi.org/10.1007/s11192-022-04547-8

Zhou, Q. (2024). Evaluating book impacts via integrating multi-source reviews. Scientometrics, 129(11), 6931–6946. https://doi.org/10.1007/s11192-024-05174-1 DOI: https://doi.org/10.1007/s11192-024-05174-1

Downloads

Published

2025-11-06

How to Cite

Yanto, A., Fatchur Rochim, A., Parlina, A., Heriyanto, & Setyowati, L. (2025). The evolution and future directions of altmetrics research in computer science: A scoping review and bibliometric analysis. Iberoamerican Journal of Science Measurement and Communication, 6(1), 1–16. https://doi.org/10.47909/ijsmc.260

Issue

Vol. 6 No. 1 (2026)

Section

Review article

License

Copyright (c) 2025 Andri Yanto, Adian Fatchur Rochim; Anne Parlina; Heriyanto, Lis Setyowati

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

This is an open access article distributed under the terms of the CC BY-NC 4.0, which permits copying and redistributing the material in any medium or format, adapting, transforming, and building upon the material as long as the license terms are followed.

Funding data