Evaluation and impact of descriptive metadata on academic event management in Ukraine: A quantitative study

Authors

DOI:

https://doi.org/10.47909/ijsmc.91

Keywords:

academic events, conference management, descriptive metadata, Ukrainian legislation

Abstract

Objective. The study aims to understand the impact of descriptive metadata in academic events. It focuses on the need for analytical frameworks that consider the events' characteristics and the interests of the participants.

Design/Methodology/Approach. The article focuses on academic event management and metadata quality based on user preferences and feedback. It surveyed Ukrainian organizers and scholars between August and October 2022, analyzing the responses of 1,270 participants using descriptive statistics and qualitative analysis in RStudio.

Results/Discussion. The survey showed that most (over 84%) of organizers and academics are dissatisfied with the metadata quality, with a third rating it as very bad. Frequent errors in metadata emphasized the need for better management, including a preference for using identifiers like ORCID and DOI and a preference for open access to information about academic events.

Conclusions. The results highlight the importance of developing specialized tools for metadata management and standardization of metadata elements in Ukraine to facilitate organization and participation in academic events at national and international levels.

Originality/Value. The study makes an important contribution to understanding descriptive metadata management in academic events in Ukraine, suggesting ways to improve efficiency in this area.

Downloads

Download data is not yet available.

References

Hillmann, D. I., and Westbrooks, E. L. (2004). Introduction to Metadata in Practice. Faculty Publications, UNL Libraries. Paper 166. Retrieved from http://digitalcommons.unl.edu/libraryscience/166.

Gamble, M., and Goble, C. (2011). Quality, trust, and utility of scientific data on the web: Toward a joint model. In Proceedings of the 3rd International Web Science Conference (WebSci '11). New York, NY, USA: Association for Computing Machinery. Article 15, 1–8. https://doi.org/10.1145/2527031.2527048 DOI: https://doi.org/10.1145/2527031.2527048. DOI: https://doi.org/10.1145/2527031.2527048

Hauschke, C., Nazarovets, S., Altemeier, F., and Kaliuzhna, N. (2021). Roadmap to FAIR Research Information in Open Infrastructures. Journal of Library Metadata, 21(1–2), 45–61. https://doi.org/10.1080/19386389.2021.1999156 DOI: https://doi.org/10.1080/19386389.2021.1999156. DOI: https://doi.org/10.1080/19386389.2021.1999156

Government of Ukraine. (2022). Government Resolution "On Approval of the National Plan regarding Open Science," No. 892-r, October 8, 2022, Kyiv. Retrieved from https://zakon.rada.gov.ua/laws/show/892-2022-%D1%80#Text.

International Federation of Library Associations and Institutions. (2017). IFLA annual report. IFLA.

Driscoll, J. C., and Kraay, A. (1995, December). Spatial Correlations in Panel Data. World Bank Policy Research Working Paper No. 1553. Retrieved from https://ssrn.com/abstract=604938.

Denzin, N. K., and Lincoln, Y. S. (2011). The SAGE Handbook of Qualitative Research. SAGE Publications.

Flick, U. (2018). The sage handbook of qualitative data collection. SAGE Publications Ltd. https://doi.org/10.4135/9781526416070 DOI: https://doi.org/10.4135/9781526416070. DOI: https://doi.org/10.4135/9781526416070

Auhunas, S., Zharinova, A., and Kaliuzhna, N. (2022). Descriptive metadata management for scientific events and conferences registration in Ukraine. https://doi.org/10.35668/978-966-479-129-5-1-10 DOI: https://doi.org/10.35668/978-966-479-129-5-1-10. DOI: https://doi.org/10.35668/978-966-479-129-5-1-10

Government of Ukraine. (2016). On Scientific and Scientific-Technical Activities. The Official Bulletin of the Verkhovna Rada of Ukraine (BVR), (3), Art. 25. Retrieved from https://zakon.rada.gov.ua/laws/show/848-19.

Institute for Educational Content Modernization. (n.d.). Letters from the Ministry of Education and Science of Ukraine. Retrieved from https://imzo.gov.ua/dokumenti/listi-mon-ukrayini/.

Government of Ukraine. (2014). On Higher Education. The Official Bulletin of the Verkhovna Rada (BVR), (37–38), Article 2004. Retrieved from https://zakon.rada.gov.ua/laws/show/1556-18#Text.

Cabinet of Ministers of Ukraine. (2023). On approval of the Procedure for awarding academic degrees. Draft Resolution. Retrieved from http://dochub.com.ua/sites/default/files/unitattachments/2017/29/poryadok_prisudzhennya_proekt_7.pdf.

Ministry of Justice of Ukraine. (2019). On Approval of the Procedure for Credit Accrual of ECTS based on the Results of Professional Training. National Agency of Ukraine on Civil Service Order (No. 1288/34259). Retrieved from https://zakon.rada.gov.ua/laws/show/z1288-19#Text.

Cabinet of Ministers of Ukraine. (2021). On Approval of the Regulation on the System of Continuous Professional Development of Healthcare Workers (No. 725). Retrieved from https://zakon.rada.gov.ua/laws/show/725-2021-%D0%BF#Text.

Ministry of Education and Science of Ukraine. (2017). On Approval of the Requirements for Dissertation Design (Order No. 40). Retrieved from http://zakon2.rada.gov.ua/laws/show/z0155-17.

Cabinet of Ministers of Ukraine. (2013). On approval of the Procedure for awarding academic degrees (No. 567). Retrieved from http://search.ligazakon.ua/l_doc2.nsf/link1/KP130567.html.

Biriukov, O.V., Zelenska, V.V., and Zakharova, N.O. (2017). Scientific and communication activities and approbation of scientific results: definition, content, purpose. Project management and production development, 3(63), 76-96.

Ministry of Health of Ukraine. (n.d.). Measures of continuous development of doctors and pharmaceutical workers. Retrieved from https://docs.google.com/spreadsheets/d/1AB2o9b8C3xzqdrhc-kjBp3Rqmb1xe5lY/edit#gid=1172350021.

Testing Center. (n.d.). Continuing professional development of healthcare professionals. Retrieved from https://www.testcentr.org.ua/uk/bpr.

Ukrainian Institute of Scientific and Technical Expertise and Information. (n.d.). Retrieved from http://www.uintei.kiev.ua/.

Kaliuzhna, N., and Auhunas, S. (2022). Research Information Infrastructure in Ukraine: First steps toward building a national CRIS. In Procedia Computer Science, 211, 230-237. https://doi.org/10.1016/j.procs.2022.10.196. DOI: https://doi.org/10.1016/j.procs.2022.10.196

Creswell, J. W., and Creswell, J. D. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications.

Register of educational entities Institutions of higher, specialized pre-higher and professional (vocational) education https://registry.edbo.gov.ua/opendata/universities/?ut=1.

Cabinet of Ministers of Ukraine. (2015). On Approval of the List of Fields of Knowledge and Specialties for Training of Higher Education Applicants (Resolution No. 266 of April 29, 2015). Retrieved from https://zakon.rada.gov.ua/laws/show/266-2015-%D0%BF?lang=en#Text.

R Core Team. (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.

Wickham, H. (2016). ggplot2: Elegant graphics for data analysis (2nd ed.). Springer Cham. https://doi.org/10.1007/978-3-319-24277-4 DOI: https://doi.org/10.1007/978-3-319-24277-4. DOI: https://doi.org/10.1007/978-3-319-24277-4

Larsson, J. (2018). eulerr: Area-proportional Euler diagrams with ellipses. Retrieved from http://lup.lub.lu.se/student-papers/record/8934042.

OpenRefine. (2023). Retrieved from https://openrefine.org/.

Mirahmadizadeh, A., Delam, H., Seif, M., and Bahrami, R. (2018). Designing, constructing, and analyzing Likert scale data. Journal of Education and Community Health. https://doi.org/10.21859/JECH.5.3.63 DOI: https://doi.org/10.1007/978-3-319-24277-4. DOI: https://doi.org/10.21859/jech.5.3.63

Adesola, Z., and Musa. (2017). Statistical issues II: Chi-Square test statistics.

Raven, R., Hadfield, P., Butler, B., and Eagleton, J. (2023). Transitioning to sustainable academic conferences needs more experimentation and reflection. Global Sustainability, 6, 1-5. https://doi.org/10.1017/sus.2023.15 DOI: https://doi.org/10.1017/sus.2023.15. DOI: https://doi.org/10.1017/sus.2023.15

Lackner, A., Fathalla, S., Nayyeri, M., Behrend, A., Manthey, R., Auer, S., Lehmann, J., and Vahdati, S. (2021). Analyzing the evolution of computer science events leveraging a scholarly knowledge graph: A scientometrics study of top-ranked events in the past decade. Scientometrics, 126(9), 8129–8151. https://doi.org/10.1007/s11192-021-04072-0 DOI: https://doi.org/10.1007/s11192-021-04072-0. DOI: https://doi.org/10.1007/s11192-021-04072-0

Bryl, V., Birukou, A., Eckert, K., and Kessler, M. (2014). What's in the proceedings? Combining publisher's and researcher's perspectives. Proceedings of the 4th Workshop on Semantic Publishing. Retrieved from https://ceur-ws.org/Vol-1155/paper-01.pdf.

Hauss, K. (2020). What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany. Research Evaluation, 30(1), 1–12. Oxford University Press (OUP). https://doi.org/10.1093/reseval/rvaa018 DOI: https://doi.org/10.1093/reseval/rvaa018. DOI: https://doi.org/10.1093/reseval/rvaa018

Porter, S. (2016). Digital Science White Paper: A New ‘Research Data Mechanics’. Retrieved from https://doi.org/10.6084/M9.FIGSHARE.3514859.V1.

Choudhury, M. H., Salsabil, L., Jayanetti, H., et al. (2023). MetaEnhance: Metadata Quality Improvement for Electronic Theses and Dissertations of University Libraries. ArXiv. doi: 10.48550/arxiv.2303.17661. DOI: https://doi.org/10.1109/JCDL57899.2023.00019

Kaur, A., Usama, M., and Wong Hooi Ten, D. (2023). Literature Review on Metadata Governance. Open International Journal of Informatics, 11(1), 114-120. DOI: https://doi.org/10.11113/oiji2023.11n1.235

Rowell, C. J. (2016). Metadata standards and web services in libraries, archives, and museums: An active learning resource. Technical Services Quarterly, 33(3), 347-349. https://doi.org/10.1080/07317131.2016.1169861 DOI: https://doi.org/10.1080/07317131.2016.1169861. DOI: https://doi.org/10.1080/07317131.2016.1169861

Pavluković, V., and Cimbaljević, M. (2020). Factors affecting conference participation decision-making. Journal of the Geographical Institute Jovan Cvijic SASA, 70(1), 31-43. https://doi.org/10.2298/IJGI2001031p DOI: https://doi.org/10.2298/IJGI2001031p. DOI: https://doi.org/10.2298/IJGI2001031P

Aktas, G., and Demirel, B. (2019). The genuine needs of conference attendees: an analysis by the modern quality function deployment. International Journal for Quality Research, 13(1), 13–32. https://doi.org/10.24874/IJQR13.01-02 DOI: https://doi.org/10.24874/IJQR13.01-02. DOI: https://doi.org/10.24874/IJQR13.01-02

Jung, S., and Tanford, S. (2017). What contributes to convention attendee satisfaction and loyalty? A meta-analysis. Journal of Convention & Event Tourism, 18(2), 118–134. http://dx.doi.org/10.1080/15470148.2017.1290565 DOI: http://dx.doi.org/10.1080/15470148.2017.1290565. DOI: https://doi.org/10.1080/15470148.2017.1290565

Liang, H. C. K, and Latip, H. A. (2018). Factors Affecting Attendees’ Decision-Making in Convention Tourism Industry. Advanced Science Letters, 24(6), 4414-4420(7). https://doi.org/10.1166/asl.2018.11616 DOI: https://doi.org/10.1166/asl.2018.11616. DOI: https://doi.org/10.1166/asl.2018.11616

Malekmohammadi, A., Mohamed, B., and Ekiz, E. H. (2011). An Analysis of Conference Attendee Motivations: Case of International Conference Attendees in Singapore. Journal of Travel and Tourism Research, 11(1), 50–64. Retrieved from https://www.academia.edu/2460081/An_Analysis_of_Conference_Attendee_Motivations_Case_of_International_Conference_Attendees_in_Singapore.

Palavitsinis, N., Manouselis, N., and Sanchez-Alonso, S. (2019). Metadata Quality Issues in Learning Repositories. Journal of Information Technology Education: Research, 18, 17-39.

Vahdati, S., Arndt, N., Auer, S., and Lange, C. (2016). OpenResearch: Collaborative Management of Scholarly Communication Metadata. In E. Blomqvist, P. Ciancarini, F. Poggi, & F. Vitali (Eds.), Knowledge Engineering and Knowledge Management. 20th International Conference, EKAW 2016, Bologna, Italy, November 19-23, 2016, Proceedings (Lecture Notes in Computer Science, 10024) (pp. 778–793). Springer International Publishing. https://doi.org/10.1007/978-3-319-49004-5_50 DOI: https://doi.org/10.1007/978-3-319-49004-5_50. DOI: https://doi.org/10.1007/978-3-319-49004-5_50

Hagemann-Wilholt, S., Plank, M., and Hauschke, C. (2020). Confident–an open platform for FAIR conference metadata. GL Conference Series; 21. Amsterdam: TextRelease. p. 47-51.

Cavusoglu, M., Doğan, S., Kirant Yozcu, Ö., Hsu, M.-J., and Cobanoglu, C. (2023). A conjoint analysis of attributes influencing attendance of academic conferences. International Journal of Contemporary Hospitality Management. https://doi.org/10.1108/ijchm-10-2020-1184 DOI: https://doi.org/10.1108/ijchm-10-2020-1184. DOI: https://doi.org/10.1108/IJCHM-10-2020-1184

Laplante, P., Rockne, J. J., Montuschi, P., Baldwin, T., Hinchey, M., Shafer, L., Voas, J., and Wang, W. (2009). Quality in Conference Publishing. IEEE Transactions on Professional Communication, 52(2), 183–196. https://doi.org/10.1109/TPC.2009.2017989 DOI: https://doi.org/10.1109/TPC.2009.2017989. DOI: https://doi.org/10.1109/TPC.2009.2017989

Peller, V. V. (2013). Utilization of Technology for Mathematical Talks. An Alarming Situation. Notices of the American Mathematical Society, 60(02), 1. https://doi.org/10.1090/noti940 DOI: https://doi.org/10.1090/noti940. DOI: https://doi.org/10.1090/noti940

Martins, W. S., Gonçalves, M. A., Laender, A. H. F., and Ziviani, N. (2010). Assessing the quality of scientific conferences based on bibliographic citations. Scientometrics, 83(1), 133–155. https://doi.org/10.1007/s11192-009-0078-y DOI: https://doi.org/10.1007/s11192-009-0078-y. DOI: https://doi.org/10.1007/s11192-009-0078-y

Zhuang, Z., Lee, D., and Giles, C. L. (2007). Measuring Conference Quality by Mining Program Committee Characteristics. JCDL ’07: Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries, 225–234. https://doi.org/10.1145/1255175.1255220 DOI: https://doi.org/10.1145/1255175.1255220. DOI: https://doi.org/10.1145/1255175.1255220

Stević, Ž., Đalić, I., Pamučar, D., Nunić, Z., Vesković, S., Vasiljević, M., and Tanackov, I. (2019). A new hybrid model for quality assessment of scientific conferences based on Rough BWM and SERVQUAL. Scientometrics, 119(1), 1–30. https://doi.org/10.1007/s11192-019-03032-z DOI: https://doi.org/10.1007/s11192-019-03032-z. DOI: https://doi.org/10.1007/s11192-019-03032-z

Ball, A. (2011). Overview of scientific metadata for data publishing, citation, and curation. Retrieved from https://api.semanticscholar.org/CorpusID:59794424.

Tarrant, D., Carr, L., and Payne, T. (2008). Releasing the Power of Digital Metadata: Examining Large Networks of Correlated Publications. In Christensen-Dalsgaard, B., Castelli, D., Ammitzbøll Jurik, B., & Lippincott, J. (Eds.), Lecture Notes in Computer Science (pp. 172–184). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-87599-4_18 DOI: https://doi.org/10.1007/978-3-540-87599-4_18. DOI: https://doi.org/10.1007/978-3-540-87599-4_18

Bertin, M., and Atanassova, I. (2012). Semantic Enrichment of Scientific Publications and Metadata: Citation Analysis Through Contextual and Cognitive Analysis. D Lib Mag., 18. https://doi.org/10.1045/July2012-bertin DOI: https://doi.org/10.1045/July2012-bertin. DOI: https://doi.org/10.1045/july2012-bertin

Doerfel, S., Doerfel, S., Robert, J., Hotho, A., and Stumme, G. (2012). Leveraging publication metadata and social data into FolkRank for scientific publication recommendation. RSWeb ’12: Proceedings of the 4th ACM RecSys Workshop on Recommender Systems and the Social Web, September, 9–16. https://doi.org/10.1145/2365934.2365937. DOI: https://doi.org/10.1145/2365934.2365937

Guo, Z., and Jin, H. (2011). Reference metadata extraction from scientific papers. 2011 12th International Conference on Parallel and Distributed Computing, Applications and Technologies, 45–49. https://doi.org/10.1109/PDCAT.2011.72. DOI: https://doi.org/10.1109/PDCAT.2011.72

Nasar, Z., Jaffry, S. W., and Malik, M. K. (2018). Information extraction from scientific articles: a survey. Scientometrics, 117(3), 1931–1990. https://doi.org/10.1007/s11192-018-2921-5. DOI: https://doi.org/10.1007/s11192-018-2921-5

Vladimirovich, S., Galikhanov, M., Barabanova, S. V., Kaybiyaynen, A. A., and Suntsova, M. S. (2019). International Network Conference as an Efficient Way to Integrate Universities and Businesses in the Context of Digital Economy. https://doi.org/10.1007/978-3-030-40274-7_63. DOI: https://doi.org/10.1007/978-3-030-40274-7_63

Hansen, T. T., and Pedersen, D. B. (2018). The impact of academic events - A literature review. Research Evaluation. https://doi.org/10.1093/RESEVAL/RVY025. DOI: https://doi.org/10.1093/reseval/rvy025

Yamashita, R., and Oshimi, D. (2023). The motivations for and barriers to academic conference attendance: Insights from an international sport management conference. Journal of Convention & Event Tourism. https://doi.org/10.1080/15470148.2023.2205184. DOI: https://doi.org/10.1080/15470148.2023.2205184

Demeranville, T. (2018). Building a robust research infrastructure, one PID at a time (ORCID Blog). Retrieved from https://orcid.org/blog/2018/08/08/building-robust-research-infrastructure-one-pid-time.

Klump, J., Huber, R., and Diepenbroek, M. (2016). DOI for geoscience data - How early practices shape present perceptions. Earth Science Informatics, 9(1), 123–136. ISSN: 1865-0473. DOI: https://doi.org/10.1007/s12145-015-0231-5. DOI: https://doi.org/10.1007/s12145-015-0231-5

Franken, J., Birukou, A., Eckert, K., Fahl, W., Hauschke, C., and Lange, C. (2022). Persistent Identification for Conferences. Data Science Journal, 21: 11, pp. 1–18. https://doi.org/10.5334/dsj-2022-011 DOI: https://doi.org/10.5334/dsj-2022-011

Wilkinson, M. D., et al. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3: 160018. https://doi.org/10.1038/sdata.2016.18. DOI: https://doi.org/10.1038/sdata.2016.18

Downloads

Published

2024-04-05

How to Cite

Auhunas, S. (2024). Evaluation and impact of descriptive metadata on academic event management in Ukraine: A quantitative study. Iberoamerican Journal of Science Measurement and Communication, 4(1), 1–30. https://doi.org/10.47909/ijsmc.91

Funding data