Research efficiency in Chilean universities: A look from data envelopment analysis

Authors

DOI:

https://doi.org/10.47909/ijsmc.173

Keywords:

data envelopment analysis, university rankings, higher education, governance of educational institutions, research evaluation, scientific output

Abstract

Objective. The objective is to analyze Chilean universities' efficiency in using some research-related inputs to determine their impact on the results of their scientific production.

Design/Methodology/Approach. To achieve the outlined objective, some strategic resources are used as inputs, such as financial income, full-time equivalent academic staffing, and the number of enrolled students, and, as output, the number of publications in journals indexed in the Scopus database between 2020 and 2022. This is a descriptive and quantitative research using the data envelopment analysis technique.

Results/Discussion. Valuable information for university management and governance was identified, including that three universities reached 100 % efficiency and seven others exceeded 90 %. The Mann-Whitney U and Student's t-tests, which show significant and favorable results for public entities, evidence the differences between public and private universities.

Conclusion. The analysis suggests that multiple factors should be considered when evaluating the efficiency of academic institutions, especially their context and mission, especially regarding scientific production.

Downloads

Download data is not yet available.

References

Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian universities: A data envelopment analysis. Economics of Education Review, 22(1), 89–97. https://doi.org/10.1016/S0272-7757(01)00068-1 DOI: https://doi.org/10.1016/S0272-7757(01)00068-1

Abramo, G., D’Angelo, C. A., & Pugini, F. (2008). The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology. Scientometrics, 76(2), 225–244. https://doi.org/10.1007/s11192-007-1942-2 DOI: https://doi.org/10.1007/s11192-007-1942-2

Abramo, G., Cicero, T., & D’Angelo, C. A. (2013). Individual research performance: A proposal for comparing apples to oranges. Journal of Informetrics, 7(2), 528–539. https://doi.org/10.1016/j.joi.2013.01.013 DOI: https://doi.org/10.1016/j.joi.2013.01.013

Abramo, G., & D’Angelo, C. A. (2015). Evaluating university research: Same performance indicator, different rankings. Journal of Informetrics, 9(3), 514–525. https://doi.org/10.1016/j.joi.2015.04.002 DOI: https://doi.org/10.1016/j.joi.2015.04.002

Abramo, G., D’Angelo, C. A., & Soldatenkova, A. (2016). The ratio of top scientists to the academic staff as an indicator of the competitive strength of universities. Journal of Informetrics, 10(2), 596–605. https://doi.org/10.1016/j.joi.2016.04.013 DOI: https://doi.org/10.1016/j.joi.2016.04.013

Abramo, G., & D’Angelo, C. A. (2021). The different responses of universities to introduction of performance-based research funding. Research Evaluation, 30(4). https://doi.org/10.1093/reseval/rvab022 DOI: https://doi.org/10.1093/reseval/rvab022

Acosta-Silva, A., Ganga-Contreras, F., & Rama-Vitale, C. (2021). Gobernanza universitaria: enfoques y alcances conceptuales. Revista iberoamericana de educación superior, 12(33), 3-17. https://doi.org/10.22201/iisue.20072872e.2021.33.854 DOI: https://doi.org/10.22201/iisue.20072872e.2021.33.854

Alcaraz-Ochoa, D., & Bernal-Domínguez, D. (2017). Evaluación de la eficiencia técnica de las Universidades Públicas Estatales (UPE) del noroeste de México mediante Análisis Envolvente de Datos (DEA). Nova Scientia, 9(19). https://doi.org/10.21640/ns.v9i19.854 DOI: https://doi.org/10.21640/ns.v9i19.854

Andalia, R. C., Labrada, R. R., & Castells, M. M. (2010). Scopus: La mayor base de datos de literatura científica arbitrada al alcance de los países subdesarrollados. ACIMED, 21(3). http://scielo.sld.cu/pdf/aci/v21n3/aci02310.pdf

Asiedu, M. A., Anyigba, H., Ofori, K. S., Ampong, G. O. A., & Addae, J. A. (2020). Factors influencing innovation performance in higher education institutions. Learning Organization, 27(4), 365–378. https://doi.org/10.1108/TLO-12-2018-0205 DOI: https://doi.org/10.1108/TLO-12-2018-0205

Asimiran, S., & Ismail, I. A. (2019). Exploring critical success factors in the governance of Malaysian public universities. International Journal of Innovation, Creativity and Change, 9(12), 268–282.

Auranen, O., & Nieminen, M. (2010). University research funding and publication performance—An international comparison. Research Policy, 39(6), 822–834. https://doi.org/https://doi.org/10.1016/j.respol.2010.03.003 DOI: https://doi.org/10.1016/j.respol.2010.03.003

Bitencourt, C. F., Pomim, M. L., Sutton, M. J. D., & De Sordi, J. O. (2021). Complexity and knowledge in organisational context: Concepts, approaches, boundaries and relations. Journal of Information and Knowledge Management, 20(4), 2150041. https://doi.org/10.1142/S0219649221500416 DOI: https://doi.org/10.1142/S0219649221500416

Bowlin, W. F. (1998). Measuring Performance: An Introduction to Data Envelopment Analysis (DEA). The journal of cost analysis, 15(2), 3-27. https://doi.org/10.1080/08823871.1998.10462318 DOI: https://doi.org/10.1080/08823871.1998.10462318

Boussofiane, A., Dyson, R. G., & Thanassoulis, E. (1991). Applied Data Envelopment Analysis. European Journal of Operational Research, 52(1), 1-15. https://doi.org/10.1016/0377-2217(91)90331-o DOI: https://doi.org/10.1016/0377-2217(91)90331-O

Brunner, J.-J. (2012). La idea de universidad en tiempos de masificación. Revista Iberoamericana de Educación Superior. https://doi.org/10.22201/iisue.20072872e.2012.7.69 DOI: https://doi.org/10.22201/iisue.20072872e.2012.7.69

Brunner, J. J., & Ganga-Contreras, F. (2016). Dinámicas de transformación en la educación superior latinoamericana: Desafíos para la gobernanza. Opción, 32 (80), 12-35.

Brunner, J. J., & Ganga, F. A. (2016). Reflexiones en torno a economía política y gobernanza de los sistemas nacionales e instituciones de educación superior en América Latina. Interciencia, 41(8), 573-579. https://www.interciencia.net/wp-content/uploads/2017/10/573E-GANGAVOL.-41_8.pdf

Brunner, J. J., & Ganga-Contreras, F. (2018). Nuevos actores en la escena de la Educación Superior: Oportunidades para seguir investigando. Opción, 34(87), 8-13.

Bugaj, Justyna M., & Radosław Rybkowski. (2018). The use of international rankings in the formulation of a university’s strategic goals—The polish perspective. Journal of Economics and Management 34, 39–57. https://cejsh.icm.edu.pl/cejsh/element/bwmeta1.element.cejsh-cac8ba61-9d48-49b6-851a-c8dafa8361b9

Cáceres V, H., Kristjanpoller R., W., & Tabilo A., J. (2014). Análisis de la eficiencia técnica y su relación con los resultados de la evaluación de desempeño en una Universidad chilena. Innovar, 24(54). https://doi.org/10.15446/innovar.v24n54.46720 DOI: https://doi.org/10.15446/innovar.v24n54.46720

Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6). https://doi.org/10.1016/0377-2217(78)90138-8 DOI: https://doi.org/10.1016/0377-2217(78)90138-8

Chankseliani, M., Qoraboyev, I., & Gimranova, D. (2021). Higher education contributing to local, national, and global development: new empirical and conceptual insights. Higher Education, 81(1). https://doi.org/10.1007/s10734-020-00565-8 DOI: https://doi.org/10.1007/s10734-020-00565-8

Chen, Y., Ma, X., Yan, P., & Wang, M. (2021). Operating efficiency in Chinese universities: An extended two-stage network DEA approach. Journal of Management Science and Engineering, 6(4). https://doi.org/10.1016/j.jmse.2021.08.005 DOI: https://doi.org/10.1016/j.jmse.2021.08.005

Coll, J & Blasco, O. (2000). Evaluación de la eficiencia mediante el análisis envolvente de datos: Introducción a los modelos básicos. Universidad de Valencia. Recuperado de https://www.uv.es/vcoll/libros/2006_evaluacion_eficiencia_DEA.pdf

Comisión Nacional de Acreditación de Chile CNA. (2024). Buscador Avanzado. Recuperado de https://www.cnachile.cl/Paginas/buscador-avanzado.aspx

Cossani, G., Codoceo, L., Cáceres, H., & Tabilo, J. (2022). Technical efficiency in Chile’s higher education system: A comparison of rankings and accreditation. Evaluation and Program Planning, 92, 102058. https://doi.org/10.1016/j.evalprogplan.2022.102058 DOI: https://doi.org/10.1016/j.evalprogplan.2022.102058

Easley, J., Strawderman, L., Babski-Reeves, K., Bullington, S., & Smith, B. (2021). Perceived quality factors in higher education. Quality in Higher Education. https://doi.org/10.1080/13538322.2021.1909210 DOI: https://doi.org/10.1080/13538322.2021.1909210

Etzkowitz, H. (2008). The triple helix: University-industry-government innovation in action. In The Triple Helix: University-Industry-Government Innovation in Action. https://doi.org/10.4324/9780203929605 DOI: https://doi.org/10.4324/9780203929605

Etzkowitz, H. (2016). The Entrepreneurial University: Vision and Metrics. Industry and Higher Education, 30(2), 83–97. https://doi.org/10.5367/ihe.2016.0303 DOI: https://doi.org/10.5367/ihe.2016.0303

Expósito-García, A., & Velasco-Morente, F. (2018). How efficient are universities at publishing research? A data envelopment analysis of Spanish state universities. Profesional de La Informacion, 27(5), 1108–1115. https://doi.org/10.3145/epi.2018.sep.14 DOI: https://doi.org/10.3145/epi.2018.sep.14

Fancello, G., Carta, M., & Serra, P. (2020). Data Envelopment Analysis for the assessment of road safety in urban road networks: A comparative study using CCR and BCC models. Case Studies on Transport Policy, 8(3), 736–744. https://doi.org/10.1016/j.cstp.2020.07.007 DOI: https://doi.org/10.1016/j.cstp.2020.07.007

Gaete Quezada, R. (2016). La responsabilidad social universitaria en la identidad corporativa de las universidades chilenas: Un análisis de contenido. Documentos y aportes en administración pública y gestión estatal, (26), 43-74. Recuperado de http://www.scielo.org.ar/scielo.php?script=sci_arttext&pid=S1851-37272016000100002&lng=es&tlng=es DOI: https://doi.org/10.14409/da.v16i26.5935

Ganga-Contreras, F., Quiroz, J., & Fossatti, P. (2016). Análisis sincrónico de la gobernanza universitaria: una mirada teórica a los años sesenta y setenta. Educação e Pesquisa, 43(2). https://doi.org/10.1590/s1517-9702201608135289 DOI: https://doi.org/10.1590/s1517-9702201608135289

Ganga-Contreras, F. y Pérez, A. (2018). Paradigmas emergentes en la Gobernanza Universitaria: una aproximación teórica. Revista Utopía y Praxis, Venezuela, 23(83),123-136.

Ganga-Contreras, F., Rodríguez-Ponce, E., Pedraja-Rejas, L., & Viancos-González, P. (2024). An analysis of Chilean universities based on their research outputs and funded projects (2008-2022). Iberoamerican Journal of Science Measurement and Communication; 4(2), 1-20. DOI: 10.47909/ijsmc.127. DOI: https://doi.org/10.47909/ijsmc.127

Gil, F. (2014). ¿Qué significa investigar? Exorcismo del trabajo de investigación. Fondo de cultura económica, 17-67.

Hazelkorn, E. (2011). Rankings and the reshaping of higher education: The battle for world-class excellence. In Rankings and the Reshaping of Higher Education: The Battle for World-Class Excellence. London: Palgrave Macmillan London. https://doi.org/10.1057/9780230306394 DOI: https://doi.org/10.1057/9780230306394

Hazelkorn, E. (2014). Reflections on a Decade of Global Rankings: What we’ve learned and outstanding issues. European Journal of Education, 49(1), 12–28. https://doi.org/10.1111/ejed.12059 DOI: https://doi.org/10.1111/ejed.12059

Instituto Nacional de Estadísticas. (2017). Censo 2017: Resultados por región. http://resultados.censo2017.cl/Region?R=R11

Labraña, J., & Brunner, J. J. (2022). Transformación de la educación superior latinoamericana y su impacto en la idea de la universidad. Perfiles Educativos, 44(176), 138–151. https://doi.org/10.22201/iisue.24486167e.2022.176.60539 DOI: https://doi.org/10.22201/iisue.24486167e.2022.176.60539

Lehmann, E.E., Otto, J.M. & Wirsching, K. (2024). Entrepreneurial universities and the third mission paradigm shift from economic performance to impact entrepreneurship: Germany’s EXIST program and ESG orientation. J Technol Transf, 49, 2184–2199. https://doi.org/10.1007/s10961-024-10080-y DOI: https://doi.org/10.1007/s10961-024-10080-y

Loganathan, M., & Subrahmanya, M.H.B (2023). Efficiency of Entrepreneurial Universities in India: A Data Envelopment Analysis. J Knowl Econ 14, 1120–1144. https://doi.org/10.1007/s13132-022-00897-Marginson, S. (2018). Global trends in higher education financing: The United Kingdom. International Journal of Educational Development, 58. https://doi.org/10.1016/j.ijedudev.2017.03.008 DOI: https://doi.org/10.1007/s13132-022-00897-z

Maral, M., & Çetin, M. (2024). Teaching, research, and third mission efficiency of universities:A data envelopment analysis and hybrid multi-criteriadecision-making approach. Managerial and Decision Economics, 45(4), 2171–2188. https://doi.org/10.1002/mde.41312188 DOI: https://doi.org/10.1002/mde.4131

Martínez-Campillo, A., & Fernández-Santos, Y. (2020). The impact of the economic crisis on the (in)efficiency of public Higher Education institutions in Southern Europe: The case of Spanish universities. Socio-Economic Planning Sciences, 71. https://doi.org/10.1016/j.seps.2019.100771 DOI: https://doi.org/10.1016/j.seps.2019.100771

Mok, K. H. (2021). Managing neo-liberalism with Chinese characteristics: The rise of education markets and Higher education governance in China. International Journal of Educational Development, 84. https://doi.org/10.1016/j.ijedudev.2021.102401 DOI: https://doi.org/10.1016/j.ijedudev.2021.102401

Muñoz, D. A. (2016). Assessing the research efficiency of higher education institutions in Chile: A data envelopment analysis approach. International Journal of Educational Management, 30(6), 809–825. https://doi.org/10.1108/IJEM-03-2015-0022 DOI: https://doi.org/10.1108/IJEM-03-2015-0022

Nations, J. M. (2021). How Austerity Politics Led to Tuition Charges at the University of California and City University of New York. History of Education Quarterly, 61(3), 273–296. https://doi.org/10.1017/heq.2021.4 DOI: https://doi.org/10.1017/heq.2021.4

Navarro-Cabrera, J. R. (2022). Importancia de la investigación científica universitaria. Revista Científica Episteme y Tekne, 1(1), e302. https://doi.org/10.51252/rceyt.v1i1.302 DOI: https://doi.org/10.51252/rceyt.v1i1.302

OECD (2024), Education spending (indicator). doi: 10.1787/ca274bac-en DOI: https://doi.org/10.1787/ca274bac-en

Peralta-González, M. J., & Gregorio-Chaviano, O. (2022). Scientific activity evaluation in Cuban universities: Analysis based on Scival (2011-2021). Iberoamerican Journal of Science Measurement and Communication, 2(1). https://doi.org/10.47909/ijsmc.145 DOI: https://doi.org/10.47909/ijsmc.145

Peña, C. A. (2015). La Importancia de la Investigación en la Universidad: Una Reinvindicación del Sapere Aude Kantiano. Amauta, 13(25), 79-85. Recuperado de https://investigaciones.uniatlantico.edu.co/revistas/index.php/Amauta/article/view/1278

Peñate, Y., Rivero, J. L., & Lozada, D. I. (2017). Análisis envolvente de datos (DEA): Un enfoque viable para la evaluación de la eficiencia docente e investigativa en las universidades ecuatorianas. Espacios, 38(30).

Pino-Mejías, J.-L., Solís-Cabrera, F. M., Delgado-Fernández, M., & Barea-Barrera, R. (2010). Evaluación de la eficiencia de grupos de investigación mediante análisis envolvente de datos (DEA). El Profesional de La Informacion, 19(2). https://doi.org/10.3145/epi.2010.mar.06 DOI: https://doi.org/10.3145/epi.2010.mar.06

Pranckutė, R. (2021). Web of science (Wos) and scopus: The titans of bibliographic information in today’s academic world. Publications, 9(1). https://doi.org/10.3390/publications9010012 DOI: https://doi.org/10.3390/publications9010012

Praus, P. (2019). High-ranked citations percentage as an indicator of publications quality. Scientometrics, 120(1). https://doi.org/10.1007/s11192-019-03128-6 DOI: https://doi.org/10.1007/s11192-019-03128-6

Quispe Fernández, G. M., & Jordán Minaya, W. R. (2017). Medición de la Eficiencia Técnica en las Universidades Autónomas del Sistema Universitario Boliviano: Aplicación del Análisis Envolvente de Datos (DEA). Espacios, 38(45).

Red Iberoamericana de Indicadores de Ciencia y Tecnología (RICYT). (2020). Gasto en Investigación y Desarrollo como porcentaje del PIB. Recuperado de https://app.ricyt.org/ui/v3/comparative.html?indicator=GASTOxPBI&start_year=2012&end_year=2021

Ramírez, P. E., & Alfaro, J. L. (2013). Evaluación de la eficiencia de las universidades pertenecientes al consejo de rectores de las universidades chilenas: Resultados de un análisis envolvente de datos. Formacion Universitaria, 6(3). https://doi.org/10.4067/S0718-50062013000300005 DOI: https://doi.org/10.4067/S0718-50062013000300005

Rodríguez-Garcés, C., & Padilla-Fuentes, G. (2021). Incorporation of the Gratuity Law into the Higher Education System in Chile: The extension of the demand subsidy and the privatization of public financing. Revista Iberoamericana de Educacion Superior, 12(33), 179–195. https://doi.org/10.22201/iisue.20072872e.2021.33.864 DOI: https://doi.org/10.22201/iisue.20072872e.2021.33.864

Salas-Velasco, M. (2020). The technical efficiency performance of the higher education systems based on data envelopment analysis with an illustration for the Spanish case. Educational Research for Policy and Practice, 19(2), 159–180. https://doi.org/10.1007/SIs10671-019-09254-5 DOI: https://doi.org/10.1007/s10671-019-09254-5

Salazar, J. M., & Leihy, P. S. (2013). The Invisible Handbook: Three decades of higher education policy in Chile (1980-2010). Education Policy Analysis Archives, 21, 34. https://doi.org/10.14507/epaa.v21n34.2013 DOI: https://doi.org/10.14507/epaa.v21n34.2013

Salmi, J. (2009). The Challenge of Establishing World Class Universities. In Directions in Development - Human Development. The World Bank. https://doi.org/doi:10.1596/978-0-8213-7865-6 DOI: https://doi.org/10.1596/978-0-8213-7865-6

Sistema de Información de Educación Superior - SIES (2023a). Informe listado de instituciones vigentes a diciembre de 2023 en educación superior en Chile. https://www.mifuturo.cl/institucionesde-educacion-superior-en-chile/

Sistema de Información de Educación Superior - SIES (2023b). Base de datos de Matrícula en 2023 en Educación Superior en Chile. https://www.mifuturo.cl/bases-de-datos-dematriculados/

Superintendencia de Educación Superior. (2020). Ficha Estandarizada Codificada Única de Situación Financiera (FECU) de las instituciones de educación superior del país. Superintendencia de Educación Superior. Recuperado de https://www.sesuperior.cl/es_cl/publicaciones/ficha-de-situacion-financierafecu/.

Superintendencia de Educación Superior. (2021). Ficha Estandarizada Codificada Única de Situación Financiera (FECU) de las instituciones de educación superior del país. Superintendencia de Educación Superior. Recuperado de https://www.sesuperior.cl/es_cl/publicaciones/ficha-de-situacion-financierafecu/.

Superintendencia de Educación Superior. (2022). Ficha Estandarizada Codificada Única de Situación Financiera (FECU) de las instituciones de educación superior del país. Superintendencia de Educación Superior. Recuperado de https://www.sesuperior.cl/es_cl/publicaciones/ficha-de-situacion-financierafecu/.

Villegas, J. G., Carolina, C. P., & Gómez, E. C. (2021). Planning and performance measurement in higher education: three case studies of operational research application. Revista Facultad de Ingenieria, 100. https://doi.org/10.17533/udea.redin.20210526 DOI: https://doi.org/10.17533/udea.redin.20210526

Published

2025-01-28

How to Cite

Ganga-Contreras, F., Romero, J. B. A., González, P. V., Cifras, N. A., & Amaya, W. S. (2025). Research efficiency in Chilean universities: A look from data envelopment analysis . Iberoamerican Journal of Science Measurement and Communication, 5(1), 1–19. https://doi.org/10.47909/ijsmc.173

Funding data