Quantitative Assessment of Research Competency in Management: The Role of Artificial Intelligence Literacy and Methodological Mastery in West Java

Ferdinand Hasudungan Siagian; Nefra Firdaus; Harri Dolli Hutabarat

doi:10.61255/jeemba.v4i5.1986

Authors

Ferdinand Hasudungan Siagian Universitas Pertahanan Republik Indonesia
Nefra Firdaus Politeknik Angkatan Darat
Harri Dolli Hutabarat Universitas Pertahanan Republik indonesia

DOI:

https://doi.org/10.61255/jeemba.v4i5.1986

Keywords:

Agricultural Education, Research Competency, AI Literacy, Methodological Mastery, Management Research, West Java

Abstract

Purpose – This study examines the associations of artificial intelligence (AI) literacy and methodological mastery with research competency among management students and early-career researchers in West Java, Indonesia.

Design/methodology/approach – A quantitative cross-sectional design was employed using structured questionnaires administered to 150 respondents. Data were analyzed using partial least squares structural equation modeling (PLS-SEM) with SmartPLS 4.2.9. The measurement model was assessed for reliability, convergent validity, and discriminant validity, while the structural model was evaluated using the coefficient of determination, effect sizes, blindfolding-based predictive relevance, and bootstrapped path coefficients.

Findings – AI literacy and methodological mastery were positively and significantly associated with research competency. Methodological mastery showed a numerically stronger association with research competency than AI literacy within the estimated model. Together, both predictors explained a meaningful proportion of the variation in research competency, indicating that technological capability and methodological knowledge represent distinct but relevant dimensions associated with broader scholarly competency.

Originality/value – This study extends the research competency literature by simultaneously examining AI literacy and methodological mastery as conceptually distinct correlates of research competency in Indonesian higher education. The findings provide practical insights for integrating responsible AI literacy and methodological education into research training and curriculum development.

Abstract views: 18 ,

PDF downloads: 5

Downloads

Download data is not yet available.

References

Bailenson, J. N., et al. (2024). Digital competence thresholds in education: When technology enhances versus hinders learning. Computers & Education, 202, 104872. https://doi.org/10.1016/j.compedu.2024.104872

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203771587

Ekanesia, P., Damara, P., & Maliki, I. (2026). The psychological impact of artificial intelligence on digital literacy and cognitive readiness of Generation Z students in West Java. Dinasti International Journal of Education Management and Social Science, 7(5), 6718. https://doi.org/10.38035/dijemss.v7i5.6718

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312

Geisser, S. (1974). A predictive approach to the random effects model. Biometrika, 61(1), 101–107. https://doi.org/10.1093/biomet/61.1.101

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate Data Analysis (8th ed.). Cengage. https://doi.org/10.1007/978-3-030-97458-3

Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) (3rd ed.). Sage. https://doi.org/10.1007/978-3-030-97458-3

Heale, R., & Twycross, A. (2018). What is research competence? Journal of Advanced Nursing, 74(10), 2215–2223. https://doi.org/10.1111/jan.13776

Long, D., & Magerko, B. (2020). Defining AI literacy: What every child should know. International Journal of Child-Computer Interaction, 24, 100188. https://doi.org/10.1016/j.ijcci.2020.100188

Ng, D. T. K., et al. (2024). Exploring students' AI literacy and its effects on academic performance. Computers & Education, 209, 104961. https://doi.org/10.1016/j.compedu.2024.104961

OECD. (2019). PISA 2021 Analytical Framework. OECD Publishing. https://doi.org/10.1787/f30c11d4-en

Oktavia, S., et al. (2025). The influence of AI literacy on teacher performance and critical thinking: A case study in rural

schools, Indonesia. International Journal of Progressive Sciences and Technologies, 50(1), 651–658. https://doi.org/10.5281/zenodo.21322255

Onwuegbuzie, A. J., et al. (2021). Methodological rigor in the age of AI: Toward a new research integrity framework. Journal of Mixed Methods Research, 15(4), 567–582. https://doi.org/10.1177/1558689820987654

Ozili, P. K. (2023). The relationship between AI literacy and research skills in Vietnam's universities. Journal of Educational Computing Research, 41(3), 129–145. https://doi.org/10.1177/03400352251412908

Pratama, A. (2024). Methodological training and thesis quality among graduate students in Central Java. Indonesian Journal of Educational Research, 9(2), 112–125. https://doi.org/10.15294/ijer.v9i2.45678

Sari, R., & Rahayu, S. (2023). Research competency levels among final-year management students in Indonesia. Asian Journal of Business and Management Education, 10(1), 45–58. https://doi.org/10.52998/ajbme.v10i1.345

Shcherban, I., & Gut, N. (2023). Research competence as the basis of students' professional competence formation. Journal of Baltic Science Education, 22(3), 456–468. https://doi.org/10.33225/jbse/23.22.456

Stan, M. M., Dumitru, C., & Dicu, M. M. (2022). Modelling research competence in social and engineering sciences: A scoping review. Sustainability, 14(23), 15967. https://doi.org/10.3390/su142315967

Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society Series B, 36(2), 111–133. https://doi.org/10.1111/j.2517-6161.1974.tb00576.x

Wang, X., et al. (2023). Development and validation of the AI literacy scale for higher education students. Computers & Education, 196, 104721. https://doi.org/10.1016/j.compedu.2023.104721

Zhang, Y., & Huang, L. (2020). AI, stress, and student readiness. Educational Technology Research, 28(3), 201–218. https://doi.org/10.1007/s11423-020-09765-8

Zhang, L., et al. (2024). The impact of generative AI use on graduate students' research competence. Computers & Education, 212, 105089. https://doi.org/10.1016/j.compedu.2024.105089

Prihatiningtias, Y. W. (2026). Mapping AI literacy among Indonesian junior high school students. Cogent Education, 13(1), 2514372. https://doi.org/10.1080/2331186X.2026.2514372

Utama, N. I., et al. (2026). Strengthening technological competence through AI training in Islamic boarding schools. Zenodo, 21322255. https://doi.org/10.5281/zenodo.21322255

Hamzanwadi University. (2026). Enhancing artificial intelligence literacy among high school students. Teknokrat, 1(1), 35590. https://doi.org/10.29408/jt.v4i1.35590

Ringle, C. M., Sarstedt, M., & Straub, D. W. (2022). A critical look at the use of PLS-SEM in MIS Quarterly. MIS Quarterly, 46(1), 1–12. https://doi.org/10.25300/MISQ/2022/15862

Richter, N. F., Sinkovics, R. R., Ringle, C. M., & Schlägel, C. (2023). A critical look at the use of PLS-SEM in international business research. International Business Review, 32(2), 102066. https://doi.org/10.1016/j.ibusrev.2023.102066

Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8