The Effect Of Ai Literacy, Ethics, And Motivation On Student Learning Gains

Shofiyah Rosyadah; Ahmad Siddiq Mappatunru; Aprilianti Nirmala S; M. Miftach Fakhri

Authors

Shofiyah Rosyadah Universitas Negeri Makassar
Ahmad Siddiq Mappatunru Universitas Negeri Makassar
Aprilianti Nirmala S Universitas Negeri Makassar
M. Miftach Fakhri Universitas Negeri Makassar

Keywords:

AI literacy, Ethical awareness, Higher education, Learning motivation, Learning gains

Abstract

The increase in the use of artificial intelligence (AI) in higher education is happening faster than the readiness of literacy and ethical frameworks, thus creating a need to understand the factors that influence the effectiveness of AI utilization on student learning outcomes. This study aims to examine the influence of AI Literacy, AI Ethical Awareness, and Motivation to Learn with AI on Learning Gains and to identify the most dominant predictors. The study used a cross-sectional quantitative design with a sample of university students in Makassar selected through purposive sampling. The measurement of motivation adapted some items from the Academic Motivation Scale (AIMS) that had been psychometrically tested prior to structural analysis. The model was evaluated using Partial Least Squares Structural Equation Modeling (PLS-SEM). The results showed that the three independent variables had a positive and significant effect on Learning Gains, with coefficients β = 0.208 for AI Literacy, β = 0.236 for AI Ethical Awareness, and β = 0.358 for Motivation to Learn with AI. The R² value of 0.532 indicates the model's explanatory power in the moderate category. The f² effect size shows that motivation makes the largest contribution (0.329), while AI Literacy and AI Ethical Awareness have a small effect. Thus, motivation emerges as the strongest predictor, confirming that the successful integration of AI in learning depends not only on technical competence and ethical awareness, but also on the affective dimension of students. These findings contribute to the development of AIED studies and motivation theory, and emphasize the importance of educational strategies that balance literacy, ethics, and motivational support.

Abstract views: 13 ,

PDF downloads: 9

Downloads

Download data is not yet available.

References

Badarudin, B., Parhanuddin, L., Tohri, A., & Suhardi, M. (2024). The effect of artificial intelligence in education on student motivation: A systematic literature review. Journal for Lesson and Learning Studies, 8(1), 1–10. https://doi.org/10.23887/jlls.v8i1.91141

Bećirović, S., Polz, E., & Tinkel, I. (2025). Exploring students’ AI literacy and its effects on their AI output quality, self-efficacy, and academic performance. Smart Learning Environments, 12(1). https://doi.org/10.1186/s40561-025-00384-3

BPS Sulawesi Selatan. (2025). Jumlah perguruan tinggi, dosen, dan mahasiswa (negeri dan swasta) di bawah Kementerian Pendidikan Tinggi, Sains, dan Teknologi menurut kabupaten/kota di Provinsi Sulawesi Selatan, 2024.

Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626

Costello, E., et al. (2025). Artificial intelligence in educational research and scholarship: Seven framings. Journal of University Teaching and Learning Practice, 22(4). https://doi.org/10.53761/xs5e3834

Creswell, J. W., & Creswell, J. E. (2017). Research design: Qualitative, quantitative, and mixed methods approaches. Sage Publications.

Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Springer. https://doi.org/10.1007/978-1-4899-2271-7

DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. Sage Publications.

Freeman, J. (2025). Student generative AI survey 2025.

GEM Report Team. (2023). Global education monitoring report 2023: Technology in education—A tool on whose terms? UNESCO. https://doi.org/10.54676/UZQV8501

Hair, J. F., Howard, M. C., & Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. Journal of Business Research, 109, 101–110. https://doi.org/10.1016/j.jbusres.2019.11.069

Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Kasneci, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Press.

Knekta, E., Runyon, C., & Eddy, S. (2019). One size doesn’t fit all: Using factor analysis to gather validity evidence when using surveys in your research. CBE—Life Sciences Education, 18(1), rm1. https://doi.org/10.1187/cbe.18-04-0064

Li, J., et al. (2025). Analyzing the network structure of students’ motivation to learn AI: A self-determination theory perspective. NPJ Science of Learning, 10(1). https://doi.org/10.1038/s41539-025-00339-w

Morin, A. J. S., Arens, A. K., Tran, A., & Caci, H. (2016). Exploring sources of construct-relevant multidimensionality in psychiatric measurement: A tutorial and illustration using the Composite Scale of Morningness. International Journal of Methods in Psychiatric Research, 25(4), 277–288. https://doi.org/10.1002/mpr.1485

Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045

Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. Journal of Educational Research, 99(6), 323–338. https://doi.org/10.3200/JOER.99.6.323-338

Sutabri, T., Suroyo, H., & Kurniawan. (2025). Navigating the generative AI revolution in education: A systematic review of applications and ethical considerations. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 14(2). https://doi.org/10.23887/janapati.v14i2.90367

Tadesse, T., Gillies, R. M., & Campbell, C. (2018). Testing models and measurement invariance of the learning gains scale. Education Sciences, 8(4), 192. https://doi.org/10.3390/educsci8040192

Vansteenkiste, M., Ryan, R. M., & Soenens, B. (2020). Basic psychological need theory: Advancements, critical themes, and future directions. Motivation and Emotion, 44(1), 1–31. https://doi.org/10.1007/s11031-019-09818-1

Wadmany, R., & Davidovitch, N. (2025). Students’ ethical perceptions of artificial intelligence use: An opportunity for developing a personal ethical compass. International Journal of Educational Studies, 8(4), 75–85. https://doi.org/10.53935/2641533x.v8i4.440

Wang, B., Rau, P.-L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour & Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929X.2022.2072768

Wang, Z., Chai, C. S., Li, J., & Lee, V. W. Y. (2025). Assessment of AI ethical reflection: The development and validation of the AI ethical reflection scale (AIERS) for university students. International Journal of Educational Technology in Higher Education, 22(1). https://doi.org/10.1186/s41239-025-00519-z

Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127

Zhai, Y., & Nezakatgoo, B. (2025). Evaluating AI-powered applications for enhancing undergraduate students’ metacognitive strategies, self-determined motivation, and social learning in English language education. Scientific Reports, 15(1), 35199. https://doi.org/10.1038/s41598-025-19118-z