Beyond the Instrumental Use of Artificial Intelligence: A Formative Experience for the Development of Critical Digital Competencies in Higher Education
DOI:
https://doi.org/10.57125/ELIJ.2026.09.25.09Keywords:
AI literacy, authentic assessment, critical AI literacy, critical digital competencies, educational innovation, human agency, situated learning.Abstract
The growing presence of artificial intelligence in higher education has made its use increasingly common, but not necessarily more critical. Students and educators may know how to use AI tools while still lacking criteria for questioning their outputs, recognising their implications, or deciding when their use is appropriate. This study examines how Critical Digital Competencies for AI (CDC-AI) develop when a formative experience deliberately places these questions at the centre of AI use. A qualitative interpretive design was used with 19 participants from two higher education contexts: 14 undergraduate students and five postgraduate participants who were also teachers. Evidence was gathered through diagnostic and final questionnaires, reflective narratives, academic essays, and researcher observations, and analysed through iterative coding, comparison, triangulation, and conceptual refinement. What emerged was not a simple progression from limited to greater knowledge about AI. Instead, participants gradually connected four processes: critical understanding of AI, critical evaluation of information, recognition of ethical implications, and reasoned justification of decisions. Particularly revealing was the way these processes began to shape decisions about when, how, and for what purposes AI should be used in academic practice. Participants moved from valuing AI mainly for efficiency and task completion towards questioning outputs, considering possible consequences, comparing alternatives, and explaining their decisions. This movement led to the study’s main integrative finding: the construction of criteria for situated AI use. Rather than proposing an additional competency, the study interprets these criteria as the result of mobilising the four processes together when a particular situation requires judgment. On this basis, CDC-AI are understood as interpretative frameworks that can guide AI-mediated educational practice. Given the small, purposively selected sample, these findings are not intended for statistical generalisation, but they offer a basis for examining how critical judgment can be pedagogically developed in higher education.
References
Ashford-Rowe, K., Herrington, J., & Brown, C. (2014). Establishing the critical elements that determine authentic assessment. Assessment & Evaluation in Higher Education, 39(2), 205–222. https://doi.org/10.1080/02602938.2013.819566
Beninger, S., Reppel, A., Stanton, J., & Watson, F. (2025). Facilitating generative AI literacy in the face of evolving technology: Interventions in marketing classrooms. Journal of Marketing Education, 47(2), 112–125. https://doi.org/10.1177/02734753251316569
Bhusal, P. C. (2025). Fostering critical AI literacy through a decolonial use of ChatGPT in ESL/EFL classrooms. Advances in Mobile Learning Educational Research, 5(2), 1472–1487. https://doi.org/10.25082/AMLER.2025.02.005
Biagini, G. (2025). Towards an AI-literate future: A systematic literature review exploring education, ethics, and applications. International Journal of Artificial Intelligence in Education, 35, 2616–2666. https://doi.org/10.1007/s40593-025-00466-w
Bielik, T., & Krell, M. (2025). Developing and evaluating the extended epistemic vigilance framework. Journal of Research in Science Teaching, 62(3), 869–895. https://doi.org/10.1002/tea.21983
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42. https://doi.org/10.3102/0013189X018001032
Carless, D. (2015). Excellence in university assessment: Learning from award-winning practice. Routledge. https://doi.org/10.4324/9781315740621
Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354
Crompton, H., & Burke, D. (Eds.). (2024). Artificial intelligence applications in higher education: Theories, ethics, and case studies for universities. Taylor & Francis.
Daher, R. (2025). Integrating AI literacy into teacher education: A critical perspective paper. Discover Artificial Intelligence, 5, Article 217. https://doi.org/10.1007/s44163-025-00475-7
Denny, P., Leinonen, J., Prather, J., Luxton-Reilly, A., Amarouche, T., Becker, B. A., & Reeves, B. N. (2024). Promptly: Using prompt problems to teach learners how to effectively utilize AI code generators. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery. https://doi.org/10.1145/3613904.3642407
Efimova, E., & Nygren, T. (2026). Classroom discussions of social issues in the age of generative AI: Epistemic vigilance against bias and bullshit. Journal of Social Studies Research, 50(2), 85–97. https://doi.org/10.1177/0885985X251382072
Falloon, G. (2020). From digital literacy to digital competence: The teacher digital competency (TDC) framework. Educational Technology Research and Development, 68(5), 2449–2472. https://doi.org/10.1007/s11423-020-09767-4
Gulikers, J. T. M., Bastiaens, T. J., & Kirschner, P. A. (2004). A five-dimensional framework for authentic assessment. Educational Technology Research and Development, 52(3), 67–86. https://doi.org/10.1007/BF02504676
Herrington, J., Reeves, T. C., & Oliver, R. (2010). A guide to authentic e-learning. Routledge.
Herrington, J., Reeves, T. C., & Oliver, R. (2014). Authentic learning environments. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 401–412). Springer. https://doi.org/10.1007/978-1-4614-3185-5_32
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeiffer, F., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274
Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge University Press.
Lombardi, M. M. (2007). Authentic learning for the 21st century: An overview (EDUCAUSE Learning Initiative Paper No. 1). EDUCAUSE.
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–16). Association for Computing Machinery. https://doi.org/10.1145/3313831.3376727
Martinez Bonilla, I., Guarneros Reyes, E., & Silva Rodríguez, A. (2025). Usos y percepciones de la inteligencia artificial generativa en la educación superior en México: Una revisión sistemática [Uses and perceptions of generative artificial intelligence in higher education in Mexico: A systematic review]. Transdigital, 6(12), Article e492. https://doi.org/10.56162/transdigital492
McDonald, N., Johri, A., Ali, A., & Hingle Collier, A. (2025). Generative artificial intelligence in higher education: Evidence from an analysis of institutional policies and guidelines. Computers in Human Behaviour: Artificial Humans, 3, Article 100121. https://doi.org/10.1016/j.chbah.2025.100121
Mezirow, J. (1991). Transformative dimensions of adult learning. Jossey-Bass.
Miao, F., & Cukurova, M. (2024). AI competency framework for teachers. UNESCO. https://doi.org/10.54675/ZJTE2084
Miao, F., Shiohira, K., & Lao, N. (2024). AI competency framework for students. UNESCO. https://doi.org/10.54675/JKJB9835
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021a). AI literacy: Definition, teaching, evaluation and ethical issues. Proceedings of the Association for Information Science and Technology, 58(1), 504–509. https://doi.org/10.1002/pra2.487
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021b). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, Article 100041. https://doi.org/10.1016/j.caeai.2021.100041
Ng, D. T. K., Su, J., Leung, J. K. L., & Chu, S. K. W. (2024). Artificial intelligence (AI) literacy education in secondary schools: A review. Interactive Learning Environments, 32(10), 6204–6224. https://doi.org/10.1080/10494820.2023.2255228
Niebla Zataraín, V. B., Beltrán Lizárraga, M. G., & Niebla Zataraín, J. M. (2025). Experiencia de uso de la inteligencia artificial en la educación superior: Caso Tecnológico Nacional de México [Experience of using artificial intelligence in higher education: The case of the National Technological Institute of Mexico]. Revista Especializada en Investigación Jurídica, (16). https://doi.org/10.20983/reij.2025.1.9
OECD. (2024). The potential impact of artificial intelligence on equity and inclusion in education. OECD Publishing. https://doi.org/10.1787/15df715b-en
Ogunleye, B., Zakariyyah, K. I., Ajao, O., Olayinka, O., & Sharma, H. (2024). A systematic review of generative AI for teaching and learning practice. Education Sciences, 14(6), Article 636. https://doi.org/10.3390/educsci14060636
Pangrazio, L., Godhe, A.-L., & Ledesma, A. G. L. (2020). What is digital literacy? A comparative review of publications across three language contexts. E-Learning and Digital Media, 17(6), 442–459. https://doi.org/10.1177/2042753020946291
Rapanta, C., Bhatt, I., Bozkurt, A., Chubb, L. A., Erb, C., Forsler, I., Gravett, K., Koole, M., Lintner, T., Örtegren, A., Petricini, T., Rodgers, B., Webster, J., Xu, X., Christensen, I. M. F., Dohn, N. B., Christensen, L. L. W., Zeivots, S., & Jandrić, P. (2025). Critical GenAI literacy: Postdigital configurations. Postdigital Science and Education, 7(4), 1296–1333. https://doi.org/10.1007/s42438-025-00573-w
Ríos Hernández, I. N., Mateus, J. C., Rivera Rogel, D., & Ávila Meléndez, L. R. (2024). Percepciones de estudiantes latinoamericanos sobre el uso de la inteligencia artificial en la educación superior [Latin American students' perceptions of the use of artificial intelligence in higher education]. Austral Comunicación, 13(1), Article e01302. https://doi.org/10.26422/aucom.2024.1301.rio
Romeu Fontanillas, T., Romero Carbonell, M., Guitert Catasús, M., & Baztán Quemada, P. (2025). Desafíos de la inteligencia artificial generativa en educación superior: Fomentando su uso crítico en el estudiantado [Challenges of generative artificial intelligence in higher education: Fostering its critical use among students]. RIED-Revista Iberoamericana de Educación a Distancia, 28(2), 209–231. https://doi.org/10.5944/ried.28.2.43535
Tacelosky, K., Sue Kasun, G., Shapiro, B. R., Liao, Y.-C., & Harris, K. (2025). Exploring critical AI literacy in language education: A case study. Foreign Language Annals, 58(4), 966–994. https://doi.org/10.1111/flan.70029
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481. https://doi.org/10.1007/s10734-017-0220-3
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), Article 15. https://doi.org/10.1186/s40561-023-00237-x
UNESCO. (2023). Guidance for generative AI in education and research. https://doi.org/10.54675/EWZM9535
UNESCO IESALC. (2023). Generative AI and the future of higher education. UNESCO International Institute for Higher Education in Latin America and the Caribbean. https://doi.org/10.54675/HOXG8740
Valentini, A., & Blancas, A. (2025). The challenges of AI in higher education and institutional responses: Is there room for competency frameworks? UNESCO International Institute for Higher Education in Latin America and the Caribbean.
Veldhuis, A., Lo, P. Y., Kenny, S., & Antle, A. N. (2025). Critical artificial intelligence literacy: A scoping review and framework synthesis. International Journal of Child-Computer Interaction, 43, Article 100708. https://doi.org/10.1016/j.ijcci.2024.100708
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., & Herrera-Seda, C. (2018). Authentic assessment: Creating a blueprint for course design. Assessment & Evaluation in Higher Education, 43(5), 840–854. https://doi.org/10.1080/02602938.2017.1412396
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.
Wang, C., & Wang, Z. (2025). Investigating L2 writers' critical AI literacy in AI-assisted writing: An APSE model. Journal of Second Language Writing, 67, Article 101187. https://doi.org/10.1016/j.jslw.2025.101187
Wenger, E. (1998). Communities of practice: Learning, meaning, and identity. Cambridge University Press.
Wiggins, G. (1998). Educative assessment: Designing assessments to inform and improve student performance. Jossey-Bass.
Yan, L., Pammer-Schindler, V., Mills, C., Nguyen, A., & Gašević, D. (2025). Beyond efficiency: Empirical insights on generative AI's impact on cognition, metacognition and epistemic agency in learning. British Journal of Educational Technology, 56(5), 1675–1685. https://doi.org/10.1111/bjet.70000
Yan, W., Nakajima, T., & Sawada, R. (2025). Beyond tool use: Tracking the evolution of generative AI literacy among university students through a process-oriented investigation. Computers and Education: Artificial Intelligence, 9, Article 100465. https://doi.org/10.1016/j.caeai.2025.100465
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Araceli Camacho-Navarro
This work is licensed under a Creative Commons Attribution 4.0 International License.