Comparing AI and Teacher Feedback: Student Insights on Creativity and Critical Thinking

Authors

  • Alfin Amaliah Zahroh English Department, Universitas Muhammadiyah Surakarta
  • Mauly Halwat Hikmat English Department, Universitas Muhammadiyah Surakarta
  • Agus Wijayanto English Department, Universitas Muhammadiyah Surakarta

DOI:

https://doi.org/10.38035/dijemss.v7i2.5797

Keywords:

Feedback, ChatGPT, Vocational School

Abstract

This mixed-method study investigates students’ reflections on the strengths and limitations of feedback provided by ChatGPT compared to teacher feedback, particularly in relation to creativity, critical thinking, and content development in writing. The study was conducted in an English vocational school setting involving 40 students and 4 English teachers. Focus groups, in-depth interviews, and questionnaires were used to gather information in order to fully comprehend the opinions and experiences of the students. The analysis focused on how students evaluated the clarity, usefulness, and relevance of the feedback from both sources, as well as its impact on their ability to generate creative ideas, think critically, and improve the content of their writing. The findings suggest that teacher feedback remains essential for addressing students’ challenges in vocabulary, grammar, and idea expression by providing clarity, motivation, and personalized guidance. While ChatGPT contributes speed, accessibility, and consistency, it lacks the contextual depth and interpersonal dimension inherent in teacher feedback. Therefore, a hybrid feedback model that integrates human expertise with AI efficiency offers promising potential to optimize students’ writing development.

References

Abu Muna Almaududi Ausat, Suherlan, H. K. A. (2022). Is ChatGPT Dangerous for Lecturer Profession? An In-depth Analysis. Jurnal Pendidikan Dan Konseling, 4, 1349–1358.

Alhajji, R. (2024). Assessing the Influence of AI on Modern Student Writing Standards: An Educators’ Perspective. Research Journal in Advanced Humanities, 5(3). https://doi.org/10.58256/5tpepv73

Alkamel, M. & Alwagieh, N.A.S (2024). Utilizing an adaptable artificial intelligence writing tool (ChatGPT) to enhance academic writing skills among Yemeni university EFL students. Published in Social Sciences & Education, Computer Science, Linguistics Social Sciences & Humanities Open. doi: https://www.semanticscholar.org/paper/Utilizing-an-adaptable-artificial-intelligence-tool-Alkamel-Alwagieh/a6a0d8fd7783d8849785bcd596502fcb37b73e94

Baskara, FX Risang. (2023). Integrating ChatGPT into EFL writing instruction: Benefits and challenges. International Journal of Education and Learning. doi: https://www.semanticscholar.org/reader/cdac2af4865e33552c8b7fe8d0f30df97ea1cc3d

Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology; In Qualitative Research in Psychology. Uwe Bristol, 3(2), 77–101. doi: https://psychology.ukzn.ac.za/?mdocs-file=1176

Castelvecchi, D. (2022). Are ChatGPT and AlphaCode going to replace programmers? Nature. https://doi.org/10.1038/d41586-022-04383-z

Chasan-Taber, L. (2014). Study Design and Methods. Writing Dissertation and Grant Proposals, 153–178.doi: https://doi.org/10.1201/b16851-12

Chen, J.-S., Le, T.-T.-Y., & Florence, D. (2021). Usability and responsiveness of artificial intelligence chatbot on online customer experience in e-retailing. International Journal of Retail & Distribution Management, 49(11), 1512–1531. https://doi.org/10.1108/IJRDM-08-2020-0312

Chuah, Kee-man. & Kabilan, Muhammad K. (2021). Teachers’ Views on The Use of Chatbots to Support English Language Teaching in a Mobile Environment. doi: https://www.researchgate.net/publication/355581755_Teachers%27_Views_on_The_Use_of_Chatbots_to_Support_English_Language_Teaching_in_a_Mobile_Environment

Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1-12. doi: https://doi.org/10.1080/14703297.2023.2190148

DeNisi, A. S., & Kluger, A. N. (2000). Feedback effectiveness: Can 360-degree appraisals be improved? Academy of Management Perspectives, 14(1), 129-139. https://doi.org/10.5465/AME.2000.2909845

Dimitropoulos, E. (2002). Educational evaluation. Athens: Gregory. ISBN13: 9789603331698.

Dharani, M., Jyostna, J. V. S. L., Sucharitha, E., Likitha, R., & Manne, S. (2020). Interactive Transport Enquiry with AI Chatbot. 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), 1271–1276. https://doi.org/10.1109/ICICCS48265.2020.9120905

Doroudi, S. (2023). The Intertwined Histories of Artificial Intelligence and Education. In International Journal of Artificial Intelligence in Education (Vol. 33, Issue 4). Springer New York. doi: https://doi.org/10.1007/s40593-022-00313-2

Fadhil, A., & Gabrielli, S. (2017). Addressing challenges in promoting healthy lifestyles: The alchatbot approach. Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare, 261–265. https://doi.org/10.1145/3154862.3154914

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 00(00), 1–15. doi: https://doi.org/10.1080/14703297.2023.2195846

Fitria, T. N. (2021a). Artificial Intelligence (AI) In Education: Using AI Tools for Teaching and Learning Process. Prosiding Seminar Nasional & Call for Paper STIE AAS, 4(1), 134–147. https://prosiding.stie-aas.ac.id/index.php/prosenas/article/view/106

Fitria, T. N. (2021b). The Use of Technology Based on Artificial Intelligence in English Teaching and Learning. ELT Echo: The Journal of English Language Teaching in Foreign Language Context, 6(2), Article 2. https://doi.org/10.24235/eltecho.v6i2.9299

Fitria, T. N. (2021c). The Use of Technology Based on Artificial Intelligence in English Teaching and Learning. ELT Echo: The Journal of English Language Teaching in Foreign Language Context, 6(2), 213–223. doi: https://doi.org/10.24235/eltecho.v6i2.9299

Fitria, Tira Nur (2023). Artificial Intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. Journal of English Language Teaching. doi: https://www.semanticscholar.org/reader/c03452648d60b4acf3e98a582f660783a3be0ccc

Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: systematic literature review. Int J Educ Technol High Educ, 20, 56. https://doi.org/10.1186/s41239-023-00426-1

Laksanasut, Saharat. (2024). The Pedagogical Impact of ChatGPT on High-school Student’s Creative Writing Skills: An Exploration of Generative AI Assisted Writing Tools. doi: https://www.researchgate.net/publication/382428026_The_Pedagogical_Impact_of_ChatGPT_on_High-school_Student's_Creative_Writing_Skills_An_Exploration_of_Generative_AI_Assisted_Writing_Tools

Lizzio, A., & Wilson, K. (2008). Feedback on assessment: students' perceptions of quality and effectiveness. Assessment & Evaluation in Higher Education, 33, 263-275. https://doi.org/10.1080/02602930701292548

Hattie, J. (2009). The black box of tertiary assessment: An impending revolution. Tertiary assessment & higher education student outcomes: Policy, practice & research, 259-275. Retrieved from https://www.wgtn.ac.nz/education/pdf/john-hattie.pdf

Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487

Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2023). Using AI to write scholarly publications. Accountability in Research, 00(00), 1–9. doi: https://doi.org/10.1080/08989621.2023.2168535

Hutson, M. (2023). The Use of Artificial Intelligence-Based Chat-GPT and Its Challenges for the World of Education; From the Viewpoint of the Development of Creative Writing Skills. Proceeding of International Conference on Education, Society and Humanity, 1(1), 353–357. doi: https://ejournal.unuja.ac.id/index.php/icesh/article/view/5614

Jiang et al. (2024). Detecting ChatGPT-generated essays in a large-scale writing assessment: Is there a bias against non-native English speakers? Science Direct. doi: https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848

Li, M., Li, C., Chen, Y. et al. (2025). Effects of an automated evaluation mechanism on students’ writing performance and higher-order thinking in an AR-based formative-peer-assessment learning mode. Educ Inf Technol. https://doi.org/10.1007/s10639-025-13611-8

Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learn. Environ, 11, 9. https://doi.org/10.1186/s40561-024-00295-9

Mahfoodh, Omer Hassan A., & Pandian, Ambigapathy. (2011). A Qualitative Case Study of EFL Students’ Affective Reactions to and Perceptions of Their Teachers’ Written Feedback. English Language Teaching, 4(3), 14-27. doi: 10.5539/elt.v4n3p14

Mandernach, B. J. (2009). Effect of instructor-personalized multimedia in the online classroom. International Review of Research in Open and Distance Learning, 10(3), 1–19. https://doi.org/10.19173/irrodl.v10i3.606

Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2). doi: https://doi.org/10.1080/2331186X.2023.2236469

McKnight, L. (2021). Electric sheep? Humans, robots, artificial intelligence, and the future of writing. Changing English, 28(4), 442-455. doi: https://doi.org/10.1080/1358684X.2021.1941768

Mhlanga, D. (2023). Open AI in Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning. SSRN Electronic Journal. doi: https://doi.org/10.2139/ssrn.4354422

Monaghan, Connie. (2007). Effective Strategies for Teaching Writing. doi: https://www.researchgate.net/publication/237227452_EFFECTIVE_STRATEGIES_FOR_TEACHING_WRITING

Murcahyanto, H. (2023). Penerapan Media Chat GPT pada Pembelajaran Manajemen Pendidikan terhadap Kemandirian Mahasiswa. Edumatic: Jurnal Pendidikan Informatika, 7(1), 115–122. doi: https://doi.org/10.29408/edumatic.v7i1.14073

Narciss, S. (2008). Feedback Strategies for Interactive Learning Tasks. In book: Handbook of Research on Educational Communications and Technology, 125-144. Retrieved 14 July 2022 from https://www.researchgate.net/publication/233833269_Feedback_Strategies_for_Interactive_Learning_Tasks

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice. tandfonline.com. doi: https://doi.org/10.1080/03075070600572090

Nugroho, A., Andriyanti, E., Widodo, P., & Mutiaraningrum, I. (2024). Students’ appraisals post-ChatGPT use: Students’ narrative after using ChatGPT for writing. Innovations in Education and Teaching International, 1–13. https://doi.org/10.1080/14703297.2024.2319184

Parkin, H. J., Hepplestone, S., Holden, G., Irwin, B., & Thorpe, L. (2012). A role for technology in enhancing students’ engagement with feedback. Assessment & Evaluation in Higher Education, 37(8), 963-973. https://doi.org/10.1080/02602938.2011.592934

Rahma, Alleyza & Fithrian, Rahmah (2023). The Potential Impact of Using ChatGPT on EFL Students' Writing: EFL Teachers' Perspective. doi: https://journal.uniku.ac.id/index.php/IEFLJ/article/view/9222

Richards, J. C., & Renandya, W. A. (2002). Methodology in Language Teaching: An Anthology of Current Practice. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511667190

Sarwanti, S., Sariasih, Y., Rahmatika, L., Islam, M. Monjurul, & Riantina, E. M. (2014). Are They Literate on ChatGPT? University Language Students' Perceptions, Benefits and Challenges in Higher Education Learning. Online Learning, 28(3), 105-130. doi: https://eric.ed.gov/?id=EJ1446718

Selasih, D., & Suranto (2024). Understanding Student Perceptions of Artificial Intelligence Technology: Case Study of Accounting Education Student, Universitas Muhammadiyah Surakarta. doi: https://doi.org/10.58230/27454312.1367

Setiyowati, R., & Ardaniah, V. (2023). A Systematic Review of AI-Based and Teacher-Based Writing Assessment. English Language and Literature International Conferences. doi: https://jurnal.unimus.ac.id/index.php/ELLIC/article/view/18463

Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795

Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14. doi: https://doi.org/10.3389%2Ffpsyg.2023.1260843

Sumakul, D. T. Y. G., Hamied, F. A., & Sukyadi, D. (2022, February). Students’ Perceptions of the Use of AI in a Writing Class. In 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021), Atlantis Press, US, 52-57.

Wiggins, G. P. (1998). Educative assessment: Designing assessments to inform and improve student performance. San Francisco: Jossey-Bass. ISBN-13: 978-0787908485

Winstone, N., & Carless, D. (2020). Designing effective feedback processes in higher education. Routledge.

Zebua, J.A.C., & Katemba, C.V. (2024). Students' Perceptions of Using the OpenAI ChatGPT Application in Improving Writing Skill. Published in Journal of Language and Education, Computer Science. doi: https://www.semanticscholar.org/paper/Students%27-Perceptions-of-Using-the-OpenAI-ChatGPT-Zebua-Katemba/8ee94a463d4d8e560535c0b729943db1b36f45aa

Downloads

Published

2026-01-04

How to Cite

Amaliah Zahroh, A., Hikmat, M. H., & Wijayanto, A. (2026). Comparing AI and Teacher Feedback: Student Insights on Creativity and Critical Thinking. Dinasti International Journal of Education Management and Social Science, 7(2), 2147–2158. https://doi.org/10.38035/dijemss.v7i2.5797