Exploring Effects of AWE-supported Teacher Feedback in Chinese EFL Writing Classes
Article Sidebar
Main Article Content
Abstract
Despite the increased studies on teacher feedback and Automated Writing Evaluation (AWE) systems, research on the combined effect of AWE and teacher feedback on EFL students’ writing performance and their engagement is scarce. To address this gap, a quasi-experimental study was conducted using two parallel classes at a Chinese university, applying convenience sampling. 38 student in the experimental group received AWE-teacher feedback, while 36 students in the control group received teacher-only feedback. Data from students’ initial drafts, revised writings, reflective journals, and semi-structured interviews were analyzed to compare the features of teacher feedback, students’ engagement, and their writing performance between AWE-teacher and teacher-only feedback modes. Findings indicated that teacher feedback in AWE-teacher feedback mode focused more on higher-order writing issues, while teacher-only feedback focused more on lower-order issues. Students in the experimental group showed deeper behavioral and cognitive engagement compared to the control group, although affective engagement was similar across both groups. Moreover, the experimental group demonstrated significant improvements in writing performance, outperforming the control group. This study provides pedagogical implications for the integration of automated and teacher feedback in EFL writing instruction.
Downloads
Article Details
Section
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Afifi, S., Rahimi, M., & Wilson, J. (2023). Student engagement with teacher and automated written corrective feedback on L2 writing: A multiple case study. The JALT CALL Journal, 19(2), 216–242. https://doi. org/10.29140/jaltcall.v19n2.1041
Ajabshir, Z. F., & Ebadi, S. (2023). The effects of automatic writing evaluation and teacher-focused feedback on CALF measures and overall quality of L2 writing across different genres. Asian-Pacific Journal of Second and Foreign Language Education, 8(1), 26. https://doi. org/10.1186/s40862-023-00201-9
Cheng, X., & Liu, Y. (2022). Student engagement with teacher written feedback: Insights from low-proficiency and high-proficiency L2 learners. System, 109, 102880. https://doi.org/10.1016/j.system.2022.102880
Cheng, X., & Zhang, L. J. (2021). Sustaining university EFL learners’ writing performancethrough provision of comprehensive written corrective feedback. Sustainability, 13(8192), 1–19. https://doi.org/10. 3390/ su13158192
Cheng, X., & Zhang, L. J. (2024). Examining Second Language (L2) Learners’ Engagement with AWE-Teacher Integrated Feedback in a Technology-Empowered Context. The Asia-Pacific Education Researcher, 33(4), 1023-1035. https://doi. org/10.1007/s40299-024-00877-8
Cheng, X., Liu, Y., & Wang, C. (2023). Understanding student engagement with teacher and peer feedback in L2 writing. System, 119 (103176), 1–12. doi: 10. 1016/j. system. 2023. 103176
Cheng, X., Zhang, L. J., & Yan, Q. (2021). Exploring teacher written feedback in EFL writing classrooms: Beliefs and practices in interaction. Language Teaching Research. https://doi. org/10.1177/13621688211057665
Cotos, E. (2014). Genre-based automated writing evaluation for L2 research writing: From design to evaluation and enhancement. New York, NY: Palgrave Macmillan.
Dikli, S., & Bleyle, S. (2014). Automated essay scoring feedback for second language writers: How does it compare to instructor feedback?. Assessing Writing, 22, 1–17. https://doi. org/10.1016/j.asw.2014.03.006
Er, E., Dimitriadis, Y., & Gašević, D. (2021). Collaborative peer feedback and learning analytics: Theory-oriented design for supporting class-wide interventions. Assessment & Evaluation in Higher Education, 46(2), 169-190. https://doi.org/10.1080/02602938.2020.1764490
Ersanlı, C. Y., & Yeşilel, D. B. A. (2023). The use of automated writing evaluation tools to foster ESL writing instruction. In New directions in technology for writing instruction (pp. 193-209). Cham: Springer International Publishing.
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023). Automated feedback and writing: A multi-level meta-analysis of effects on students' performance. Frontiers in Artificial Intelligence, 6, 1162454. https://doi. org/10.3389/frai.2023.1162454
Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. The Journal of Technology, Language, and Assessment, 8(6), 1–43. Retrieved from http://ejournals.bc.edu/ojs/index.php/jtla/article/download/ 1625/1469
Guo, K., & Wang, D. (2024). To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing. Education and Information Technologies, 29(7), 8435-8463. https://doi. org/10.1007/s10639-023-12146-0
Guo, Q., Feng, R., & Hua, Y. (2022). How effectively can EFL students use automated written corrective feedback (AWCF) in research writing?. Computer Assisted Language Learning, 35(9), 2312-2331. https://doi. org/10.1080/09588221.2021.1879161
Han, T., & Sari, E. (2024). An investigation on the use of automated feedback in Turkish EFL students’ writing classes. Computer Assisted Language Learning, 37(4), 961-985. https://doi.org/10.1080/09588221.2022.2067179
Han, Y. (2017). Mediating and being mediated: Learner beliefs and learner engagement with written corrective feedback. System, 69, 133-142. https://doi.org/10.1016/j.system.2017.07.003
Han, Y. (2019). Written corrective feedback from an ecological perspective: The interaction between the context and individual learners. System, 80, 288–303. https:// doi. org/ 10. 1016/j. system. 2018. 12. 009
Han, Y., & Hyland, F. (2015). Exploring learner engagement with written corrective feedback in a Chinese tertiary EFL classroom. Journal of Second Language Writing, 30, 31–44. https://doi. org/10.1016/j. jslw. 2015. 08. 002
Huang, S., & Renandya, W. A. (2020). Exploring the integration of automated feedback among lower-proficiency EFL learners. Innovation in Language Learning and Teaching, 14(1), 15–26. https://doi. org/10.1080/17501229.2018.1471083
Huang, Y., & Wilson, J. (2021). Using automated feedback to develop writing proficiency. Computers and Composition, 62,102675. https://doi.org/10.1016/j.compcom.2021.102675
Jiang, L., & Yu, S. (2022). Appropriating automated feedback in L2 writing: Experiences of Chinese EFL student writers. Computer Assisted Language Learning, 35(7), 1329-1353. https://doi.org/10.1080/09588221.2020.1799824
Jiang, L., Yu, S., & Wang, C. (2020). Second language writing instructors’ feedback practice in response to automated writing evaluation: A sociocultural perspective. System, 93, 102302. https://doi. org/10.1016/j.system.2020.102302
Karatay, Y., & Karatay, L. (2024). Automated writing evaluation use in second language classrooms: A research synthesis. System, 103332. https://doi.org/ 10.1016/j.system.2024.103332
Kim, Y., & Emeliyanova, L. (2021). The effects of written corrective feedback on the accuracy of L2 writing: Comparing collaborative and individual revision behavior. Language Teaching Research, 25(2), 234-255. https://doi.org/10.1177/1362168819831406
Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44 (100450), 1–12. https://doi. org/10. 1016/j. asw. 2020. 100450
Krings, H. P. (2020). Zur Einführung in den Themenschwerpunkt: Wo steht die Forschung und was folgt aus ihr für die Vermittlung fremdsprachlicher Schreibkompetenz?. Fremdsprachen Lehren und Lernen, 49(1): 2-20.
Lee, I. (2016). Teacher education on feedback in EFL writing: Issues, challenges, and future directions. Tesol Quarterly, 50(2), 518-527. https://doi. org/10.1002/tesq.303
Lee, I. (2020). Utility of focused/comprehensive written corrective feedback research for authentic L2 writing classrooms. Journal of Second Language Writing, 49, 100734. https://doi. org/10.1016/j.jslw.2020.100734
Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of Second Language Writing, 27, 1–18. https://doi. org/10.1016/j.jslw.2014.10.004
Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement. Computer Assisted Language Learning, 35(2), 605–634. https://doi. org/ 10. 1080/ 09588 221. 2020. 1743323
Liu, C., & Yu, S. (2022). Reconceptualizing the impact of feedback in second language writing: A multidimensional perspective. Assessing Writing, 53, 100630. https://doi. org/10.1016/j.asw.2022.100630
Man, D., Chau, M. H., & Kong, B. (2021). Promoting student engagement with teacher feedback through rebuttal writing. Educational Psychology, 41(7), 883-901. https://doi.org/10.1080/01443410.2020.1746238
Mao, S., & Crosthwaite, P. (2019). Investigating written corrective feedback: (Mis)alignment of teachers’ beliefs and practice. Journal of Second Language Writing, 45, 46–60. https://doi.org/ 10. 1016/j. jslw. 2019. 05. 004
Mao, Z., & Lee, I. (2023). Student engagement with written feedback: Critical issues and way forward. RELC Journal. https:// doi. org/10. 1177/ 00336882221150811
O’Neill, R., & Russell, A. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program grammarly. Australian Journal of Educational Technology, 35(1), 42–56. https://doi. org/10. 14742/ajet. 3795
Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52(100816), 1–16. https://doi. org/10. 1016/j. jslw. 2021. 100816
Schon, D. A. (1987). Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. San Francisco, CA: Jossey-Bass.
Strauss, A. L., & Corbin, J. M. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Thousand Oaks: Sage Publications.
Thi, N. K., & Nikolov, M. (2022). How teacher and Grammarly feedback complement one another in Myanmar EFL students’ writing. The Asia-Pacific Education Researcher, 31(6), 767-779. https://doi. org/10.1007/s40299-021-00625-2
Tian, L., & Zhou, Y. (2020). Learner engagement with automated feedback, peer feedback and teacher feedback in an online EFL writing context. System, 91, 102247. https://doi.org/10.1016/j.system.2020.102247
Wang, P.-L. (2015). Effects of an automated writing evaluation program: Student experiences and perceptions. Electronic Journal of Foreign Language Teaching, 12(1), 79–100.
Wei, P., & Wang, X., & Dong, H. (2023). The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial. Frontier Psychology, 14:1249991. https://doi. org/10.3389/fpsyg.2023.1249991
Wilson, J., & Czik, A. (2016). Automated essay evaluation software in English Language Arts classrooms: Effects on teacher feedback, student motivation, and writing quality. Computers & Education, 100, 94-109. https://doi. org/10.1016/j.compedu.2016.05.004
Wilson, J., & Roscoe, R. D. (2020). Automated writing evaluation and feedback: Multiple metrics of efficacy. Journal of Educational Computing Research, 58(1), 87-125. https://doi.org/10.1177/0735633119830764
Xu, J., & Zhang, S. (2022). Understanding AWE feedback and English writing of learners with different proficiency levels in an EFL classroom: A sociocultural perspective. Asia-Pacific Education Researcher, 31, 357–367. https://doi. org/10. 1007/s40299- 021- 00577-7
Xu, S., Su, Y., & Liu, K. (2025). Investigating student engagement with AI-driven feedback in translation revision: A mixed-methods study. Education and Information Technologies, 1-27. https://doi. org/10.1007/s10639-025-13457-0
Yang, L. F., & Zhang, L. J. (2023). Self-regulation and student engagement with feedback: The case of Chinese EFL student writers. Journal of English for Academic Purposes, 63 (101226), 1–14. https://doi. org/10. 1016/j. jeap. 2023. 101226
Yu, S., Zhang, Y., Zheng, Y., Yuan, K., & Zhang, L. (2019). Understanding student engagement with peer feedback on master’s theses: A Macau study. Assessment & Evaluation in Higher Education, 44(1), 50-65. https://doi. org/10.1080/02602938.2018.1467879
Zhang, L. J. (2022). L2 writing: Toward a theory-practice praxis. In E. Hinkel (Ed.), Handbook of practical second language teaching and learning (pp. 331–343). Routledge.
Zhang, T. (2021). The effect of highly focused versus mid-focused written corrective feedback on EFL learners’ explicit and implicit knowledge development. System, 99, 102493. https://doi.org/10.1016/j.system.2021.102493
Zhang, Z. (2017). Student engagement with computer-generated feedback: A case study. ELT Journal, 71(3), 317–328. https://doi. org/10. 1093/elt/ ccw089
Zhang, Z. V., & Hyland, K. (2023). Student engagement with peer feedback in L2 writing: Insights from reflective journaling and revising practices. Assessing Writing, 58, 100784. https://doi. org/10.1016/j.asw.2023.100784
Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102. https://doi. org/10. 1016/j. asw. 2018. 02. 004
Zhang, Z., & Hyland, K. (2022). Fostering student engagement with feedback: An integrated approach. Assessing Writing, 51(100586), 1–16. https://doi. org/10.1016/j.asw. 2021. 100586
Zheng, Y., & Yu, S. (2018). Student engagement with teacher written corrective feedback in EFL writing: A case study of Chinese lower-proficiency students. Assessing Writing, 37, 13–24. https://doi. org/ 10. 1016/j. asw. 2018. 03. 001
Zheng, Y., Yu, S., & Liu, Z. (2023). Understanding individual differences in lower-proficiency students’ engagement with teacher written corrective feedback. Teaching in Higher Education, 28(2), 301-321. https://doi. org/10.1080/13562517.2020.1806225