Korean Management Review

Korean Management Review

Edited by: Hee-ung Kim Print ISSN: 1226-1874 Online ISSN: 2951-3480 © THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION. Frequency: Publication Frequency: Six times per year (February 28, April 30, June 30, August 31, October 31, and December 31)
Cover
Latest Issue Vol. 60, No. 5 2025

Patterns of ChatGPT Engagement and Argumentative Writing Development

Kwak, Subeom

연세대학교

Korean Management Review 60Vol. 5No. pp.223-254 (2025)

DOI: 10.20880/kler.2025.60.5.223

Abstract

This study explored how first-year university students used ChatGPT during a semester-long academic writing course on argumentative writing. One hundred and twenty-four students enrolled in a required freshman writing course at a Korean university received explicit instruction in Toulmin-based argumentation and wrote argumentative essays. ChatGPT use for writing was measured across six subscales (surface revision, content elaboration, organization/coherence, metacognitive use, dependence, and collaborative refinement). Analytic rubric scores showed modest overall gains, with particularly strong improvements in evidence and counterarguments. The findings highlight that the quality, rather than mere presence, of AI use matters in strengthening the quality of argumentative writing.

Keywords

Artificial intelligenceChatGPTargumentative writingwriting instructionmixed-methods research

References

  1. [1] [학술지(정기간행물)] Aull L. L./From cow paths to conversation: Rethinking the argumentative essay/Pedagogy: Critical Approaches to Teaching Literature, Language, Composition, and Culture/2020/20(1)/21~34//
  2. [2] [학술지(정기간행물)] Bašić, Ž./ChatGPT-3.5 as writing assistance in students’ essays/Humanities and Social Sciences Communications/2023/10(1)/1~5//
  3. [3] [학술지(정기간행물)] Bedington A/Writing with generative AI and human-machine teaming: Insights and recommendations from faculty and students/Computers and Composition/2024/71/102833~//
  4. [4] [학술지(정기간행물)] Deep P. D./The role of AI in academic writing: Impacts on writing skills, critical thinking, and integrity in higher education/Societies/2025/15(9)/247~//10.3390/soc15090247
  5. [5] [학술지(정기간행물)] Ding L./Rise of generative artificial intelligence in science/Scientometrics/2025/130(9)/5093~5114//
  6. [6] [학술지(정기간행물)] Duschl, R. A./Supporting and promoting argumentation discourse in science education/Studies in Science Education/2002/38(1)/39~72//
  7. [7] [학술지(정기간행물)] Elycheikh A./Critical Integration of Generative AI in Higher Education: Cognitive, Pedagogical and Ethical Perspectives/London Journal of Research in Humanities & Social Science/2025/25(13)/1~12//
  8. [8] [학술지(정기간행물)] Fontenelle-Tereshchuk, D./Academic writing and ChatGPT: Students transitioning into college in the shadow of the COVID-19 pandemic/Discover Education/2024/3(1)/6~//10.1007/s44217-023-00076-5
  9. [9] [학술지(정기간행물)] Fryer L. K./Chatbot learning partners: Connecting learning experiences, interest and competence/Computers in Human Behavior/2019/93/279~289//
  10. [10] [학술지(정기간행물)] Fuchs K./Exploring the opportunities and challenges of NLP models in higher education: Is Chat GPT a blessing or a curse?/Frontiers in Education/2023/8/1166682~//
  11. [11] [학술지(정기간행물)] Godwin-Jones, R./Big data and language learning: Opportunities and challenges/Language Learning & Technology/2021/25(1)/4~19//
  12. [12] [학술지(정기간행물)] Graham S/A meta-analysis of writing instruction for students in the elementary grades/Journal of Educational Psychology/2012/104(4)/879~896//
  13. [13] [학술지(정기간행물)] Hutson J./Embracing AI in English composition: Insights and innovations in hybrid pedagogical practices/International Journal of Changes in Education/2024/1(1)/19~31//
  14. [14] [학술지(정기간행물)] Jin H/Collaboration with ChatGPT: preservice elementary teachers analyzing and interpreting student responses/Disciplinary and Interdisciplinary Science Education Research/2025/7(1)/27~//
  15. [15] [단행본] Best Practices in Writing Instruction/Karchmer R/Guilford/2007/222~241///Best practices in using the Internet to support writing
  16. [16] [학술지(정기간행물)] Kasneci, E./ChatGPT for good? On opportunities and challenges of large language models for education/Learning and Individual Differences/2023/103/102274~//
  17. [17] [학술지(정기간행물)] Kim J./Students-Generative AI interaction patterns and its impact on academic writing/Journal of Computing in Higher Education/2025//~//10.1007/s12528-025-09444-6
  18. [18] [학술지(정기간행물)] Kwak, S./Generative AI: A Writing Companion or a Hindrance?/Journal of Reading Research/2024/73/45~80//
  19. [19] [학술지(정기간행물)] Levine, S./How do students use ChatGPT as a writing support?/Journal of Adolescent & Adult Literacy/2024/68(5)/445~457//10.1002/jaal.1373
  20. [20] [학술지(정기간행물)] McNeil K. L./Synergy between teacher practices and curricular scaffolds to support students in using domain-specific and domain-general knowledge in writing arguments to explain phenomena/Journal of the Learning Sciences/2009/18(3)/416~460//
  21. [21] [학술지(정기간행물)] Nasr N./Exploring the Impact of Generative AI ChatGPT on Critical Thinking in Higher Education: Passive AI-Directed Use or Human–AI Supported Collaboration?/Education Sciences/2025/15(9)/1198~//10.3390/educsci15091198
  22. [22] [단행본] Teaching and learning argumentative writing in high school English language arts classrooms/Newell G. E./Routledge/2015/~///
  23. [23] [학술지(정기간행물)] Ranalli, J./Automated written corrective feedback: How well can students make use of it/Computer Assisted Language Learning/2018/31(7)/653~674//
  24. [24] [단행본] Teaching writing with a word processor, grades 7Y13/Rodriguez, D./ERIC Clearinghouse on Reading and Communication Skills and National Council of Teachers of English/1986/~///
  25. [25] [학술지(정기간행물)] Rudolph, J./ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?/Journal of Applied Learning and Teaching/2023/6(1)/342~363//
  26. [26] [학술지(정기간행물)] Steiss J./Comparing the quality of human and ChatGPT feedback on students’ writing/Learning and Instruction/2024//~//10.1016/j.learninstruc.2024.101894
  27. [27] [학술지(정기간행물)] Su Y/Collaborating with ChatGPT in argumentative writing classrooms/Assessing Writing/2023/57/100752~//
  28. [28] [학술지(정기간행물)] Tate, T./Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning/Discover Computing/2025/28(1)/72~//10.1007/s10791-025-09563-9
  29. [29] [학술지(정기간행물)] Thorp, H. H./ChatGPT is fun, but not an author/Science/2023/379(6630)/313~313//
  30. [30] [단행본] The Uses of Argument/Toulmin, S. E./Cambridge University Press/2003/~///
  31. [31] [학술지(정기간행물)] Tseng, W./AI-writing tools in education: If you can’t beat them, join them/Journal of China Computer-Assisted Language Learning/2023/3(2)/258~262//
  32. [32] [학술지(정기간행물)] Usher, M./From Prompt to Polished: Exploring Student–Chatbot Interactions for Academic Writing Assistance/Education Sciences/2025/15(3)/329~//10.3390/educsci15030329
  33. [33] [단행본] Argumentation: Analysis, Evaluation, Presentation/Van Eemeren, F. H./Routledge/2002/~///
  34. [34] [학술지(정기간행물)] Vetter M. A./Towards a framework for local interrogation of AI ethics: A case study on text generators, academic integrity, and composing with ChatGPT/Computers and Composition/2024/71/102831~//
  35. [35] [학술지(정기간행물)] Wang, C./Exploring Students’ Generative AI-Assisted Writing Processes: Perceptions and Experiences from Native and Nonnative English Speakers/Technology Knowledge and Learning/2025/30(3)/1825~1846//
  36. [36] [학술지(정기간행물)] Zhang M/A commentary of GPT-3 in MIT Technology Review 2021/Fundamental Research/2021/1(6)/831~833//

Korean Management Review · THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION.

Print ISSN 1226-1874 · Online ISSN 2951-3480

Privacy PolicyTerms of UseContact UsKMA Homepage

TEL : 010-8207-3258 EMAIL : editor_kmr@daum.net 계좌번호 : 신한 140-009-175782 예금주 : (사)한국경영학회 COPYRIGHT ⓒ 2026 THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION. All rights reserved