Learners’ Experiences with Artificial Intelligence (AI) Chatbot for Korean Grammar Education - A Focus on Usage Patterns and Perception
Changkyung Song Seo Heeju Kim, Hojung
서울대학교 국어교육과 서울대학교 국어교육과 서울대학교
Korea Business Review 58Vol. 5No. pp.45-76 (2023)
Abstract
This study investigated the usage patterns and perceptions of normative grammar education in the Seoul National University, ETRI/TutorousLabs, and the Timbel Collaboration Project. Two types of chatbots were developed: a Q&A chatbot with students initiating questions and a system-driven chatbot with the chatbot initiating questions. Convenience sampling was employed to recruit 62 middle school students for the survey, which covered aspects such as frequency, style, usefulness, technical affordances, pedagogical affordances, social affordances, attitude, preference, and overall impression. Usefulness and attitude were scored on a 5-point Likert scale, whereas other items involved multiple-choice and open-ended questions. The findings were as follows: chatbots were used 1-2 times per week for less than 10 minutes. Several questions were of the “what” type, focusing on orthography areas at home or school for review purposes. Students rated the accessibility and knowledge improvement highly, with no reported anxiety about chatbot use. However, the ratings were relatively low for personalization, recommendations, and openness. Regarding attitude, there was a strong belief in knowledge improvement and a weak inclination to continue use. Regarding preferences, orthography and the Q&A chatbots were dominant. Finally, this study provides insights into the development, application, and research on chatbots in educational contexts.
Keywords
ChatbotQ&A chatbotSystem-driven chatbotNormative grammar educationUsage patternPerception
References
- [1] [인터넷자원] Introduction to natural language processing using deep learning/https://wikidocs.net/book/2155/Ahn, S. J.//WikiDocs/2023
- [2] [학술지(정기간행물)] Aminu, I. M./Strategic orientation, access to finance, business environment and SMEs performance in Nigeria : data screening and preliminary analysis/European Journal of Business and Management/2014/6(35)/124~132//
- [3] [학술지(정기간행물)] Ayedoun, E./A conversational agent to encourage willingness to communicate in the context of English as a foreign language/Procedia Computer Science/2015/60/1433~1442//
- [4] [학술지(정기간행물)] Brandtzaeg, P. B./Chatbots : changing user needs and motivations/Interactions/2018/25(5)/38~43//
- [5] [학술지(정기간행물)] Chen, H. L./A chatbot for learning Chinese : learning achievement and technology acceptance/Journal of Educational Computing Research/2020/58(6)/1161~1189//
- [6] [학위논문] Davis, G. M./Humanlike conversational artificial intelligence agents for foreign or second language learning: User perceptions, expectations, and interactions with agents//Stanford University//2022
- [7] [단행본] Questionnaires in second language research: construction, administration, and processing/Dörnyei, Z./Lawrence Erlbaum Associates/2002/~///
- [8] [학술지(정기간행물)] Fidan, M./Supporting the instructional videos with chatbot and peer feedback mechanisms in online learning : The effects on learning performance and intrinsic motivation/Journal of Educational Computing Research/2022/60(7)/1716~1741//
- [9] [학술지(정기간행물)] Følstad, A./Users’ experiences with chatbots : findings from a questionnaire study/Quality and User Experience/2020/5(1)/3~//
- [10] [단행본] SPSS for windows step by step : A simple guide and reference/George, D./Pearson/2010/~///
- [11] [학술지(정기간행물)] Goda, Y./Conversation with a chatbot before an online EFL group discussion and the effects on critical thinking/The Journal of Information and Systems in Education/2014/13(1)/1~7//
- [12] [학술지(정기간행물)] Haristiani, N./Artificial Intelligence(AI)chatbot as language learning medium : An inquiry/Journal of Physics : Conference Series/2019/1387(1)/1~6//
- [13] [학술지(정기간행물)] Huang, W./Chatbots for language learning : Are they really useful? A systematic review of chatbot-supported language learning/Journal of Computer Assisted Learning/2022/38(1)/237~257//
- [14] [인터넷자원] One-way ANOVA post hoc test/https://www.ibm.com/docs/en/spss-statistics/saas?topic=anova-one-way-post-hoc-tests/IBM/2023//2023
- [15] [학술지(정기간행물)] Kharis, M./Mobile gramabot : Development of a chatbot app for interactive german grammar learning/International Journal of Emerging Technologies in Learning/2022/17(14)/52~63//
- [16] [학술지(정기간행물)] 김은성/국어 문법 학습자의 음운에 대한 앎의 양상 연구/언어과학연구/2007/(42)/1~25/언어과학회/
- [17] [학술지(정기간행물)] Kim, J./Multi-turn chatbot based on query-context attentions and dual wasserstein generative adversarial networks/Applied Sciences/2019/9(18)/3908~//
- [18] [학술지(정기간행물)] 김나영/Effects of Voice Chat on EFL Learners’ Speaking Ability according to Proficiency Levels/멀티미디어 언어교육/2016/19(4)/63~88/한국멀티미디어언어교육학회/10.15702/mall.2016.19.4.63
- [19] [학술지(정기간행물)] 김나영/Chatbots and Korean EFL Students' English Vocabulary Learning/디지털융복합연구/2018/16(2)/1~7/한국디지털정책학회/https://doi.org/10.14400/JDC.2018.16.2.001
- [20] [학술지(정기간행물)] 김나영/A Study on Chatbots for Developing Korean College Students' English Listening and Reading Skills/디지털융복합연구/2018/16(8)/19~26/한국디지털정책학회/https://doi.org/10.14400/JDC.2018.16.8.019
- [21] [단행본] Principles and practice of structural equation modeling/Kline, R. B./The Guilford Press/2011/3~427///
- [22] [학술지(정기간행물)] Kohnke, L./ChatGPT for language teaching and learning/RELC Journal/2023/54(3)/1~14//
- [23] [학술지(정기간행물)] 구본관/문법 능력과 문법 평가 문항 개발의 방향/국어교육학연구/2010/(37)/185~218/국어교육학회/10.20880/kler.2010..37.185
- [24] [학술지(정기간행물)] 이장호/외국어학습을 위한 대화형 챗봇의 담화 분석을 통한 개선 방안 연구/멀티미디어 언어교육/2019/22(1)/132~153/한국멀티미디어언어교육학회/10.15702/mall.2019.22.1.132
- [25] [단행본] The theory of school grammar education/Lee, K. K./Korea University Ethnic Culture Research Institute/2008/~///
- [26] [학술지(정기간행물)] Min, H. S./The direction of the language norm policy/Journal of Korean Language Education/2003/12(0)/7~71//
- [27] [학술지(정기간행물)] 민윤정/기술수용모형을 적용한 학습용 챗봇 사용의도와 영향요인 간 구조적 관계 분석/교육정보미디어연구/2020/26(4)/799~825/한국교육정보미디어학회/http://dx.doi.org/10.15833/KAFEIAM.26.4.799
- [28] [학술지(정기간행물)] 남가영/국어 규범교육과 문법교육의 관계 설정 양상- 역대 국어과 교육과정 및 교과서의 사적(史的) 분석을 바탕으로/우리말글/2014/62/1~44/우리말글학회/10.18628/urimal.62..201409.1
- [29] [학술지(정기간행물)] 남가영/문법교육의 ‘지식의 구조’ 체계화 방향/국어교육/2007/(123)/341~374/한국어교육학회/
- [30] [학술지(정기간행물)] 백영경/한국어 화용 교육 보조 도구로서의 챗봇 개발 연구 -거절 화행을 중심으로-/이중언어학/2021/(84)/115~141/이중언어학회/10.17296/korbil.2021..84.115
- [31] [인터넷자원] 1st place Claude put ChatGPT, Bingchat, and Bard to shame/https://www.aitimes.com/news/articleView.html?idxno=151525/Park, C.//AI Times/2023
- [32] [학술지(정기간행물)] 박정아/한국어 교육용 AI 챗봇 개발을 위한 챗봇 빌더 활용 방안/외국어로서의 한국어교육/2021/63/51~91/언어연구교육원 한국어학당/https://doi.org/10.21716/TKFL.63.3
- [33] [단행본] Personal Knowledge : Towards a Post-critical Philosophy/Polanyi, M./University of Chicago Press/1962/~///
- [34] [단행본] Assessing grammar/Purpura, J. E./Cambridge University Press/2004/~///
- [35] [단행본] MRC CBU Wiki/Simon, S./University of Cambridge/2018/~///Testing normality including skewness and kurtosis
- [36] [학술지(정기간행물)] Smutny, P./Chatbots for learning : A review of educational chatbots for the Facebook Messenger/Computers & Education/2020/151/1~11//
- [37] [학술지(정기간행물)] 서지혜/시나리오를 기반으로 한 초급 한국어 말하기 연습용 챗봇 설계 방안 연구/문화와융합/2021/43(9)/53~76/한국문화융합학회/
- [38] [학술지(정기간행물)] Wang, Y. F./VILLAGE—Virtual immersive language learning and gaming environment : Immersion and presence/British Journal of Educational Technology/2017/48(2)/431~450//
- [39] [학술지(정기간행물)] 이기연/문법 능력 평가 내용 연구 - 문법적 판단력 설정을 중심으로 -/국어교육연구/2013/(32)/105~132/국어교육연구소/10.17313/jkorle.2013..32.105
- [40] [학술지(정기간행물)] 유지연/챗봇을 통한 스마트러닝 한국어교육의 학습 효과: 학습자 인식을 중심으로/멀티미디어 언어교육/2021/24(2)/82~105/한국멀티미디어언어교육학회/10.15702/mall.2021.24.2.82
- [41] [학술지(정기간행물)] 유혜령/문법교육 내용으로서 '문법'과 '활동'에 대한 재고/어문론총/2017/(72)/81~113/한국문학언어학회/10.22784/eomun.2017..72.81
