Korea Business Review

Korea Business Review

Edited by: Hyoung-Goo Kang Print ISSN: 2951-3596 Online ISSN: 2951-360X © THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION. Frequency: Quarterly (four times per year): February 28, May 31, August 31, and November 30
Cover
Latest Issue Vol. 60, No. 5 2025

Article Info

The Validity on the Keyword Matching Scoring Methods in Writing Assessment

LEE, Ji-won

한국교원대학교

Korea Business Review 49Vol. 2No. pp.513-548 (2014)

DOI: 10.20880/kler.2014.49.2.513

Abstract

The purpose of this study was to investigate the validity on keyword matching scoring methods. In keyword extraction results, vocabulary differed according to a variety of writing performance of group classified from holistic rating results by human raters. Such are suggested that keyword matching scoring methods are valid to distinction of writing performance. As a result, high-level group keywords are deeper insight of topic and used to various ways of development in discussion. They also mainly used to vocabulary indicated the causal nexus in organization, formal and non-biased vocabulary in word selection. On the other side, low-level group keywords are mainly used to enumerate bits of examples way of development in discussion, emotional vocabulary which disrupt objectivity in the text. In addition, they are used to writer-centrism vocabulary which have colloquial, informal, biased traits. These result indicated that extract distinguished keywords between high-level and low-level group. Therefore, keyword scoring methods have validity in writing assessment system.

Keywords

키워드쓰기 평가키워드 채점평가방법평가자자동채점 프로그램키워드 산출평가자 신뢰도필자 중심적 글쓰기독자 중심적 글쓰기

References

  1. [1] [학술지(정기간행물)] 김민호/한국어 어휘의미망의 의미 관계를 이용한 어의 중의성 해소/정보과학회논문지 : 소프트웨어 및 응용/2011/38(10)/554~564/한국정보과학회/
  2. [2] [학술지(정기간행물)] 김일환/대규모 신문 기사의 자동 키워드 추출과 분석 -t-점수를 이용하여-/한국어학/2011/53/145~194/한국어학회/
  3. [3] [보고서] 대규모 평가를 위한 서답형 문항 자동채점 방안 연구/노은희/한국교육과정평가원/2012/~/연구보고 RRE2012-6
  4. [4] [학술지(정기간행물)] 박영민/학생 작문의 다니엘 효과와 예상독자 인식의 방법/새국어교육/2005/(70)/73~99/한국국어교육학회/
  5. [5] [학술지(정기간행물)] 박영민/중학생 논설문 평가의 모평균 추정과 평가 예시문 선정/국어교육/2010/(131)/437~461/한국어교육학회/
  6. [6] [학술지(정기간행물)] 박지영/의미연결망 분석을 통한 셀러브리티의 SNS 메시지 탐구 : 아이돌의 미투데이 메시지를 중심으로/방송통신연구/2013/3(82)/36~74/한국방송학회/
  7. [7] [학위논문] 윤창욱/비문학 지문 이독성 공식 개발에 관한 연구/석사/한국교원대학교 교육대학원/국어교육/2006
  8. [8] [학술지(정기간행물)] 정희모/대학생 글쓰기의 텍스트 비교 분석 연구-능숙한 필자와 미숙한 필자의 텍스트에 나타난 특징을 중심으로/국어교육학연구/2008/39(32)/393~426/국어교육학회/
  9. [9] [학술지(정기간행물)] 최숙기/텍스트 복잡도 기반의 읽기 교육용 제재의 정합성 평가 모형 개발 연구/국어교육/2012/45(139)/451~490/한국어교육학회/
  10. [10] [학술지(정기간행물)] 한관종/사회과학 방법론으로서의 연결망 분석기법 적용의 의의와 연구과제—의미와 연결망 분석(semantic network analysis)을 중심으로/사회과교육연구/2003/10(2)/219~235//
  11. [11] [단행본] 국어정보학/홍윤표/태학사/2012/~///
  12. [12] [학술지(정기간행물)] Attali, Y/Automated essay scoring with e-rater® V. 2/The Journal of Technology, Learning and Assessment/2006/4(3)/~//
  13. [13] [단행본] Enriching automated essay scoring using discourse marking/Burstein, J/ERIC Clearinghouse/2001/~///
  14. [14] [학술지(정기간행물)] Dunbar, S. B/Quality control in the development and use of performance assessments/Applied measurement in education/1991/4(4)/289~303//
  15. [15] [학술지(정기간행물)] Eells, W. C/Reliability of repeated grading of essay type examinations/Journal of Educational Psychology/1930/21(1)/48~//
  16. [16] [학술지(정기간행물)] Ellen W. Nold/The Discourse Matrix/College Composition and Communication/1980/31(1980)/141~152//
  17. [17] [학술지(정기간행물)] Gillam, R. B/Spoken and written language relationships in language/learning-impaired and normally achieving school-age children/Journal of Speech, Language, and Hearing Research/1992/35(6)/1303~1315//
  18. [18] [학술지(정기간행물)] Hughes, D. C/The use of model essays to reduce context effects in essay scoring/Journal of Educational Measurement/1984/21(3)/277~281//
  19. [19] [학술지(정기간행물)] Hyland, Ken/Is there an ‘academic vocabulary’?/TESOL quarterly/2007/41(2)/235~253//
  20. [20] [단행본] Grammatical Structures Written at The Three Grade levels/Kellogg W. Hunt/National Council of Teachers of English/1965/~///
  21. [21] [학술지(정기간행물)] Kilgarriff, A/Comparing corpora/International journal of corpus linguistics/2001/6(1)/97~133//
  22. [22] [기타자료] Landauer, T. K/Automated scoring and annotation of essays with the Intelligent Essay Assessor/Automated essay scoring: A cross-disciplinary perspective/2003/87~112//
  23. [23] [단행본] The measurement of work performance: Methods, theory, and applications/Landy, F. J/Academic Press/1983/~///
  24. [24] [단행본] Word frequencies in written and spoken English: based on the British National Corpus/Leech, G/Longman/2001/~///
  25. [25] [보고서] Transformational sentence-combining: A method for enhancing the development of syntactic fluency in English composition/Mellon, J. C/National Council of Teachers of English/1969/~/No. 10-13
  26. [26] [학술지(정기간행물)] Oakes, M. P/Use of the chi-squared test to examine vocabulary differences in English language corpora representing seven different countries/Literary and Linguistic Computing/2007/22(1)/85~99//
  27. [27] [학술지(정기간행물)] Paquot, M/Distinctive words in academic writing : A comparison of three statistical tests for keyword extraction/Language and Computers/2009/68(1)/247~269//
  28. [28] [학술지(정기간행물)] Saal, F. E/Rating the ratings : Assessing the psychometric quality of rating data/Psychological Bulletin/1980/88(2)/413~//
  29. [29] [학술지(정기간행물)] Thorndike, E. L/A constant error in psychological ratings/Journal of applied psychology/1920/4(1)/25~29//
  30. [30] [단행본] Contextualized language intervention/Ukrainetz, T. A/Thinking Publications/2006/~///
  31. [31] [학술대회논문] Witten, I. H/KEA: Practical automatic keyphrase extraction/Proceedings of the fourth ACM conference on Digital libraries/1999//255~/ACM

Korea Business Review · THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION.

Print ISSN 2951-3596 · Online ISSN 2951-360X

Privacy PolicyTerms of UseContact UsKMA Homepage

TEL : 010-2672-3919 EMAIL : kbr2editor@gmail.com 계좌번호 : 신한 140-009-175743 예금주 : (사)한국경영학회 COPYRIGHT ⓒ 2023 THE KOREAN ACADEMIC SOCIETY OF BUSINESS ADMINISTRATION. All rights reserved